Nov 02 08:03:15.158845 ip-10-0-135-235 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Nov 02 08:03:15.158859 ip-10-0-135-235 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Nov 02 08:03:15.158869 ip-10-0-135-235 systemd[1]: kubelet.service: Failed with result 'resources'.
Nov 02 08:03:15.159291 ip-10-0-135-235 systemd[1]: Failed to start Kubernetes Kubelet.
Nov 02 08:03:25.407771 ip-10-0-135-235 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Nov 02 08:03:25.407786 ip-10-0-135-235 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot dacaf683edef46e1aed1391f63f199e9 --
Nov 02 08:05:37.002429 ip-10-0-135-235 systemd[1]: Starting Kubernetes Kubelet...
Nov 02 08:05:37.382517 ip-10-0-135-235 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 02 08:05:37.382517 ip-10-0-135-235 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 02 08:05:37.382517 ip-10-0-135-235 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 02 08:05:37.382517 ip-10-0-135-235 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 02 08:05:37.385674 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385593    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 08:05:37.385674 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385674    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 08:05:37.385674 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385678    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 08:05:37.385764 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385682    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 08:05:37.385764 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385685    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 08:05:37.385764 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385687    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 08:05:37.385764 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385690    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 08:05:37.385764 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385693    2577 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 08:05:37.385764 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385698    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 08:05:37.385764 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385703    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 08:05:37.385764 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385706    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 08:05:37.385764 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385709    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 08:05:37.385764 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385712    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 08:05:37.385764 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385716    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 08:05:37.385764 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385719    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 08:05:37.385764 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385721    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 08:05:37.385764 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385724    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 08:05:37.385764 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385727    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 08:05:37.385764 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385729    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 08:05:37.385764 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385732    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 08:05:37.385764 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385735    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 08:05:37.385764 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385738    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 08:05:37.386834 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385740    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 08:05:37.386834 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385743    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 08:05:37.386834 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385746    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 08:05:37.386834 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385749    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 08:05:37.386834 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385751    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 08:05:37.386834 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385754    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 08:05:37.386834 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385757    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 08:05:37.386834 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385760    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 08:05:37.386834 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385762    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 08:05:37.386834 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385765    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 08:05:37.386834 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385767    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 08:05:37.386834 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385770    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 08:05:37.386834 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385773    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 08:05:37.386834 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385776    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 08:05:37.386834 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385779    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 08:05:37.386834 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385781    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 08:05:37.386834 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385784    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 08:05:37.386834 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385787    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 08:05:37.386834 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385790    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 08:05:37.387313 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385792    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 08:05:37.387313 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385795    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 08:05:37.387313 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385797    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 08:05:37.387313 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385800    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 08:05:37.387313 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385803    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 08:05:37.387313 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385805    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 08:05:37.387313 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385807    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 08:05:37.387313 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385810    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 08:05:37.387313 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385813    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 08:05:37.387313 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385815    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 08:05:37.387313 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385818    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 08:05:37.387313 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385820    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 08:05:37.387313 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385823    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 08:05:37.387313 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385825    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 08:05:37.387313 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385830    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 08:05:37.387313 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385833    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 08:05:37.387313 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385835    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 08:05:37.387313 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385838    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 08:05:37.387313 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385841    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 08:05:37.387313 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385843    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 08:05:37.387785 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385846    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 08:05:37.387785 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385849    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 08:05:37.387785 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385852    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 08:05:37.387785 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385854    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 08:05:37.387785 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385857    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 08:05:37.387785 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385860    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 08:05:37.387785 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385863    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 08:05:37.387785 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385865    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 08:05:37.387785 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385868    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 08:05:37.387785 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385871    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 08:05:37.387785 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385873    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 08:05:37.387785 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385877    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 08:05:37.387785 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385880    2577 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 08:05:37.387785 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385882    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 08:05:37.387785 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385885    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 08:05:37.387785 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385887    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 08:05:37.387785 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385890    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 08:05:37.387785 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385892    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 08:05:37.387785 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385895    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 08:05:37.387785 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385897    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 08:05:37.388308 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385900    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 08:05:37.388308 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385903    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 08:05:37.388308 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385907    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 08:05:37.388308 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385910    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 08:05:37.388308 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385913    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 08:05:37.388308 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385916    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 08:05:37.388308 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385919    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 08:05:37.388308 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385922    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 08:05:37.388308 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385925    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 08:05:37.388308 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385928    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 08:05:37.388308 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385930    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 08:05:37.388308 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385933    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 08:05:37.388308 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385936    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 08:05:37.388308 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385939    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 08:05:37.388308 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385941    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 08:05:37.388308 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385944    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 08:05:37.388308 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385946    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 08:05:37.388308 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385949    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 08:05:37.388308 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385952    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 08:05:37.388762 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385954    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 08:05:37.388762 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385957    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 08:05:37.388762 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385960    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 08:05:37.388762 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385963    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 08:05:37.388762 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385971    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 08:05:37.388762 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.385976    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 08:05:37.388762 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386762    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 08:05:37.388762 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386769    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 08:05:37.388762 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386772    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 08:05:37.388762 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386775    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 08:05:37.388762 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386778    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 08:05:37.388762 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386780    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 08:05:37.388762 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386783    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 08:05:37.388762 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386786    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 08:05:37.388762 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386789    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 08:05:37.388762 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386791    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 08:05:37.388762 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386794    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 08:05:37.388762 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386797    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 08:05:37.388762 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386799    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 08:05:37.389244 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386803    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 08:05:37.389244 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386806    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 08:05:37.389244 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386809    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 08:05:37.389244 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386812    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 08:05:37.389244 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386815    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 08:05:37.389244 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386818    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 08:05:37.389244 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386821    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 08:05:37.389244 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386823    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 08:05:37.389244 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386826    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 08:05:37.389244 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386828    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 08:05:37.389244 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386831    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 08:05:37.389244 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386833    2577 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 08:05:37.389244 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386836    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 08:05:37.389244 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386839    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 08:05:37.389244 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386841    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 08:05:37.389244 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386844    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 08:05:37.389244 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386847    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 08:05:37.389244 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386850    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 08:05:37.389244 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386853    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 08:05:37.389244 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386856    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 08:05:37.389724 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386859    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 08:05:37.389724 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386862    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 08:05:37.389724 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386865    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 08:05:37.389724 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386867    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 08:05:37.389724 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386870    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 08:05:37.389724 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386872    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 08:05:37.389724 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386875    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 08:05:37.389724 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386877    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 08:05:37.389724 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386880    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 08:05:37.389724 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386882    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 08:05:37.389724 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386885    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 08:05:37.389724 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386887    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 08:05:37.389724 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386890    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 08:05:37.389724 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386893    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 08:05:37.389724 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386896    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 08:05:37.389724 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386899    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 08:05:37.389724 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386901    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 08:05:37.389724 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386905    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 08:05:37.389724 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386907    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 08:05:37.390197 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386909    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 08:05:37.390197 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386912    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 08:05:37.390197 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386915    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 08:05:37.390197 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386917    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 08:05:37.390197 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386920    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 08:05:37.390197 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386923    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 08:05:37.390197 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386925    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 08:05:37.390197 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386928    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 08:05:37.390197 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386930    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 08:05:37.390197 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386933    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 08:05:37.390197 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386935    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 08:05:37.390197 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386938    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 08:05:37.390197 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386941    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 08:05:37.390197 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386944    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 08:05:37.390197 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386946    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 08:05:37.390197 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386949    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 08:05:37.390197 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386951    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 08:05:37.390197 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386954    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 08:05:37.390197 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386957    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 08:05:37.390197 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386960    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 08:05:37.390674 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386962    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 08:05:37.390674 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386964    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 08:05:37.390674 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386967    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 08:05:37.390674 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386970    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 08:05:37.390674 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386972    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 08:05:37.390674 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386977    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 08:05:37.390674 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386981    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 08:05:37.390674 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386984    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 08:05:37.390674 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386986    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 08:05:37.390674 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386989    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 08:05:37.390674 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386991    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 08:05:37.390674 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386994    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 08:05:37.390674 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.386997    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 08:05:37.390674 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387000    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 08:05:37.390674 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387002    2577 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 08:05:37.390674 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387005    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 08:05:37.390674 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387008    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 08:05:37.390674 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387010    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 08:05:37.390674 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387012    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 08:05:37.391120 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387015    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 08:05:37.391120 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387018    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 08:05:37.391120 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387020    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 08:05:37.391120 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387023    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 08:05:37.391120 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387025    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 08:05:37.391120 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387028    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 08:05:37.391120 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387031    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 08:05:37.391120 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387034    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 08:05:37.391120 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387036    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 08:05:37.391120 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387041    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 08:05:37.391120 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387045    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 08:05:37.391120 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387048    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 08:05:37.391120 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387050    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 08:05:37.391120 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387053    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 08:05:37.391120 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387056    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 08:05:37.391120 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387587    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 08:05:37.391120 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387593    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 08:05:37.391120 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387598    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 08:05:37.391120 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387602    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 08:05:37.391586 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387606    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 08:05:37.391586 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387609    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 08:05:37.391586 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387612    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 08:05:37.391586 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387616    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 08:05:37.391586 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387618    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 08:05:37.391586 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387621    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 08:05:37.391586 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387624    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 08:05:37.391586 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387627    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 08:05:37.391586 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387630    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 08:05:37.391586 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387633    2577 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 08:05:37.391586 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387635    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 08:05:37.391586 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387638    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 08:05:37.391586 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387640    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 08:05:37.391586 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387643    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 08:05:37.391586 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387645    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 08:05:37.391586 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387648    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 08:05:37.391586 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387650    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 08:05:37.391586 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387653    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 08:05:37.391586 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387656    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 08:05:37.392015 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387658    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 08:05:37.392015 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387661    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 08:05:37.392015 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387664    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 08:05:37.392015 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387667    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 08:05:37.392015 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387669    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 08:05:37.392015 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387672    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 08:05:37.392015 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387674    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 08:05:37.392015 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387677    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 08:05:37.392015 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387679    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 08:05:37.392015 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387683    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 08:05:37.392015 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387686    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 08:05:37.392015 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387689    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 08:05:37.392015 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387692    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 08:05:37.392015 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387695    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 08:05:37.392015 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387698    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 08:05:37.392015 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387700    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 08:05:37.392015 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387703    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 08:05:37.392015 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387706    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 08:05:37.392015 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387709    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 08:05:37.392015 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387711    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 08:05:37.392577 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387714    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 08:05:37.392577 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387717    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 08:05:37.392577 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387719    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 08:05:37.392577 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387722    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 08:05:37.392577 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387724    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 08:05:37.392577 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387727    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 08:05:37.392577 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387729    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 08:05:37.392577 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387732    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 08:05:37.392577 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387735    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 08:05:37.392577 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387737    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 08:05:37.392577 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387740    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 08:05:37.392577 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387742    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 08:05:37.392577 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387745    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 08:05:37.392577 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387747    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 08:05:37.392577 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387751    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 08:05:37.392577 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387753    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 08:05:37.392577 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387756    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 08:05:37.392577 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387759    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 08:05:37.392577 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387761    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 08:05:37.393066 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387764    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 08:05:37.393066 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387766    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 08:05:37.393066 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387769    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 08:05:37.393066 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387771    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 08:05:37.393066 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387774    2577 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 08:05:37.393066 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387777    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 08:05:37.393066 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387782    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 08:05:37.393066 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387786    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 08:05:37.393066 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387790    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 08:05:37.393066 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387794    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 08:05:37.393066 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387797    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 08:05:37.393066 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387800    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 08:05:37.393066 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387804    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 08:05:37.393066 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387807    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 08:05:37.393066 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387810    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 08:05:37.393066 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387813    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 08:05:37.393066 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387815    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 08:05:37.393066 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387818    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 08:05:37.393066 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387821    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 08:05:37.393066 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387823    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 08:05:37.393562 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387826    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 08:05:37.393562 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387828    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 08:05:37.393562 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387831    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 08:05:37.393562 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387835    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 08:05:37.393562 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387838    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 08:05:37.393562 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387840    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 08:05:37.393562 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387842    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 08:05:37.393562 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387845    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 08:05:37.393562 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387848    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 08:05:37.393562 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387851    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 08:05:37.393562 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387853    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 08:05:37.393562 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387856    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 08:05:37.393562 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387858    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 08:05:37.393562 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387861    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 08:05:37.393562 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387863    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 08:05:37.393562 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387866    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 08:05:37.393562 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387868    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 08:05:37.393562 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387871    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 08:05:37.393562 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387875    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 08:05:37.394029 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387877    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 08:05:37.394029 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387880    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 08:05:37.394029 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387882    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 08:05:37.394029 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387885    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 08:05:37.394029 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.387887    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 08:05:37.394029 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388776    2577 flags.go:64] FLAG: --address="0.0.0.0"
Nov 02 08:05:37.394029 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388786    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 02 08:05:37.394029 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388792    2577 flags.go:64] FLAG: --anonymous-auth="true"
Nov 02 08:05:37.394029 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388797    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 02 08:05:37.394029 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388802    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 02 08:05:37.394029 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388805    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 02 08:05:37.394029 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388810    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 02 08:05:37.394029 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388814    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 02 08:05:37.394029 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388818    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 02 08:05:37.394029 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388821    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 02 08:05:37.394029 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388824    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 02 08:05:37.394029 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388828    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 02 08:05:37.394029 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388831    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 02 08:05:37.394029 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388834    2577 flags.go:64] FLAG: --cgroup-root=""
Nov 02 08:05:37.394029 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388837    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 02 08:05:37.394029 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388840    2577 flags.go:64] FLAG: --client-ca-file=""
Nov 02 08:05:37.394029 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388843    2577 flags.go:64] FLAG: --cloud-provider="external"
Nov 02 08:05:37.394029 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388847    2577 flags.go:64] FLAG: --cluster-dns="[]"
Nov 02 08:05:37.394572 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388851    2577 flags.go:64] FLAG: --cluster-domain=""
Nov 02 08:05:37.394572 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388855    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 02 08:05:37.394572 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388858    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 02 08:05:37.394572 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388861    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 02 08:05:37.394572 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388865    2577 flags.go:64] FLAG: --container-log-max-files="5"
Nov 02 08:05:37.394572 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388869    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 02 08:05:37.394572 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388872    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 02 08:05:37.394572 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388876    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 02 08:05:37.394572 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388881    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 02 08:05:37.394572 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388884    2577 flags.go:64] FLAG: --contention-profiling="false"
Nov 02 08:05:37.394572 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388888    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 02 08:05:37.394572 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388891    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 02 08:05:37.394572 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388894    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 02 08:05:37.394572 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388898    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 02 08:05:37.394572 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388902    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 02 08:05:37.394572 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388905    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 02 08:05:37.394572 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388908    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 02 08:05:37.394572 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388911    2577 flags.go:64] FLAG: --enable-load-reader="false"
Nov 02 08:05:37.394572 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388914    2577 flags.go:64] FLAG: --enable-server="true"
Nov 02 08:05:37.394572 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388917    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 02 08:05:37.394572 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388921    2577 flags.go:64] FLAG: --event-burst="100"
Nov 02 08:05:37.394572 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388924    2577 flags.go:64] FLAG: --event-qps="50"
Nov 02 08:05:37.394572 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388927    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 02 08:05:37.394572 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388930    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 02 08:05:37.395210 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388933    2577 flags.go:64] FLAG: --eviction-hard=""
Nov 02 08:05:37.395210 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388937    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 02 08:05:37.395210 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388940    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 02 08:05:37.395210 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388943    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 02 08:05:37.395210 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388946    2577 flags.go:64] FLAG: --eviction-soft=""
Nov 02 08:05:37.395210 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388949    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 02 08:05:37.395210 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388952    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 02 08:05:37.395210 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388955    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 02 08:05:37.395210 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388958    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 02 08:05:37.395210 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388961    2577 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 02 08:05:37.395210 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388964    2577 flags.go:64] FLAG: --fail-swap-on="true"
Nov 02 08:05:37.395210 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388967    2577 flags.go:64] FLAG: --feature-gates=""
Nov 02 08:05:37.395210 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388971    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 02 08:05:37.395210 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388974    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 02 08:05:37.395210 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388978    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 02 08:05:37.395210 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388981    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 02 08:05:37.395210 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388985    2577 flags.go:64] FLAG: --healthz-port="10248"
Nov 02 08:05:37.395210 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388988    2577 flags.go:64] FLAG: --help="false"
Nov 02 08:05:37.395210 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388991    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:05:37.395210 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388995    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 02 08:05:37.395210 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.388998    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 02 08:05:37.395210 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389001    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 02 08:05:37.395210 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389005    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 02 08:05:37.395760 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389008    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 02 08:05:37.395760 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389011    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 02 08:05:37.395760 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389014    2577 flags.go:64] FLAG: --image-service-endpoint=""
Nov 02 08:05:37.395760 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389017    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 02 08:05:37.395760 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389020    2577 flags.go:64] FLAG: --kube-api-burst="100"
Nov 02 08:05:37.395760 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389023    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 02 08:05:37.395760 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389026    2577 flags.go:64] FLAG: --kube-api-qps="50"
Nov 02 08:05:37.395760 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389029    2577 flags.go:64] FLAG: --kube-reserved=""
Nov 02 08:05:37.395760 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389032    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 02 08:05:37.395760 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389035    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 02 08:05:37.395760 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389038    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 02 08:05:37.395760 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389041    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 02 08:05:37.395760 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389044    2577 flags.go:64] FLAG: --lock-file=""
Nov 02 08:05:37.395760 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389047    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 02 08:05:37.395760 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389050    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 02 08:05:37.395760 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389053    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 02 08:05:37.395760 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389059    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 02 08:05:37.395760 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389062    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 02 08:05:37.395760 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389065    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 02 08:05:37.395760 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389069    2577 flags.go:64] FLAG: --logging-format="text"
Nov 02 08:05:37.395760 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389072    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 02 08:05:37.395760 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389076    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 02 08:05:37.395760 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389079    2577 flags.go:64] FLAG: --manifest-url=""
Nov 02 08:05:37.395760 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389082    2577 flags.go:64] FLAG: --manifest-url-header=""
Nov 02 08:05:37.395760 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389086    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 02 08:05:37.396402 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389091    2577 flags.go:64] FLAG: --max-open-files="1000000"
Nov 02 08:05:37.396402 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389095    2577 flags.go:64] FLAG: --max-pods="110"
Nov 02 08:05:37.396402 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389098    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 02 08:05:37.396402 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389101    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 02 08:05:37.396402 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389104    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 02 08:05:37.396402 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389107    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 02 08:05:37.396402 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389110    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 02 08:05:37.396402 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389113    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 02 08:05:37.396402 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389116    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 02 08:05:37.396402 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389125    2577 flags.go:64] FLAG: --node-status-max-images="50"
Nov 02 08:05:37.396402 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389138    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 02 08:05:37.396402 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389142    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 02 08:05:37.396402 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389145    2577 flags.go:64] FLAG: --pod-cidr=""
Nov 02 08:05:37.396402 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389148    2577 flags.go:64] FLAG: --pod-manifest-path=""
Nov 02 08:05:37.396402 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389151    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 02 08:05:37.396402 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389154    2577 flags.go:64] FLAG: --pods-per-core="0"
Nov 02 08:05:37.396402 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389157    2577 flags.go:64] FLAG: --port="10250"
Nov 02 08:05:37.396402 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389159    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 02 08:05:37.396402 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389162    2577 flags.go:64] FLAG: --provider-id="aws:///us-west-2a/i-0a82209b6a62da828"
Nov 02 08:05:37.396402 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389166    2577 flags.go:64] FLAG: --qos-reserved=""
Nov 02 08:05:37.396402 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389169    2577 flags.go:64] FLAG: --read-only-port="10255"
Nov 02 08:05:37.396402 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389172    2577 flags.go:64] FLAG: --register-node="true"
Nov 02 08:05:37.396402 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389175    2577 flags.go:64] FLAG: --register-with-taints=""
Nov 02 08:05:37.396402 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389179    2577 flags.go:64] FLAG: --registry-burst="10"
Nov 02 08:05:37.396402 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389182    2577 flags.go:64] FLAG: --registry-qps="5"
Nov 02 08:05:37.396402 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389185    2577 flags.go:64] FLAG: --reserved-cpus=""
Nov 02 08:05:37.397336 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389188    2577 flags.go:64] FLAG: --reserved-memory=""
Nov 02 08:05:37.397336 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389192    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 02 08:05:37.397336 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389196    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 02 08:05:37.397336 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389199    2577 flags.go:64] FLAG: --rotate-certificates="false"
Nov 02 08:05:37.397336 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389202    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 02 08:05:37.397336 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389204    2577 flags.go:64] FLAG: --runonce="false"
Nov 02 08:05:37.397336 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389209    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 02 08:05:37.397336 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389212    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 02 08:05:37.397336 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389216    2577 flags.go:64] FLAG: --seccomp-default="false"
Nov 02 08:05:37.397336 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389219    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 02 08:05:37.397336 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389222    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 02 08:05:37.397336 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389225    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 02 08:05:37.397336 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389228    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 02 08:05:37.397336 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389232    2577 flags.go:64] FLAG: --storage-driver-password="root"
Nov 02 08:05:37.397336 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389235    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 02 08:05:37.397336 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389237    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 02 08:05:37.397336 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389240    2577 flags.go:64] FLAG: --storage-driver-user="root"
Nov 02 08:05:37.397336 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389243    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 02 08:05:37.397336 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389247    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 02 08:05:37.397336 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389250    2577 flags.go:64] FLAG: --system-cgroups=""
Nov 02 08:05:37.397336 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389253    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 02 08:05:37.397336 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389258    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 02 08:05:37.397336 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389261    2577 flags.go:64] FLAG: --tls-cert-file=""
Nov 02 08:05:37.397336 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389264    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 02 08:05:37.397336 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389268    2577 flags.go:64] FLAG: --tls-min-version=""
Nov 02 08:05:37.398058 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389271    2577 flags.go:64] FLAG: --tls-private-key-file=""
Nov 02 08:05:37.398058 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389274    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 02 08:05:37.398058 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389277    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 02 08:05:37.398058 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389280    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 02 08:05:37.398058 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389283    2577 flags.go:64] FLAG: --v="2"
Nov 02 08:05:37.398058 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389287    2577 flags.go:64] FLAG: --version="false"
Nov 02 08:05:37.398058 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389291    2577 flags.go:64] FLAG: --vmodule=""
Nov 02 08:05:37.398058 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389295    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 02 08:05:37.398058 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389299    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 02 08:05:37.398058 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389455    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 08:05:37.398058 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389460    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 08:05:37.398058 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389463    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 08:05:37.398058 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389466    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 08:05:37.398058 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389469    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 08:05:37.398058 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389472    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 08:05:37.398058 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389478    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 08:05:37.398058 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389483    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 08:05:37.398058 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389486    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 08:05:37.398058 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389489    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 08:05:37.398058 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389491    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 08:05:37.398058 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389494    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 08:05:37.398656 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389497    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 08:05:37.398656 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389499    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 08:05:37.398656 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389501    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 08:05:37.398656 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389504    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 08:05:37.398656 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389507    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 08:05:37.398656 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389510    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 08:05:37.398656 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389512    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 08:05:37.398656 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389515    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 08:05:37.398656 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389517    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 08:05:37.398656 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389520    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 08:05:37.398656 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389523    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 08:05:37.398656 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389525    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 08:05:37.398656 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389528    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 08:05:37.398656 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389531    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 08:05:37.398656 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389533    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 08:05:37.398656 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389536    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 08:05:37.398656 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389539    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 08:05:37.398656 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389541    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 08:05:37.398656 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389543    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 08:05:37.399206 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389546    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 08:05:37.399206 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389549    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 08:05:37.399206 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389552    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 08:05:37.399206 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389554    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 08:05:37.399206 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389557    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 08:05:37.399206 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389559    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 08:05:37.399206 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389562    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 08:05:37.399206 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389566    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 08:05:37.399206 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389568    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 08:05:37.399206 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389571    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 08:05:37.399206 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389574    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 08:05:37.399206 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389576    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 08:05:37.399206 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389579    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 08:05:37.399206 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389582    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 08:05:37.399206 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389584    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 08:05:37.399206 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389587    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 08:05:37.399206 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389589    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 08:05:37.399206 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389592    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 08:05:37.399206 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389595    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 08:05:37.399206 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389597    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 08:05:37.399726 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389600    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 08:05:37.399726 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389602    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 08:05:37.399726 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389605    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 08:05:37.399726 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389608    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 08:05:37.399726 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389611    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 08:05:37.399726 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389613    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 08:05:37.399726 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389616    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 08:05:37.399726 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389618    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 08:05:37.399726 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389620    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 08:05:37.399726 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389623    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 08:05:37.399726 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389625    2577 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 08:05:37.399726 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389628    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 08:05:37.399726 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389631    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 08:05:37.399726 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389633    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 08:05:37.399726 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389636    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 08:05:37.399726 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389639    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 08:05:37.399726 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389641    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 08:05:37.399726 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389644    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 08:05:37.399726 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389646    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 08:05:37.399726 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389650    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 08:05:37.400300 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389653    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 08:05:37.400300 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389655    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 08:05:37.400300 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389658    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 08:05:37.400300 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389660    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 08:05:37.400300 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389663    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 08:05:37.400300 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389665    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 08:05:37.400300 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389668    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 08:05:37.400300 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389670    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 08:05:37.400300 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389673    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 08:05:37.400300 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389675    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 08:05:37.400300 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389678    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 08:05:37.400300 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389680    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 08:05:37.400300 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389683    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 08:05:37.400300 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389685    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 08:05:37.400300 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389688    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 08:05:37.400300 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389691    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 08:05:37.400300 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389693    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 08:05:37.400300 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389696    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 08:05:37.400300 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389698    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 08:05:37.400300 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389701    2577 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 08:05:37.400829 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389703    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 08:05:37.400829 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389706    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 08:05:37.400829 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389708    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 08:05:37.400829 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389711    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 08:05:37.400829 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389713    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 08:05:37.400829 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389716    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 08:05:37.400829 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389718    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 08:05:37.400829 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389722    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 08:05:37.400829 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389725    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 08:05:37.400829 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389727    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 08:05:37.400829 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389730    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 08:05:37.400829 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389734    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 08:05:37.400829 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389737    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 08:05:37.400829 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389739    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 08:05:37.400829 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389743    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 08:05:37.401255 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.389771    2577 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 02 08:05:37.401255 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389814    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 08:05:37.401255 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389819    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 08:05:37.401255 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389823    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 08:05:37.401255 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389826    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 08:05:37.401255 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389828    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 08:05:37.401255 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389831    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 08:05:37.401255 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389834    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 08:05:37.401255 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389838    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 08:05:37.401255 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389842    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 08:05:37.401255 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389844    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 08:05:37.401255 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389848    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 08:05:37.401255 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389851    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 08:05:37.401255 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389854    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 08:05:37.401255 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389856    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 08:05:37.401659 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389859    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 08:05:37.401659 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389862    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 08:05:37.401659 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389864    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 08:05:37.401659 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389867    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 08:05:37.401659 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389870    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 08:05:37.401659 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389873    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 08:05:37.401659 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389875    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 08:05:37.401659 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389878    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 08:05:37.401659 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389880    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 08:05:37.401659 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389883    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 08:05:37.401659 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389886    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 08:05:37.401659 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389888    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 08:05:37.401659 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389891    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 08:05:37.401659 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389894    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 08:05:37.401659 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389898    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 08:05:37.401659 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389900    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 08:05:37.401659 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389903    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 08:05:37.401659 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389905    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 08:05:37.401659 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389908    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 08:05:37.402123 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389911    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 08:05:37.402123 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389913    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 08:05:37.402123 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389916    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 08:05:37.402123 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389918    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 08:05:37.402123 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389921    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 08:05:37.402123 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389924    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 08:05:37.402123 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389926    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 08:05:37.402123 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389929    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 08:05:37.402123 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389932    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 08:05:37.402123 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389936    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 08:05:37.402123 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389939    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 08:05:37.402123 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389941    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 08:05:37.402123 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389945    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 08:05:37.402123 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389947    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 08:05:37.402123 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389950    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 08:05:37.402123 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389952    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 08:05:37.402123 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389955    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 08:05:37.402123 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389958    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 08:05:37.402123 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389960    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 08:05:37.402123 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389963    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 08:05:37.402621 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389972    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 08:05:37.402621 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389977    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 08:05:37.402621 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389980    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 08:05:37.402621 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389982    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 08:05:37.402621 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389986    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 08:05:37.402621 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389988    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 08:05:37.402621 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389991    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 08:05:37.402621 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389995    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 08:05:37.402621 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.389998    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 08:05:37.402621 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390000    2577 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 08:05:37.402621 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390003    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 08:05:37.402621 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390005    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 08:05:37.402621 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390008    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 08:05:37.402621 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390010    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 08:05:37.402621 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390013    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 08:05:37.402621 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390015    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 08:05:37.402621 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390018    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 08:05:37.402621 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390021    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 08:05:37.402621 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390023    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 08:05:37.402621 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390026    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 08:05:37.403137 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390029    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 08:05:37.403137 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390033    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 08:05:37.403137 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390035    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 08:05:37.403137 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390038    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 08:05:37.403137 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390041    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 08:05:37.403137 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390043    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 08:05:37.403137 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390046    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 08:05:37.403137 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390048    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 08:05:37.403137 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390051    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 08:05:37.403137 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390054    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 08:05:37.403137 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390056    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 08:05:37.403137 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390059    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 08:05:37.403137 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390061    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 08:05:37.403137 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390064    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 08:05:37.403137 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390067    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 08:05:37.403137 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390069    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 08:05:37.403137 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390072    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 08:05:37.403137 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390075    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 08:05:37.403137 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390077    2577 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 08:05:37.403137 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390081    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 08:05:37.403620 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390084    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 08:05:37.403620 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390087    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 08:05:37.403620 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390089    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 08:05:37.403620 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390092    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 08:05:37.403620 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390094    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 08:05:37.403620 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390097    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 08:05:37.403620 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390099    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 08:05:37.403620 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390103    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 08:05:37.403620 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390106    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 08:05:37.403620 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390108    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 08:05:37.403620 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390111    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 08:05:37.403620 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390114    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 08:05:37.403620 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.390116    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 08:05:37.403620 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.398555    2577 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 02 08:05:37.403620 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.398571    2577 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 02 08:05:37.403620 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.398598    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 02 08:05:37.403620 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.398603    2577 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 02 08:05:37.403620 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398666    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 08:05:37.403620 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398672    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 08:05:37.404076 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398676    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 08:05:37.404076 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398679    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 08:05:37.404076 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398682    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 08:05:37.404076 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398685    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 08:05:37.404076 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398687    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 08:05:37.404076 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398690    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 08:05:37.404076 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398693    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 08:05:37.404076 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398695    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 08:05:37.404076 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398698    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 08:05:37.404076 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398701    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 08:05:37.404076 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398705    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 08:05:37.404076 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398710    2577 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 08:05:37.404076 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398714    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 08:05:37.404076 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398717    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 08:05:37.404076 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398720    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 08:05:37.404076 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398722    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 08:05:37.404076 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398725    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 08:05:37.404076 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398728    2577 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 08:05:37.404076 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398731    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 08:05:37.404076 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398734    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 08:05:37.404549 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398737    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 08:05:37.404549 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398740    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 08:05:37.404549 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398742    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 08:05:37.404549 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398745    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 08:05:37.404549 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398747    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 08:05:37.404549 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398750    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 08:05:37.404549 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398754    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 08:05:37.404549 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398757    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 08:05:37.404549 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398760    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 08:05:37.404549 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398763    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 08:05:37.404549 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398766    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 08:05:37.404549 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398768    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 08:05:37.404549 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398771    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 08:05:37.404549 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398774    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 08:05:37.404549 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398776    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 08:05:37.404549 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398779    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 08:05:37.404549 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398781    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 08:05:37.404549 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398784    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 08:05:37.404549 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398786    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 08:05:37.405022 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398789    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 08:05:37.405022 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398792    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 08:05:37.405022 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398795    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 08:05:37.405022 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398797    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 08:05:37.405022 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398800    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 08:05:37.405022 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398804    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 08:05:37.405022 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398807    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 08:05:37.405022 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398810    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 08:05:37.405022 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398812    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 08:05:37.405022 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398815    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 08:05:37.405022 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398818    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 08:05:37.405022 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398821    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 08:05:37.405022 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398824    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 08:05:37.405022 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398826    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 08:05:37.405022 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398829    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 08:05:37.405022 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398832    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 08:05:37.405022 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398834    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 08:05:37.405022 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398837    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 08:05:37.405022 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398839    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 08:05:37.405022 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398842    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 08:05:37.405502 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398844    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 08:05:37.405502 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398847    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 08:05:37.405502 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398851    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 08:05:37.405502 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398855    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 08:05:37.405502 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398859    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 08:05:37.405502 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398862    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 08:05:37.405502 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398864    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 08:05:37.405502 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398867    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 08:05:37.405502 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398869    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 08:05:37.405502 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398872    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 08:05:37.405502 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398874    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 08:05:37.405502 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398877    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 08:05:37.405502 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398880    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 08:05:37.405502 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398882    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 08:05:37.405502 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398885    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 08:05:37.405502 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398887    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 08:05:37.405502 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398890    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 08:05:37.405502 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398894    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 08:05:37.405502 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398898    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 08:05:37.405971 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398901    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 08:05:37.405971 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398903    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 08:05:37.405971 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398906    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 08:05:37.405971 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398909    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 08:05:37.405971 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398911    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 08:05:37.405971 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398914    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 08:05:37.405971 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398917    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 08:05:37.405971 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398919    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 08:05:37.405971 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398922    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 08:05:37.405971 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398924    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 08:05:37.405971 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398927    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 08:05:37.405971 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398930    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 08:05:37.405971 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398932    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 08:05:37.405971 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398935    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 08:05:37.405971 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398937    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 08:05:37.405971 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398940    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 08:05:37.405971 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398943    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 08:05:37.405971 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398945    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 08:05:37.405971 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398948    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 08:05:37.405971 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398950    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 08:05:37.406454 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398953    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 08:05:37.406454 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398955    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 08:05:37.406454 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398958    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 08:05:37.406454 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398961    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 08:05:37.406454 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398963    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 08:05:37.406454 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.398966    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 08:05:37.406454 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.398994    2577 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 02 08:05:37.406454 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399153    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 08:05:37.406454 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399158    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 08:05:37.406454 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399161    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 08:05:37.406454 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399164    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 08:05:37.406454 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399167    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 08:05:37.406454 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399171    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 08:05:37.406454 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399174    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 08:05:37.406454 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399177    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 08:05:37.406454 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399179    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 08:05:37.406842 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399182    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 08:05:37.406842 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399185    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 08:05:37.406842 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399187    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 08:05:37.406842 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399190    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 08:05:37.406842 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399193    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 08:05:37.406842 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399195    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 08:05:37.406842 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399198    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 08:05:37.406842 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399200    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 08:05:37.406842 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399203    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 08:05:37.406842 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399205    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 08:05:37.406842 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399208    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 08:05:37.406842 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399211    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 08:05:37.406842 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399213    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 08:05:37.406842 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399216    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 08:05:37.406842 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399219    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 08:05:37.406842 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399222    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 08:05:37.406842 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399225    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 08:05:37.406842 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399227    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 08:05:37.406842 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399230    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 08:05:37.406842 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399232    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 08:05:37.407471 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399235    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 08:05:37.407471 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399237    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 08:05:37.407471 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399240    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 08:05:37.407471 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399242    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 08:05:37.407471 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399246    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 08:05:37.407471 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399249    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 08:05:37.407471 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399252    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 08:05:37.407471 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399254    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 08:05:37.407471 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399257    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 08:05:37.407471 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399260    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 08:05:37.407471 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399263    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 08:05:37.407471 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399266    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 08:05:37.407471 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399270    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 08:05:37.407471 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399273    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 08:05:37.407471 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399276    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 08:05:37.407471 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399278    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 08:05:37.407471 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399281    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 08:05:37.407471 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399283    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 08:05:37.407471 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399286    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 08:05:37.407909 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399288    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 08:05:37.407909 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399291    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 08:05:37.407909 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399293    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 08:05:37.407909 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399295    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 08:05:37.407909 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399298    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 08:05:37.407909 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399301    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 08:05:37.407909 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399305    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 08:05:37.407909 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399308    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 08:05:37.407909 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399310    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 08:05:37.407909 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399313    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 08:05:37.407909 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399315    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 08:05:37.407909 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399318    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 08:05:37.407909 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399321    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 08:05:37.407909 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399323    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 08:05:37.407909 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399326    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 08:05:37.407909 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399328    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 08:05:37.407909 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399331    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 08:05:37.407909 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399334    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 08:05:37.407909 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399336    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 08:05:37.408369 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399339    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 08:05:37.408369 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399342    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 08:05:37.408369 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399344    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 08:05:37.408369 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399347    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 08:05:37.408369 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399350    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 08:05:37.408369 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399352    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 08:05:37.408369 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399355    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 08:05:37.408369 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399358    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 08:05:37.408369 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399360    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 08:05:37.408369 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399363    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 08:05:37.408369 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399366    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 08:05:37.408369 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399368    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 08:05:37.408369 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399371    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 08:05:37.408369 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399374    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 08:05:37.408369 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399376    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 08:05:37.408369 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399382    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 08:05:37.408369 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399384    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 08:05:37.408369 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399387    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 08:05:37.408369 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399389    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 08:05:37.408369 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399392    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 08:05:37.408843 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399395    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 08:05:37.408843 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399397    2577 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 08:05:37.408843 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399400    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 08:05:37.408843 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399403    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 08:05:37.408843 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399406    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 08:05:37.408843 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399408    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 08:05:37.408843 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399411    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 08:05:37.408843 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399414    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 08:05:37.408843 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399416    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 08:05:37.408843 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399419    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 08:05:37.408843 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399421    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 08:05:37.408843 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399424    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 08:05:37.408843 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399427    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 08:05:37.408843 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399429    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 08:05:37.408843 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399432    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 08:05:37.408843 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399434    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 08:05:37.408843 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399439    2577 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 08:05:37.408843 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399442    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 08:05:37.408843 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399445    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 08:05:37.409505 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.399469    2577 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 02 08:05:37.409505 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399505    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 08:05:37.409505 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399509    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 08:05:37.409505 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399512    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 08:05:37.409505 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399515    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 08:05:37.409505 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399518    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 08:05:37.409505 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399521    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 08:05:37.409505 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399524    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 08:05:37.409505 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399528    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 08:05:37.409505 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399530    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 08:05:37.409505 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399533    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 08:05:37.409505 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399536    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 08:05:37.409505 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399538    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 08:05:37.409505 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399541    2577 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 08:05:37.409505 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399544    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 08:05:37.409505 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399547    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 08:05:37.409958 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399550    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 08:05:37.409958 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399552    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 08:05:37.409958 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399555    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 08:05:37.409958 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399558    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 08:05:37.409958 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399560    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 08:05:37.409958 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399563    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 08:05:37.409958 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399565    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 08:05:37.409958 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399568    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 08:05:37.409958 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399571    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 08:05:37.409958 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399574    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 08:05:37.409958 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399576    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 08:05:37.409958 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399579    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 08:05:37.409958 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399581    2577 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 08:05:37.409958 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399584    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 08:05:37.409958 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399588    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 08:05:37.409958 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399591    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 08:05:37.409958 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399593    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 08:05:37.409958 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399596    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 08:05:37.409958 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399599    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 08:05:37.410439 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399602    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 08:05:37.410439 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399604    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 08:05:37.410439 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399607    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 08:05:37.410439 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399609    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 08:05:37.410439 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399612    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 08:05:37.410439 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399616    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 08:05:37.410439 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399619    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 08:05:37.410439 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399622    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 08:05:37.410439 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399625    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 08:05:37.410439 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399628    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 08:05:37.410439 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399630    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 08:05:37.410439 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399633    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 08:05:37.410439 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399635    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 08:05:37.410439 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399638    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 08:05:37.410439 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399640    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 08:05:37.410439 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399643    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 08:05:37.410439 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399646    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 08:05:37.410439 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399648    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 08:05:37.410439 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399651    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 08:05:37.410439 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399653    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 08:05:37.410932 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399656    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 08:05:37.410932 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399659    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 08:05:37.410932 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399661    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 08:05:37.410932 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399664    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 08:05:37.410932 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399666    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 08:05:37.410932 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399669    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 08:05:37.410932 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399672    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 08:05:37.410932 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399676    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 08:05:37.410932 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399679    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 08:05:37.410932 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399682    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 08:05:37.410932 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399685    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 08:05:37.410932 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399688    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 08:05:37.410932 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399690    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 08:05:37.410932 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399693    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 08:05:37.410932 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399695    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 08:05:37.410932 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399698    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 08:05:37.410932 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399702    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 08:05:37.410932 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399707    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 08:05:37.410932 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399710    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 08:05:37.411441 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399713    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 08:05:37.411441 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399716    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 08:05:37.411441 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399719    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 08:05:37.411441 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399721    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 08:05:37.411441 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399724    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 08:05:37.411441 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399726    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 08:05:37.411441 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399729    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 08:05:37.411441 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399732    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 08:05:37.411441 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399735    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 08:05:37.411441 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399738    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 08:05:37.411441 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399742    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 08:05:37.411441 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399746    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 08:05:37.411441 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399750    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 08:05:37.411441 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399752    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 08:05:37.411441 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399755    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 08:05:37.411441 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399757    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 08:05:37.411441 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399760    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 08:05:37.411441 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399763    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 08:05:37.411441 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399765    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 08:05:37.411899 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399768    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 08:05:37.411899 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399771    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 08:05:37.411899 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399774    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 08:05:37.411899 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399777    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 08:05:37.411899 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399780    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 08:05:37.411899 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399783    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 08:05:37.411899 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399785    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 08:05:37.411899 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399788    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 08:05:37.411899 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399791    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 08:05:37.411899 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399795    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 08:05:37.411899 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399797    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 08:05:37.411899 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399801    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 08:05:37.411899 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399804    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 08:05:37.411899 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:37.399806    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 08:05:37.411899 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.399867    2577 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 02 08:05:37.411899 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.401721    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Nov 02 08:05:37.411899 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.402603    2577 server.go:1014] "Starting client certificate rotation"
Nov 02 08:05:37.411899 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.402705    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 02 08:05:37.412438 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.402745    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 02 08:05:37.412438 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.404371    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 02 08:05:37.412438 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.407054    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 02 08:05:37.415229 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.415215    2577 log.go:25] "Validated CRI v1 runtime API"
Nov 02 08:05:37.418476 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.418459    2577 log.go:25] "Validated CRI v1 image API"
Nov 02 08:05:37.419305 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.419283    2577 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 02 08:05:37.426224 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.426206    2577 fs.go:135] Filesystem UUIDs: map[1d9111a4-5120-4d3c-8e0a-5e7ebbc5a181:/dev/nvme0n1p4 2b27b379-ed27-47e2-a507-b1f3485eeabf:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Nov 02 08:05:37.426278 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.426224    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Nov 02 08:05:37.433104 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.432997    2577 manager.go:217] Machine: {Timestamp:2026-11-02 08:05:37.431573428 +0000 UTC m=+0.323051272 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100389 MemoryCapacity:33164337152 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2034206d82aa81e5573c94dd4d1af5 SystemUUID:ec203420-6d82-aa81-e557-3c94dd4d1af5 BootID:dacaf683-edef-46e1-aed1-391f63f199e9 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:06:ff:f7:c9:c0:75 Speed:0 Mtu:9001} {Name:ens5 MacAddress:06:ff:f7:c9:c0:75 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:ac:0e:a3:37:bd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164337152 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 02 08:05:37.433611 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.433601    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 02 08:05:37.433693 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.433680    2577 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 02 08:05:37.435893 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.435874    2577 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 02 08:05:37.436017 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.435894    2577 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-235.us-west-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 02 08:05:37.436059 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.436019    2577 topology_manager.go:143] "Creating topology manager with none policy"
Nov 02 08:05:37.436059 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.436028    2577 container_manager_linux.go:311] "Creating device plugin manager"
Nov 02 08:05:37.436059 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.436055    2577 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 02 08:05:37.436144 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.436067    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 02 08:05:37.436693 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.436683    2577 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 02 08:05:37.440187 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.440176    2577 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 02 08:05:37.440303 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.440294    2577 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 02 08:05:37.440841 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.440831    2577 kubelet.go:493] "Attempting to sync node with API server"
Nov 02 08:05:37.440876 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.440846    2577 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 02 08:05:37.440876 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.440856    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 02 08:05:37.440876 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.440865    2577 kubelet.go:405] "Adding apiserver pod source"
Nov 02 08:05:37.440876 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.440873    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 02 08:05:37.441290 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.441266    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 02 08:05:37.445051 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.445030    2577 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 02 08:05:37.448953 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.448940    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 02 08:05:37.449687 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.449672    2577 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 02 08:05:37.449732 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.449724    2577 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 02 08:05:37.449942 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.449931    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 02 08:05:37.449995 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.449952    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 02 08:05:37.449995 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.449962    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 02 08:05:37.449995 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.449978    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 02 08:05:37.449995 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.449988    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 02 08:05:37.450093 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.449997    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 02 08:05:37.450367 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.450356    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 02 08:05:37.450397 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.450369    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 02 08:05:37.450397 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.450377    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 02 08:05:37.450397 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.450383    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 02 08:05:37.450397 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.450393    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 02 08:05:37.450518 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.450403    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 02 08:05:37.451041 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.451031    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 02 08:05:37.451069 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.451045    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 02 08:05:37.454760 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.454748    2577 server.go:1263] "Started kubelet"
Nov 02 08:05:37.454858 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.454830    2577 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 02 08:05:37.454947 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.454854    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 02 08:05:37.454985 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.454970    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 02 08:05:37.455442 ip-10-0-135-235 systemd[1]: Started Kubernetes Kubelet.
Nov 02 08:05:37.456605 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.456534    2577 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 02 08:05:37.457868 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.457850    2577 server.go:317] "Adding debug handlers to kubelet server"
Nov 02 08:05:37.459988 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.459972    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 02 08:05:37.460528 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.460370    2577 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 02 08:05:37.460594 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:37.460532    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-235.us-west-2.compute.internal\" not found"
Nov 02 08:05:37.461142 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.461040    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 02 08:05:37.461253 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.461235    2577 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 02 08:05:37.461339 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.461322    2577 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 02 08:05:37.461462 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.461450    2577 reconstruct.go:97] "Volume reconstruction finished"
Nov 02 08:05:37.461462 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.461462    2577 reconciler.go:29] "Reconciler: start to sync state"
Nov 02 08:05:37.462224 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.462209    2577 factory.go:153] Registering CRI-O factory
Nov 02 08:05:37.462224 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.462226    2577 factory.go:223] Registration of the crio container factory successfully
Nov 02 08:05:37.462353 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.462280    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 02 08:05:37.462353 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.462290    2577 factory.go:55] Registering systemd factory
Nov 02 08:05:37.462353 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.462297    2577 factory.go:223] Registration of the systemd container factory successfully
Nov 02 08:05:37.462353 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.462315    2577 factory.go:103] Registering Raw factory
Nov 02 08:05:37.462353 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.462328    2577 manager.go:1199] Started watching for new ooms in manager
Nov 02 08:05:37.464821 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.464804    2577 manager.go:319] Starting recovery of all containers
Nov 02 08:05:37.465282 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:37.465243    2577 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Nov 02 08:05:37.477416 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.477399    2577 manager.go:324] Recovery completed
Nov 02 08:05:37.481938 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.481923    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 08:05:37.484841 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.484821    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-235.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 08:05:37.484914 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.484853    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-235.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 08:05:37.484914 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.484863    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-235.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 08:05:37.485455 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.485435    2577 cpu_manager.go:226] "Starting" policy="none"
Nov 02 08:05:37.485455 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.485448    2577 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 02 08:05:37.485557 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.485462    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 08:05:37.485557 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.485472    2577 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 02 08:05:37.486249 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.486234    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-235.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 08:05:37.486308 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.486262    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-235.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 08:05:37.486308 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.486273    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-235.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 08:05:37.487624 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.487613    2577 policy_none.go:50] "Start"
Nov 02 08:05:37.487658 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.487629    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 02 08:05:37.487658 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.487639    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 02 08:05:37.489570 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.489559    2577 policy_none.go:44] "Start"
Nov 02 08:05:37.542743 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.542704    2577 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 02 08:05:37.545932 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.545915    2577 manager.go:341] "Starting Device Plugin manager"
Nov 02 08:05:37.570671 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:37.545953    2577 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 02 08:05:37.570671 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.545963    2577 server.go:87] "Starting device plugin registration server"
Nov 02 08:05:37.570671 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.546229    2577 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 02 08:05:37.570671 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.546240    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 02 08:05:37.570671 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.546590    2577 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 02 08:05:37.570671 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.546652    2577 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 02 08:05:37.570671 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.546657    2577 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 02 08:05:37.570671 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:37.547308    2577 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 02 08:05:37.570671 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:37.547355    2577 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-235.us-west-2.compute.internal\" not found"
Nov 02 08:05:37.590850 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.590676    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 02 08:05:37.592085 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.592061    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 02 08:05:37.592208 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.592090    2577 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 02 08:05:37.592208 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.592118    2577 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 02 08:05:37.592208 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:37.592174    2577 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Nov 02 08:05:37.600426 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.600405    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-235.us-west-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Nov 02 08:05:37.600511 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:37.600408    2577 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-235.us-west-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Nov 02 08:05:37.601108 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:37.600405    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-235.us-west-2.compute.internal.18e42bd324bc5e2a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-235.us-west-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-235.us-west-2.compute.internal,},FirstTimestamp:2026-11-02 08:05:37.454718506 +0000 UTC m=+0.346196351,LastTimestamp:2026-11-02 08:05:37.454718506 +0000 UTC m=+0.346196351,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-235.us-west-2.compute.internal,}"
Nov 02 08:05:37.646396 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.646316    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 08:05:37.647563 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.647545    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-235.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 08:05:37.647650 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.647576    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-235.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 08:05:37.647650 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.647590    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-235.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 08:05:37.647650 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.647627    2577 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:05:37.678406 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.678382    2577 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 02 08:05:37.678508 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.678430    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qljq4"
Nov 02 08:05:37.692939 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.692910    2577 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-235.us-west-2.compute.internal"]
Nov 02 08:05:37.693036 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.692996    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 08:05:37.693897 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.693880    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-235.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 08:05:37.693995 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.693909    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-235.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 08:05:37.693995 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.693924    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-235.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 08:05:37.696191 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.696177    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 08:05:37.696338 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.696318    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:05:37.696391 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.696367    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 08:05:37.696848 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.696832    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-235.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 08:05:37.696900 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.696861    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-235.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 08:05:37.696900 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.696872    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-235.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 08:05:37.696979 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.696918    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-235.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 08:05:37.696979 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.696938    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-235.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 08:05:37.696979 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.696949    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-235.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 08:05:37.698996 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.698982    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:05:37.699061 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.699011    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 08:05:37.699874 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.699855    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-235.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 08:05:37.699938 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.699885    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-235.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 08:05:37.699938 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.699898    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-235.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 08:05:37.720476 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:37.720458    2577 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-235.us-west-2.compute.internal\" not found" node="ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:05:37.722667 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:37.722652    2577 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-235.us-west-2.compute.internal\" not found" node="ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:05:37.750103 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.750088    2577 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 08:05:37.751635 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.751621    2577 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 08:05:37.763366 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.763348    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a70872874f68c480b6b252a06401797-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal\" (UID: \"8a70872874f68c480b6b252a06401797\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:05:37.763423 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.763374    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a70872874f68c480b6b252a06401797-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal\" (UID: \"8a70872874f68c480b6b252a06401797\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:05:37.763423 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.763397    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5efd6818a2d6de09c2e33ba0444837d8-config\") pod \"kube-apiserver-proxy-ip-10-0-135-235.us-west-2.compute.internal\" (UID: \"5efd6818a2d6de09c2e33ba0444837d8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:05:37.846553 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.846525    2577 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 08:05:37.847534 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.847518    2577 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 08:05:37.847638 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.847616    2577 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:05:37.861097 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.861074    2577 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:05:37.864350 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.864333    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a70872874f68c480b6b252a06401797-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal\" (UID: \"8a70872874f68c480b6b252a06401797\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:05:37.864418 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.864357    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a70872874f68c480b6b252a06401797-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal\" (UID: \"8a70872874f68c480b6b252a06401797\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:05:37.864418 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.864377    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5efd6818a2d6de09c2e33ba0444837d8-config\") pod \"kube-apiserver-proxy-ip-10-0-135-235.us-west-2.compute.internal\" (UID: \"5efd6818a2d6de09c2e33ba0444837d8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:05:37.864513 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.864445    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5efd6818a2d6de09c2e33ba0444837d8-config\") pod \"kube-apiserver-proxy-ip-10-0-135-235.us-west-2.compute.internal\" (UID: \"5efd6818a2d6de09c2e33ba0444837d8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:05:37.864513 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.864449    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a70872874f68c480b6b252a06401797-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal\" (UID: \"8a70872874f68c480b6b252a06401797\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:05:37.864513 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.864456    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a70872874f68c480b6b252a06401797-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal\" (UID: \"8a70872874f68c480b6b252a06401797\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:05:37.922284 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.921310    2577 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 02 08:05:37.924022 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.923968    2577 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:05:37.984699 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:37.984675    2577 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 02 08:05:38.023432 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:38.023403    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:05:38.025558 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:38.025540    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:05:39.657275 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:39.657244    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Nov 02 08:05:39.657808 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:39.657424    2577 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Nov 02 08:05:39.657808 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:39.657424    2577 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Nov 02 08:05:39.657808 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:39.657451    2577 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Nov 02 08:05:39.657808 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:39.657412    2577 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://a4c4bab8d27dd4bf6a9cd51fc9ec0bbf-5d8bc6b0cc418bd2.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-135-235.us-west-2.compute.internal.18e42bd32687f93a\": read tcp 10.0.135.235:59656->3.21.99.120:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-135-235.us-west-2.compute.internal.18e42bd32687f93a  default   5461 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-235.us-west-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-235.us-west-2.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-235.us-west-2.compute.internal,},FirstTimestamp:2026-11-02 08:05:37 +0000 UTC,LastTimestamp:2026-11-02 08:05:37.693894142 +0000 UTC m=+0.585371987,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-235.us-west-2.compute.internal,}"
Nov 02 08:05:39.696125 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:39.696099    2577 apiserver.go:52] "Watching apiserver"
Nov 02 08:05:39.715153 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:39.715130    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Nov 02 08:05:39.937658 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:39.937550    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-01 08:00:38 +0000 UTC" deadline="2028-07-30 11:30:22.934955002 +0000 UTC"
Nov 02 08:05:39.937658 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:39.937604    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15267h24m42.997355871s"
Nov 02 08:05:40.009246 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.009216    2577 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 02 08:05:40.009545 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.009523    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-5qkvj","openshift-network-operator/iptables-alerter-zt85z","kube-system/konnectivity-agent-zdsw7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv","openshift-cluster-node-tuning-operator/tuned-jggtz","openshift-image-registry/node-ca-zfknz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal","kube-system/global-pull-secret-syncer-w2swh","openshift-multus/multus-additional-cni-plugins-9qsmp","openshift-multus/network-metrics-daemon-rh5vc","kube-system/kube-apiserver-proxy-ip-10-0-135-235.us-west-2.compute.internal","openshift-dns/node-resolver-dfp7b","openshift-ovn-kubernetes/ovnkube-node-jb77f","openshift-multus/multus-gqv8f"]
Nov 02 08:05:40.012035 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.012020    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.013986 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.013964    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.016048 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.016031    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:05:40.018100 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.018086    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zdsw7"
Nov 02 08:05:40.020078 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.020066    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zfknz"
Nov 02 08:05:40.022093 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.022077    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:05:40.022181 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:40.022130    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qkvj" podUID="c03021d1-d458-46a8-af56-bfba0cc4b4b4"
Nov 02 08:05:40.024229 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.024213    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:05:40.024308 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:40.024261    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2swh" podUID="9a77497b-33c1-4ac2-bfba-58b6edcf871e"
Nov 02 08:05:40.024557 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.024540    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/731f7925-494b-4442-b5c4-8d2df9379896-socket-dir\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:05:40.024606 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.024563    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-run\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.024606 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.024577    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-sys\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.024606 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.024590    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-lib-modules\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.024606 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.024605    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-var-lib-kubelet\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.024731 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.024657    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/558cdaf8-03cf-4d61-9c28-94a5da9c886d-tmp\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.024731 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.024685    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/731f7925-494b-4442-b5c4-8d2df9379896-etc-selinux\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:05:40.024731 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.024723    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-sysctl-conf\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.024856 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.024760    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-multus-socket-dir-parent\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.024856 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.024793    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-host-var-lib-cni-bin\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.024856 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.024828    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-multus-conf-dir\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.024961 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.024843    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-multus-daemon-config\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.024961 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.024906    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/731f7925-494b-4442-b5c4-8d2df9379896-registration-dir\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:05:40.024961 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.024932    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/731f7925-494b-4442-b5c4-8d2df9379896-sys-fs\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:05:40.024961 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.024954    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-etc-kubernetes\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.025073 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.024974    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-multus-cni-dir\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.025073 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.025000    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/731f7925-494b-4442-b5c4-8d2df9379896-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:05:40.025073 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.025024    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0027996b-31d7-474a-88e9-efc0b6032300-konnectivity-ca\") pod \"konnectivity-agent-zdsw7\" (UID: \"0027996b-31d7-474a-88e9-efc0b6032300\") " pod="kube-system/konnectivity-agent-zdsw7"
Nov 02 08:05:40.025073 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.025050    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-systemd\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.025191 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.025074    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-cnibin\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.025191 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.025091    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-modprobe-d\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.025191 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.025116    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-sysconfig\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.025191 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.025140    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-kubernetes\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.025320 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.025183    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-tuned\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.025320 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.025215    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djtkk\" (UniqueName: \"kubernetes.io/projected/558cdaf8-03cf-4d61-9c28-94a5da9c886d-kube-api-access-djtkk\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.025320 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.025275    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-system-cni-dir\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.025320 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.025292    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-host-run-k8s-cni-cncf-io\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.025320 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.025308    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-host-run-netns\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.025542 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.025323    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7pwz\" (UniqueName: \"kubernetes.io/projected/731f7925-494b-4442-b5c4-8d2df9379896-kube-api-access-q7pwz\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:05:40.025542 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.025336    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0027996b-31d7-474a-88e9-efc0b6032300-agent-certs\") pod \"konnectivity-agent-zdsw7\" (UID: \"0027996b-31d7-474a-88e9-efc0b6032300\") " pod="kube-system/konnectivity-agent-zdsw7"
Nov 02 08:05:40.025542 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.025349    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-host\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.025542 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.025375    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-cni-binary-copy\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.025542 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.025422    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-host-run-multus-certs\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.025542 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.025454    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/731f7925-494b-4442-b5c4-8d2df9379896-device-dir\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:05:40.025542 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.025484    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-sysctl-d\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.025542 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.025508    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-host-var-lib-cni-multus\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.025542 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.025533    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-host-var-lib-kubelet\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.025814 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.025555    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-hostroot\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.025814 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.025578    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk9zl\" (UniqueName: \"kubernetes.io/projected/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-kube-api-access-hk9zl\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.026459 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.026446    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:05:40.028602 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.028585    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:05:40.028673 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:40.028651    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh5vc" podUID="ff05c739-4a53-4cfe-942f-df41f812d742"
Nov 02 08:05:40.030723 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.030709    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dfp7b"
Nov 02 08:05:40.033153 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.033134    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.035349 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.035334    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zt85z"
Nov 02 08:05:40.067790 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.065651    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 02 08:05:40.067790 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.065656    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6rwld\""
Nov 02 08:05:40.067790 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.065661    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 02 08:05:40.067790 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.066338    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-c87zx\""
Nov 02 08:05:40.067790 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.066379    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 02 08:05:40.067790 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.066426    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 02 08:05:40.067790 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.066533    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 02 08:05:40.067790 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.066785    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 02 08:05:40.068292 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.068273    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 02 08:05:40.068339 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.068330    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 02 08:05:40.068459 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.068443    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 02 08:05:40.068588 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.068574    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mwch9\""
Nov 02 08:05:40.070317 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.070302    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 02 08:05:40.070424 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.070414    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 02 08:05:40.070520 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.070507    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-zrnf9\""
Nov 02 08:05:40.076722 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.076704    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 02 08:05:40.076780 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.076743    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 02 08:05:40.076820 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.076794    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-t2bt7\""
Nov 02 08:05:40.117937 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.117921    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 02 08:05:40.126089 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.126071    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/05f90c13-3432-4e94-b368-66226fa6ff26-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:05:40.126176 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.126101    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-multus-socket-dir-parent\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.126176 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.126125    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-multus-conf-dir\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.126176 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.126149    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-multus-daemon-config\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.126308 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.126182    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d220536b-9c7c-4e34-8ac0-3c25ab4975f7-host\") pod \"node-ca-zfknz\" (UID: \"d220536b-9c7c-4e34-8ac0-3c25ab4975f7\") " pod="openshift-image-registry/node-ca-zfknz"
Nov 02 08:05:40.126308 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.126205    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9a77497b-33c1-4ac2-bfba-58b6edcf871e-kubelet-config\") pod \"global-pull-secret-syncer-w2swh\" (UID: \"9a77497b-33c1-4ac2-bfba-58b6edcf871e\") " pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:05:40.126308 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.126222    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a77497b-33c1-4ac2-bfba-58b6edcf871e-original-pull-secret\") pod \"global-pull-secret-syncer-w2swh\" (UID: \"9a77497b-33c1-4ac2-bfba-58b6edcf871e\") " pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:05:40.126308 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.126234    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-multus-conf-dir\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.126308 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.126243    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b54f688-470c-4797-b685-8b9826e361a8-tmp-dir\") pod \"node-resolver-dfp7b\" (UID: \"5b54f688-470c-4797-b685-8b9826e361a8\") " pod="openshift-dns/node-resolver-dfp7b"
Nov 02 08:05:40.126308 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.126297    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff05c739-4a53-4cfe-942f-df41f812d742-metrics-certs\") pod \"network-metrics-daemon-rh5vc\" (UID: \"ff05c739-4a53-4cfe-942f-df41f812d742\") " pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:05:40.126559 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.126314    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-multus-socket-dir-parent\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.126559 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.126348    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-systemd-units\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.126559 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.126395    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9a77497b-33c1-4ac2-bfba-58b6edcf871e-dbus\") pod \"global-pull-secret-syncer-w2swh\" (UID: \"9a77497b-33c1-4ac2-bfba-58b6edcf871e\") " pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:05:40.126559 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.126428    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-multus-cni-dir\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.126559 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.126470    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/731f7925-494b-4442-b5c4-8d2df9379896-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:05:40.126559 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.126523    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-multus-cni-dir\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.126559 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.126531    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0027996b-31d7-474a-88e9-efc0b6032300-konnectivity-ca\") pod \"konnectivity-agent-zdsw7\" (UID: \"0027996b-31d7-474a-88e9-efc0b6032300\") " pod="kube-system/konnectivity-agent-zdsw7"
Nov 02 08:05:40.126559 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.126552    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/731f7925-494b-4442-b5c4-8d2df9379896-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:05:40.126909 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.126594    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-systemd\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.126909 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.126621    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgzlc\" (UniqueName: \"kubernetes.io/projected/d220536b-9c7c-4e34-8ac0-3c25ab4975f7-kube-api-access-pgzlc\") pod \"node-ca-zfknz\" (UID: \"d220536b-9c7c-4e34-8ac0-3c25ab4975f7\") " pod="openshift-image-registry/node-ca-zfknz"
Nov 02 08:05:40.126909 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.126648    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-sysconfig\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.126909 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.126656    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-systemd\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.126909 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.126671    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-kubernetes\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.126909 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.126699    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djtkk\" (UniqueName: \"kubernetes.io/projected/558cdaf8-03cf-4d61-9c28-94a5da9c886d-kube-api-access-djtkk\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.126909 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.126736    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-host-run-k8s-cni-cncf-io\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.126909 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.126778    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-host-run-netns\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.126909 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.126802    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-kubernetes\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.126909 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.126776    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-sysconfig\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.126909 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.126805    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-ovnkube-config\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.126909 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.126821    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-host-run-netns\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.126909 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.126821    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-host-run-k8s-cni-cncf-io\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.126909 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.126858    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7pwz\" (UniqueName: \"kubernetes.io/projected/731f7925-494b-4442-b5c4-8d2df9379896-kube-api-access-q7pwz\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:05:40.126909 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.126900    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0027996b-31d7-474a-88e9-efc0b6032300-agent-certs\") pod \"konnectivity-agent-zdsw7\" (UID: \"0027996b-31d7-474a-88e9-efc0b6032300\") " pod="kube-system/konnectivity-agent-zdsw7"
Nov 02 08:05:40.127462 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.126923    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-host\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.127462 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.126949    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-cni-bin\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.127462 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.126975    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.127462 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127003    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/79843809-80ac-4069-b436-ba1a26348505-iptables-alerter-script\") pod \"iptables-alerter-zt85z\" (UID: \"79843809-80ac-4069-b436-ba1a26348505\") " pod="openshift-network-operator/iptables-alerter-zt85z"
Nov 02 08:05:40.127462 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127014    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-host\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.127462 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127026    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwd27\" (UniqueName: \"kubernetes.io/projected/79843809-80ac-4069-b436-ba1a26348505-kube-api-access-lwd27\") pod \"iptables-alerter-zt85z\" (UID: \"79843809-80ac-4069-b436-ba1a26348505\") " pod="openshift-network-operator/iptables-alerter-zt85z"
Nov 02 08:05:40.127462 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127082    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/05f90c13-3432-4e94-b368-66226fa6ff26-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:05:40.127462 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127131    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djxm4\" (UniqueName: \"kubernetes.io/projected/05f90c13-3432-4e94-b368-66226fa6ff26-kube-api-access-djxm4\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:05:40.127462 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127152    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/731f7925-494b-4442-b5c4-8d2df9379896-device-dir\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:05:40.127462 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127173    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-sysctl-d\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.127462 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127189    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk9zl\" (UniqueName: \"kubernetes.io/projected/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-kube-api-access-hk9zl\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.127462 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127192    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/731f7925-494b-4442-b5c4-8d2df9379896-device-dir\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:05:40.127462 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127204    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-run-netns\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.127462 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127223    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-cni-netd\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.127462 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127246    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05f90c13-3432-4e94-b368-66226fa6ff26-system-cni-dir\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:05:40.127462 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127269    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/731f7925-494b-4442-b5c4-8d2df9379896-socket-dir\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:05:40.128075 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127286    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-sysctl-d\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.128075 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127290    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-run\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.128075 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127328    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-lib-modules\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.128075 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127357    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px425\" (UniqueName: \"kubernetes.io/projected/ff05c739-4a53-4cfe-942f-df41f812d742-kube-api-access-px425\") pod \"network-metrics-daemon-rh5vc\" (UID: \"ff05c739-4a53-4cfe-942f-df41f812d742\") " pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:05:40.128075 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127380    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-var-lib-openvswitch\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.128075 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127416    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-run-ovn-kubernetes\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.128075 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127459    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-lib-modules\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.128075 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127467    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-run\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.128075 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127478    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4c4m\" (UniqueName: \"kubernetes.io/projected/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-kube-api-access-l4c4m\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.128075 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127522    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79843809-80ac-4069-b436-ba1a26348505-host-slash\") pod \"iptables-alerter-zt85z\" (UID: \"79843809-80ac-4069-b436-ba1a26348505\") " pod="openshift-network-operator/iptables-alerter-zt85z"
Nov 02 08:05:40.128075 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127568    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/731f7925-494b-4442-b5c4-8d2df9379896-etc-selinux\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:05:40.128075 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127589    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-sysctl-conf\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.128075 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127605    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-host-var-lib-cni-bin\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.128075 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127652    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-slash\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.128075 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127680    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-host-var-lib-cni-bin\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.128075 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127729    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-sysctl-conf\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.128075 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127740    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpq4r\" (UniqueName: \"kubernetes.io/projected/c03021d1-d458-46a8-af56-bfba0cc4b4b4-kube-api-access-rpq4r\") pod \"network-check-target-5qkvj\" (UID: \"c03021d1-d458-46a8-af56-bfba0cc4b4b4\") " pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:05:40.128845 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127754    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/731f7925-494b-4442-b5c4-8d2df9379896-etc-selinux\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:05:40.128845 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127770    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/05f90c13-3432-4e94-b368-66226fa6ff26-cni-binary-copy\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:05:40.128845 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127798    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/05f90c13-3432-4e94-b368-66226fa6ff26-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:05:40.128845 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127830    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/731f7925-494b-4442-b5c4-8d2df9379896-registration-dir\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:05:40.128845 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127833    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-multus-daemon-config\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.128845 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127911    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/731f7925-494b-4442-b5c4-8d2df9379896-sys-fs\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:05:40.128845 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127940    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-etc-kubernetes\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.128845 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127965    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc2kl\" (UniqueName: \"kubernetes.io/projected/5b54f688-470c-4797-b685-8b9826e361a8-kube-api-access-rc2kl\") pod \"node-resolver-dfp7b\" (UID: \"5b54f688-470c-4797-b685-8b9826e361a8\") " pod="openshift-dns/node-resolver-dfp7b"
Nov 02 08:05:40.128845 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127991    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-cnibin\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.128845 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.127990    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/731f7925-494b-4442-b5c4-8d2df9379896-registration-dir\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:05:40.128845 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.128032    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-etc-kubernetes\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.128845 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.128033    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/731f7925-494b-4442-b5c4-8d2df9379896-sys-fs\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:05:40.128845 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.128039    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5b54f688-470c-4797-b685-8b9826e361a8-hosts-file\") pod \"node-resolver-dfp7b\" (UID: \"5b54f688-470c-4797-b685-8b9826e361a8\") " pod="openshift-dns/node-resolver-dfp7b"
Nov 02 08:05:40.128845 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.128097    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-modprobe-d\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.128845 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.128061    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-cnibin\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.128845 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.128124    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-tuned\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.128845 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.128147    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-system-cni-dir\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.129610 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.128151    2577 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 02 08:05:40.129610 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.128171    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-host-run-multus-certs\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.129610 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.128180    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-modprobe-d\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.129610 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.128194    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-run-systemd\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.129610 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.128217    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-system-cni-dir\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.129610 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.128237    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-ovnkube-script-lib\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.129610 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.128250    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-host-run-multus-certs\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.129610 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.128259    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-cni-binary-copy\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.129610 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.128294    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-run-openvswitch\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.129610 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.128328    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-env-overrides\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.129610 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.128372    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-kubelet\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.129610 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.128396    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-etc-openvswitch\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.129610 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.128431    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-node-log\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.129610 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.128460    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-log-socket\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.129610 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.128155    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/731f7925-494b-4442-b5c4-8d2df9379896-socket-dir\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:05:40.129610 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.128506    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/05f90c13-3432-4e94-b368-66226fa6ff26-cnibin\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:05:40.129610 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.128555    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-host-var-lib-cni-multus\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.130395 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.128604    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-host-var-lib-kubelet\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.130395 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.128622    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-host-var-lib-cni-multus\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.130395 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.128660    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-hostroot\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.130395 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.128687    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-run-ovn\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.130395 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.128732    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-cni-binary-copy\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.130395 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.128736    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-hostroot\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.130395 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.128789    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-ovn-node-metrics-cert\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.130395 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.128793    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0027996b-31d7-474a-88e9-efc0b6032300-konnectivity-ca\") pod \"konnectivity-agent-zdsw7\" (UID: \"0027996b-31d7-474a-88e9-efc0b6032300\") " pod="kube-system/konnectivity-agent-zdsw7"
Nov 02 08:05:40.130395 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.128819    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-host-var-lib-kubelet\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.130395 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.128861    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d220536b-9c7c-4e34-8ac0-3c25ab4975f7-serviceca\") pod \"node-ca-zfknz\" (UID: \"d220536b-9c7c-4e34-8ac0-3c25ab4975f7\") " pod="openshift-image-registry/node-ca-zfknz"
Nov 02 08:05:40.130395 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.128906    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-sys\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.130395 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.128956    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-sys\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.130395 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.128989    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-var-lib-kubelet\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.130395 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.129025    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-var-lib-kubelet\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.130395 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.129034    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/558cdaf8-03cf-4d61-9c28-94a5da9c886d-tmp\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.131835 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.131812    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/558cdaf8-03cf-4d61-9c28-94a5da9c886d-tmp\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.131930 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.131907    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-tuned\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.132140 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.132112    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0027996b-31d7-474a-88e9-efc0b6032300-agent-certs\") pod \"konnectivity-agent-zdsw7\" (UID: \"0027996b-31d7-474a-88e9-efc0b6032300\") " pod="kube-system/konnectivity-agent-zdsw7"
Nov 02 08:05:40.165479 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.165460    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 02 08:05:40.165701 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.165686    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 02 08:05:40.165776 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.165726    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 02 08:05:40.165776 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.165735    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 02 08:05:40.165914 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.165861    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 02 08:05:40.166222 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.166204    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bgzdd\""
Nov 02 08:05:40.166313 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.166222    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 02 08:05:40.166313 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.166232    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qmmzq\""
Nov 02 08:05:40.166313 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.166266    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 02 08:05:40.166313 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.166269    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-shlrq\""
Nov 02 08:05:40.166313 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.166279    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 02 08:05:40.166313 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.166278    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 02 08:05:40.166313 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.166242    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 02 08:05:40.166313 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.166241    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 02 08:05:40.166313 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.166304    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zgn8x\""
Nov 02 08:05:40.166313 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.166311    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 02 08:05:40.166637 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.166331    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 02 08:05:40.166637 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.166477    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 02 08:05:40.182035 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.182015    2577 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 02 08:05:40.182115 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.182074    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zr5nm"
Nov 02 08:05:40.185722 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.185697    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djtkk\" (UniqueName: \"kubernetes.io/projected/558cdaf8-03cf-4d61-9c28-94a5da9c886d-kube-api-access-djtkk\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.185809 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.185725    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk9zl\" (UniqueName: \"kubernetes.io/projected/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-kube-api-access-hk9zl\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.185809 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.185747    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7pwz\" (UniqueName: \"kubernetes.io/projected/731f7925-494b-4442-b5c4-8d2df9379896-kube-api-access-q7pwz\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:05:40.229326 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.229260    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4c4m\" (UniqueName: \"kubernetes.io/projected/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-kube-api-access-l4c4m\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.229326 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.229292    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79843809-80ac-4069-b436-ba1a26348505-host-slash\") pod \"iptables-alerter-zt85z\" (UID: \"79843809-80ac-4069-b436-ba1a26348505\") " pod="openshift-network-operator/iptables-alerter-zt85z"
Nov 02 08:05:40.229326 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.229315    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-slash\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.229536 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.229339    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpq4r\" (UniqueName: \"kubernetes.io/projected/c03021d1-d458-46a8-af56-bfba0cc4b4b4-kube-api-access-rpq4r\") pod \"network-check-target-5qkvj\" (UID: \"c03021d1-d458-46a8-af56-bfba0cc4b4b4\") " pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:05:40.229536 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.229362    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79843809-80ac-4069-b436-ba1a26348505-host-slash\") pod \"iptables-alerter-zt85z\" (UID: \"79843809-80ac-4069-b436-ba1a26348505\") " pod="openshift-network-operator/iptables-alerter-zt85z"
Nov 02 08:05:40.229536 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.229373    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-slash\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.229536 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.229440    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/05f90c13-3432-4e94-b368-66226fa6ff26-cni-binary-copy\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:05:40.229536 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.229468    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/05f90c13-3432-4e94-b368-66226fa6ff26-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:05:40.229536 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.229491    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc2kl\" (UniqueName: \"kubernetes.io/projected/5b54f688-470c-4797-b685-8b9826e361a8-kube-api-access-rc2kl\") pod \"node-resolver-dfp7b\" (UID: \"5b54f688-470c-4797-b685-8b9826e361a8\") " pod="openshift-dns/node-resolver-dfp7b"
Nov 02 08:05:40.229536 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.229512    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5b54f688-470c-4797-b685-8b9826e361a8-hosts-file\") pod \"node-resolver-dfp7b\" (UID: \"5b54f688-470c-4797-b685-8b9826e361a8\") " pod="openshift-dns/node-resolver-dfp7b"
Nov 02 08:05:40.229857 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.229541    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-run-systemd\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.229857 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.229564    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-ovnkube-script-lib\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.229857 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.229626    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5b54f688-470c-4797-b685-8b9826e361a8-hosts-file\") pod \"node-resolver-dfp7b\" (UID: \"5b54f688-470c-4797-b685-8b9826e361a8\") " pod="openshift-dns/node-resolver-dfp7b"
Nov 02 08:05:40.229857 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.229657    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-run-systemd\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.229857 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.229688    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-run-openvswitch\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.229857 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.229737    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-run-openvswitch\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.229857 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.229745    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-env-overrides\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.229857 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.229772    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-kubelet\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.229857 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.229817    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-etc-openvswitch\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.229857 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.229841    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-node-log\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.229857 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.229856    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-log-socket\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.230360 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.229893    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/05f90c13-3432-4e94-b368-66226fa6ff26-cnibin\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:05:40.230360 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.229909    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-etc-openvswitch\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.230360 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.229919    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-run-ovn\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.230360 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.229922    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-node-log\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.230360 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.229939    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-log-socket\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.230360 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.229942    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-ovn-node-metrics-cert\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.230360 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.229997    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/05f90c13-3432-4e94-b368-66226fa6ff26-cnibin\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:05:40.230360 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.230002    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-kubelet\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.230360 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.230011    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d220536b-9c7c-4e34-8ac0-3c25ab4975f7-serviceca\") pod \"node-ca-zfknz\" (UID: \"d220536b-9c7c-4e34-8ac0-3c25ab4975f7\") " pod="openshift-image-registry/node-ca-zfknz"
Nov 02 08:05:40.230360 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.230020    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-run-ovn\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.230360 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.230182    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/05f90c13-3432-4e94-b368-66226fa6ff26-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:05:40.230360 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.230188    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/05f90c13-3432-4e94-b368-66226fa6ff26-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:05:40.230360 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.230252    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/05f90c13-3432-4e94-b368-66226fa6ff26-cni-binary-copy\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:05:40.230360 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.230271    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d220536b-9c7c-4e34-8ac0-3c25ab4975f7-host\") pod \"node-ca-zfknz\" (UID: \"d220536b-9c7c-4e34-8ac0-3c25ab4975f7\") " pod="openshift-image-registry/node-ca-zfknz"
Nov 02 08:05:40.230360 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.230323    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9a77497b-33c1-4ac2-bfba-58b6edcf871e-kubelet-config\") pod \"global-pull-secret-syncer-w2swh\" (UID: \"9a77497b-33c1-4ac2-bfba-58b6edcf871e\") " pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:05:40.230360 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.230294    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d220536b-9c7c-4e34-8ac0-3c25ab4975f7-host\") pod \"node-ca-zfknz\" (UID: \"d220536b-9c7c-4e34-8ac0-3c25ab4975f7\") " pod="openshift-image-registry/node-ca-zfknz"
Nov 02 08:05:40.230996 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.230379    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a77497b-33c1-4ac2-bfba-58b6edcf871e-original-pull-secret\") pod \"global-pull-secret-syncer-w2swh\" (UID: \"9a77497b-33c1-4ac2-bfba-58b6edcf871e\") " pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:05:40.230996 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.230420    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b54f688-470c-4797-b685-8b9826e361a8-tmp-dir\") pod \"node-resolver-dfp7b\" (UID: \"5b54f688-470c-4797-b685-8b9826e361a8\") " pod="openshift-dns/node-resolver-dfp7b"
Nov 02 08:05:40.230996 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.230427    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9a77497b-33c1-4ac2-bfba-58b6edcf871e-kubelet-config\") pod \"global-pull-secret-syncer-w2swh\" (UID: \"9a77497b-33c1-4ac2-bfba-58b6edcf871e\") " pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:05:40.230996 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.230444    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff05c739-4a53-4cfe-942f-df41f812d742-metrics-certs\") pod \"network-metrics-daemon-rh5vc\" (UID: \"ff05c739-4a53-4cfe-942f-df41f812d742\") " pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:05:40.230996 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.230472    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-systemd-units\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.230996 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.230516    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9a77497b-33c1-4ac2-bfba-58b6edcf871e-dbus\") pod \"global-pull-secret-syncer-w2swh\" (UID: \"9a77497b-33c1-4ac2-bfba-58b6edcf871e\") " pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:05:40.230996 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:40.230552    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 02 08:05:40.230996 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.230563    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgzlc\" (UniqueName: \"kubernetes.io/projected/d220536b-9c7c-4e34-8ac0-3c25ab4975f7-kube-api-access-pgzlc\") pod \"node-ca-zfknz\" (UID: \"d220536b-9c7c-4e34-8ac0-3c25ab4975f7\") " pod="openshift-image-registry/node-ca-zfknz"
Nov 02 08:05:40.230996 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:40.230601    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 08:05:40.230996 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.230599    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-ovnkube-config\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.230996 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:40.230661    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a77497b-33c1-4ac2-bfba-58b6edcf871e-original-pull-secret podName:9a77497b-33c1-4ac2-bfba-58b6edcf871e nodeName:}" failed. No retries permitted until 2026-11-02 08:05:40.730624845 +0000 UTC m=+2.367354174 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a77497b-33c1-4ac2-bfba-58b6edcf871e-original-pull-secret") pod "global-pull-secret-syncer-w2swh" (UID: "9a77497b-33c1-4ac2-bfba-58b6edcf871e") : object "kube-system"/"original-pull-secret" not registered
Nov 02 08:05:40.230996 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:40.230686    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff05c739-4a53-4cfe-942f-df41f812d742-metrics-certs podName:ff05c739-4a53-4cfe-942f-df41f812d742 nodeName:}" failed. No retries permitted until 2026-11-02 08:05:40.730673743 +0000 UTC m=+2.367403054 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff05c739-4a53-4cfe-942f-df41f812d742-metrics-certs") pod "network-metrics-daemon-rh5vc" (UID: "ff05c739-4a53-4cfe-942f-df41f812d742") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 08:05:40.230996 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.230724    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-cni-bin\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.230996 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.230747    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.230996 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.230755    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-systemd-units\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.230996 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.230776    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/79843809-80ac-4069-b436-ba1a26348505-iptables-alerter-script\") pod \"iptables-alerter-zt85z\" (UID: \"79843809-80ac-4069-b436-ba1a26348505\") " pod="openshift-network-operator/iptables-alerter-zt85z"
Nov 02 08:05:40.231722 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.230786    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-cni-bin\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.231722 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.230808    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9a77497b-33c1-4ac2-bfba-58b6edcf871e-dbus\") pod \"global-pull-secret-syncer-w2swh\" (UID: \"9a77497b-33c1-4ac2-bfba-58b6edcf871e\") " pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:05:40.231722 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.230868    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.231722 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.230873    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwd27\" (UniqueName: \"kubernetes.io/projected/79843809-80ac-4069-b436-ba1a26348505-kube-api-access-lwd27\") pod \"iptables-alerter-zt85z\" (UID: \"79843809-80ac-4069-b436-ba1a26348505\") " pod="openshift-network-operator/iptables-alerter-zt85z"
Nov 02 08:05:40.231722 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.230950    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/05f90c13-3432-4e94-b368-66226fa6ff26-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:05:40.231722 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.230976    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djxm4\" (UniqueName: \"kubernetes.io/projected/05f90c13-3432-4e94-b368-66226fa6ff26-kube-api-access-djxm4\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:05:40.231722 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.231002    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-run-netns\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.231722 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.231046    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-cni-netd\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.231722 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.231092    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05f90c13-3432-4e94-b368-66226fa6ff26-system-cni-dir\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:05:40.231722 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.231123    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px425\" (UniqueName: \"kubernetes.io/projected/ff05c739-4a53-4cfe-942f-df41f812d742-kube-api-access-px425\") pod \"network-metrics-daemon-rh5vc\" (UID: \"ff05c739-4a53-4cfe-942f-df41f812d742\") " pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:05:40.231722 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.231151    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-var-lib-openvswitch\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.231722 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.231170    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/05f90c13-3432-4e94-b368-66226fa6ff26-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:05:40.231722 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.231176    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-run-ovn-kubernetes\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.231722 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.231312    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-run-ovn-kubernetes\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.231722 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.231384    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/05f90c13-3432-4e94-b368-66226fa6ff26-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:05:40.231722 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.231432    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-env-overrides\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.231722 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.231459    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-ovnkube-script-lib\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.232335 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.231461    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05f90c13-3432-4e94-b368-66226fa6ff26-system-cni-dir\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:05:40.232335 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.231503    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-cni-netd\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.232335 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.231517    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-var-lib-openvswitch\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.232335 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.231529    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d220536b-9c7c-4e34-8ac0-3c25ab4975f7-serviceca\") pod \"node-ca-zfknz\" (UID: \"d220536b-9c7c-4e34-8ac0-3c25ab4975f7\") " pod="openshift-image-registry/node-ca-zfknz"
Nov 02 08:05:40.232335 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.231547    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-run-netns\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.232335 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.231574    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/79843809-80ac-4069-b436-ba1a26348505-iptables-alerter-script\") pod \"iptables-alerter-zt85z\" (UID: \"79843809-80ac-4069-b436-ba1a26348505\") " pod="openshift-network-operator/iptables-alerter-zt85z"
Nov 02 08:05:40.232335 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.231774    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b54f688-470c-4797-b685-8b9826e361a8-tmp-dir\") pod \"node-resolver-dfp7b\" (UID: \"5b54f688-470c-4797-b685-8b9826e361a8\") " pod="openshift-dns/node-resolver-dfp7b"
Nov 02 08:05:40.232335 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.232034    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-ovnkube-config\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.232547 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.232517    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-ovn-node-metrics-cert\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.288919 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:40.288891    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 02 08:05:40.288919 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:40.288917    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 02 08:05:40.288919 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:40.288927    2577 projected.go:196] Error preparing data for projected volume kube-api-access-rpq4r for pod openshift-network-diagnostics/network-check-target-5qkvj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 08:05:40.289181 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:40.288990    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c03021d1-d458-46a8-af56-bfba0cc4b4b4-kube-api-access-rpq4r podName:c03021d1-d458-46a8-af56-bfba0cc4b4b4 nodeName:}" failed. No retries permitted until 2026-11-02 08:05:40.788972426 +0000 UTC m=+2.425701757 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rpq4r" (UniqueName: "kubernetes.io/projected/c03021d1-d458-46a8-af56-bfba0cc4b4b4-kube-api-access-rpq4r") pod "network-check-target-5qkvj" (UID: "c03021d1-d458-46a8-af56-bfba0cc4b4b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 08:05:40.291186 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.291161    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc2kl\" (UniqueName: \"kubernetes.io/projected/5b54f688-470c-4797-b685-8b9826e361a8-kube-api-access-rc2kl\") pod \"node-resolver-dfp7b\" (UID: \"5b54f688-470c-4797-b685-8b9826e361a8\") " pod="openshift-dns/node-resolver-dfp7b"
Nov 02 08:05:40.291432 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.291412    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djxm4\" (UniqueName: \"kubernetes.io/projected/05f90c13-3432-4e94-b368-66226fa6ff26-kube-api-access-djxm4\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:05:40.291571 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.291548    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgzlc\" (UniqueName: \"kubernetes.io/projected/d220536b-9c7c-4e34-8ac0-3c25ab4975f7-kube-api-access-pgzlc\") pod \"node-ca-zfknz\" (UID: \"d220536b-9c7c-4e34-8ac0-3c25ab4975f7\") " pod="openshift-image-registry/node-ca-zfknz"
Nov 02 08:05:40.291621 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.291603    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4c4m\" (UniqueName: \"kubernetes.io/projected/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-kube-api-access-l4c4m\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.291891 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.291857    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwd27\" (UniqueName: \"kubernetes.io/projected/79843809-80ac-4069-b436-ba1a26348505-kube-api-access-lwd27\") pod \"iptables-alerter-zt85z\" (UID: \"79843809-80ac-4069-b436-ba1a26348505\") " pod="openshift-network-operator/iptables-alerter-zt85z"
Nov 02 08:05:40.292058 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.292041    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-px425\" (UniqueName: \"kubernetes.io/projected/ff05c739-4a53-4cfe-942f-df41f812d742-kube-api-access-px425\") pod \"network-metrics-daemon-rh5vc\" (UID: \"ff05c739-4a53-4cfe-942f-df41f812d742\") " pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:05:40.348959 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.348925    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:05:40.363404 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.363372    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gqv8f"
Nov 02 08:05:40.389274 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.389253    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:05:40.403909 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.403886    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zdsw7"
Nov 02 08:05:40.407388 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.407373    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zfknz"
Nov 02 08:05:40.444956 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:40.444911    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a70872874f68c480b6b252a06401797.slice/crio-61443f19b06c5174067ac167c131cad07f3b1838b1262c254275ef6de87a36a3 WatchSource:0}: Error finding container 61443f19b06c5174067ac167c131cad07f3b1838b1262c254275ef6de87a36a3: Status 404 returned error can't find the container with id 61443f19b06c5174067ac167c131cad07f3b1838b1262c254275ef6de87a36a3
Nov 02 08:05:40.445154 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:40.445140    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5efd6818a2d6de09c2e33ba0444837d8.slice/crio-6e090e4165f5fd0997d74c74596c5e0c2232b822f8935dd2dbc3a0909b3848a7 WatchSource:0}: Error finding container 6e090e4165f5fd0997d74c74596c5e0c2232b822f8935dd2dbc3a0909b3848a7: Status 404 returned error can't find the container with id 6e090e4165f5fd0997d74c74596c5e0c2232b822f8935dd2dbc3a0909b3848a7
Nov 02 08:05:40.447340 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.447325    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:05:40.450017 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.450001    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 02 08:05:40.452341 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.452325    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dfp7b"
Nov 02 08:05:40.456695 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:40.456675    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05f90c13_3432_4e94_b368_66226fa6ff26.slice/crio-1ebfc3569d1bfe6378defd79ab0685cf0c8953bc408127f5fdf6681b2dd1c4d0 WatchSource:0}: Error finding container 1ebfc3569d1bfe6378defd79ab0685cf0c8953bc408127f5fdf6681b2dd1c4d0: Status 404 returned error can't find the container with id 1ebfc3569d1bfe6378defd79ab0685cf0c8953bc408127f5fdf6681b2dd1c4d0
Nov 02 08:05:40.460599 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:40.460573    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b54f688_470c_4797_b685_8b9826e361a8.slice/crio-fbe098f0e9731181351749c3d5456206f5e9289e5f2df036054281cc8a80596a WatchSource:0}: Error finding container fbe098f0e9731181351749c3d5456206f5e9289e5f2df036054281cc8a80596a: Status 404 returned error can't find the container with id fbe098f0e9731181351749c3d5456206f5e9289e5f2df036054281cc8a80596a
Nov 02 08:05:40.466517 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.466502    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zt85z"
Nov 02 08:05:40.475099 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.475082    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:05:40.475284 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:40.475267    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79843809_80ac_4069_b436_ba1a26348505.slice/crio-45277ab15e1401d38b64135ca5501ccf8f8abe08fd8499494a6c4398d227f2ef WatchSource:0}: Error finding container 45277ab15e1401d38b64135ca5501ccf8f8abe08fd8499494a6c4398d227f2ef: Status 404 returned error can't find the container with id 45277ab15e1401d38b64135ca5501ccf8f8abe08fd8499494a6c4398d227f2ef
Nov 02 08:05:40.483298 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:40.483279    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e7ae74c_fcd8_4820_a8b7_769a5fff9f15.slice/crio-01b46fcdb5fd050f0a7da2d941718e1004eaab21d114e64acecc68e1fbb59c1e WatchSource:0}: Error finding container 01b46fcdb5fd050f0a7da2d941718e1004eaab21d114e64acecc68e1fbb59c1e: Status 404 returned error can't find the container with id 01b46fcdb5fd050f0a7da2d941718e1004eaab21d114e64acecc68e1fbb59c1e
Nov 02 08:05:40.734290 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.734212    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a77497b-33c1-4ac2-bfba-58b6edcf871e-original-pull-secret\") pod \"global-pull-secret-syncer-w2swh\" (UID: \"9a77497b-33c1-4ac2-bfba-58b6edcf871e\") " pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:05:40.734290 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.734245    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff05c739-4a53-4cfe-942f-df41f812d742-metrics-certs\") pod \"network-metrics-daemon-rh5vc\" (UID: \"ff05c739-4a53-4cfe-942f-df41f812d742\") " pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:05:40.734944 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:40.734353    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 02 08:05:40.734944 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:40.734397    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 08:05:40.734944 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:40.734412    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a77497b-33c1-4ac2-bfba-58b6edcf871e-original-pull-secret podName:9a77497b-33c1-4ac2-bfba-58b6edcf871e nodeName:}" failed. No retries permitted until 2026-11-02 08:05:41.73439843 +0000 UTC m=+3.371127759 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a77497b-33c1-4ac2-bfba-58b6edcf871e-original-pull-secret") pod "global-pull-secret-syncer-w2swh" (UID: "9a77497b-33c1-4ac2-bfba-58b6edcf871e") : object "kube-system"/"original-pull-secret" not registered
Nov 02 08:05:40.734944 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:40.734440    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff05c739-4a53-4cfe-942f-df41f812d742-metrics-certs podName:ff05c739-4a53-4cfe-942f-df41f812d742 nodeName:}" failed. No retries permitted until 2026-11-02 08:05:41.734428436 +0000 UTC m=+3.371157748 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff05c739-4a53-4cfe-942f-df41f812d742-metrics-certs") pod "network-metrics-daemon-rh5vc" (UID: "ff05c739-4a53-4cfe-942f-df41f812d742") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 08:05:40.835401 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.835370    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpq4r\" (UniqueName: \"kubernetes.io/projected/c03021d1-d458-46a8-af56-bfba0cc4b4b4-kube-api-access-rpq4r\") pod \"network-check-target-5qkvj\" (UID: \"c03021d1-d458-46a8-af56-bfba0cc4b4b4\") " pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:05:40.835561 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:40.835499    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 02 08:05:40.835561 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:40.835513    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 02 08:05:40.835561 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:40.835521    2577 projected.go:196] Error preparing data for projected volume kube-api-access-rpq4r for pod openshift-network-diagnostics/network-check-target-5qkvj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 08:05:40.835659 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:40.835564    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c03021d1-d458-46a8-af56-bfba0cc4b4b4-kube-api-access-rpq4r podName:c03021d1-d458-46a8-af56-bfba0cc4b4b4 nodeName:}" failed. No retries permitted until 2026-11-02 08:05:41.835552165 +0000 UTC m=+3.472281477 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rpq4r" (UniqueName: "kubernetes.io/projected/c03021d1-d458-46a8-af56-bfba0cc4b4b4-kube-api-access-rpq4r") pod "network-check-target-5qkvj" (UID: "c03021d1-d458-46a8-af56-bfba0cc4b4b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 08:05:40.851703 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.851653    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.us-west-2.compute.internal" event={"ID":"5efd6818a2d6de09c2e33ba0444837d8","Type":"ContainerStarted","Data":"6e090e4165f5fd0997d74c74596c5e0c2232b822f8935dd2dbc3a0909b3848a7"}
Nov 02 08:05:40.852666 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.852641    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal" event={"ID":"8a70872874f68c480b6b252a06401797","Type":"ContainerStarted","Data":"61443f19b06c5174067ac167c131cad07f3b1838b1262c254275ef6de87a36a3"}
Nov 02 08:05:40.853752 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.853734    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jb77f" event={"ID":"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15","Type":"ContainerStarted","Data":"01b46fcdb5fd050f0a7da2d941718e1004eaab21d114e64acecc68e1fbb59c1e"}
Nov 02 08:05:40.854808 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.854788    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zt85z" event={"ID":"79843809-80ac-4069-b436-ba1a26348505","Type":"ContainerStarted","Data":"45277ab15e1401d38b64135ca5501ccf8f8abe08fd8499494a6c4398d227f2ef"}
Nov 02 08:05:40.855838 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.855820    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dfp7b" event={"ID":"5b54f688-470c-4797-b685-8b9826e361a8","Type":"ContainerStarted","Data":"fbe098f0e9731181351749c3d5456206f5e9289e5f2df036054281cc8a80596a"}
Nov 02 08:05:40.856727 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:40.856705    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qsmp" event={"ID":"05f90c13-3432-4e94-b368-66226fa6ff26","Type":"ContainerStarted","Data":"1ebfc3569d1bfe6378defd79ab0685cf0c8953bc408127f5fdf6681b2dd1c4d0"}
Nov 02 08:05:41.017536 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:41.017456    2577 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 08:05:41.112847 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:41.112817    2577 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 08:05:41.185654 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:41.185588    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-01 08:00:39 +0000 UTC" deadline="2028-05-01 22:54:39.367805185 +0000 UTC"
Nov 02 08:05:41.185654 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:41.185647    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13118h48m58.182160188s"
Nov 02 08:05:41.209190 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:41.209159    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod558cdaf8_03cf_4d61_9c28_94a5da9c886d.slice/crio-5c4b89197d29a063b2e1395c733461dded1121f00371bd8e25803d9f48367fbc WatchSource:0}: Error finding container 5c4b89197d29a063b2e1395c733461dded1121f00371bd8e25803d9f48367fbc: Status 404 returned error can't find the container with id 5c4b89197d29a063b2e1395c733461dded1121f00371bd8e25803d9f48367fbc
Nov 02 08:05:41.248979 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:41.248937    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc705cd89_a6cf_4dcf_88b5_5ff2da580f07.slice/crio-cc75ecdda2d02d96a405b1324a5d8bbbdb344821cf453edf9371a4e06851db0b WatchSource:0}: Error finding container cc75ecdda2d02d96a405b1324a5d8bbbdb344821cf453edf9371a4e06851db0b: Status 404 returned error can't find the container with id cc75ecdda2d02d96a405b1324a5d8bbbdb344821cf453edf9371a4e06851db0b
Nov 02 08:05:41.289204 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:41.289125    2577 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 08:05:41.344712 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:41.344678    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0027996b_31d7_474a_88e9_efc0b6032300.slice/crio-7a4360c82ba695803be781b41ca0cf014fd2d869d94d3c48c5a587dcf5b8b24b WatchSource:0}: Error finding container 7a4360c82ba695803be781b41ca0cf014fd2d869d94d3c48c5a587dcf5b8b24b: Status 404 returned error can't find the container with id 7a4360c82ba695803be781b41ca0cf014fd2d869d94d3c48c5a587dcf5b8b24b
Nov 02 08:05:41.345143 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:41.345116    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd220536b_9c7c_4e34_8ac0_3c25ab4975f7.slice/crio-dddfb0521c8b80b98845cd23cf30b4c62d2b673ec394c5ad3e467159aed185b2 WatchSource:0}: Error finding container dddfb0521c8b80b98845cd23cf30b4c62d2b673ec394c5ad3e467159aed185b2: Status 404 returned error can't find the container with id dddfb0521c8b80b98845cd23cf30b4c62d2b673ec394c5ad3e467159aed185b2
Nov 02 08:05:41.444835 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:05:41.444798    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod731f7925_494b_4442_b5c4_8d2df9379896.slice/crio-b290572b501567db428c0dbfb6aa0a1e0464a75a5d2d732421ddaba91f3a965e WatchSource:0}: Error finding container b290572b501567db428c0dbfb6aa0a1e0464a75a5d2d732421ddaba91f3a965e: Status 404 returned error can't find the container with id b290572b501567db428c0dbfb6aa0a1e0464a75a5d2d732421ddaba91f3a965e
Nov 02 08:05:41.740225 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:41.740146    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a77497b-33c1-4ac2-bfba-58b6edcf871e-original-pull-secret\") pod \"global-pull-secret-syncer-w2swh\" (UID: \"9a77497b-33c1-4ac2-bfba-58b6edcf871e\") " pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:05:41.740225 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:41.740200    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff05c739-4a53-4cfe-942f-df41f812d742-metrics-certs\") pod \"network-metrics-daemon-rh5vc\" (UID: \"ff05c739-4a53-4cfe-942f-df41f812d742\") " pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:05:41.740914 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:41.740349    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 08:05:41.740914 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:41.740412    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff05c739-4a53-4cfe-942f-df41f812d742-metrics-certs podName:ff05c739-4a53-4cfe-942f-df41f812d742 nodeName:}" failed. No retries permitted until 2026-11-02 08:05:43.740394158 +0000 UTC m=+5.377123485 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff05c739-4a53-4cfe-942f-df41f812d742-metrics-certs") pod "network-metrics-daemon-rh5vc" (UID: "ff05c739-4a53-4cfe-942f-df41f812d742") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 08:05:41.740914 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:41.740471    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 02 08:05:41.740914 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:41.740506    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a77497b-33c1-4ac2-bfba-58b6edcf871e-original-pull-secret podName:9a77497b-33c1-4ac2-bfba-58b6edcf871e nodeName:}" failed. No retries permitted until 2026-11-02 08:05:43.740494151 +0000 UTC m=+5.377223478 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a77497b-33c1-4ac2-bfba-58b6edcf871e-original-pull-secret") pod "global-pull-secret-syncer-w2swh" (UID: "9a77497b-33c1-4ac2-bfba-58b6edcf871e") : object "kube-system"/"original-pull-secret" not registered
Nov 02 08:05:41.841467 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:41.841150    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpq4r\" (UniqueName: \"kubernetes.io/projected/c03021d1-d458-46a8-af56-bfba0cc4b4b4-kube-api-access-rpq4r\") pod \"network-check-target-5qkvj\" (UID: \"c03021d1-d458-46a8-af56-bfba0cc4b4b4\") " pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:05:41.841467 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:41.841327    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 02 08:05:41.841467 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:41.841348    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 02 08:05:41.841467 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:41.841361    2577 projected.go:196] Error preparing data for projected volume kube-api-access-rpq4r for pod openshift-network-diagnostics/network-check-target-5qkvj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 08:05:41.841467 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:41.841422    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c03021d1-d458-46a8-af56-bfba0cc4b4b4-kube-api-access-rpq4r podName:c03021d1-d458-46a8-af56-bfba0cc4b4b4 nodeName:}" failed. No retries permitted until 2026-11-02 08:05:43.841403447 +0000 UTC m=+5.478132782 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rpq4r" (UniqueName: "kubernetes.io/projected/c03021d1-d458-46a8-af56-bfba0cc4b4b4-kube-api-access-rpq4r") pod "network-check-target-5qkvj" (UID: "c03021d1-d458-46a8-af56-bfba0cc4b4b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 08:05:41.847873 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:41.847391    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:05:41.847873 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:41.847523    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh5vc" podUID="ff05c739-4a53-4cfe-942f-df41f812d742"
Nov 02 08:05:41.847873 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:41.847617    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:05:41.847873 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:41.847691    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qkvj" podUID="c03021d1-d458-46a8-af56-bfba0cc4b4b4"
Nov 02 08:05:41.847873 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:41.847743    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:05:41.847873 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:41.847834    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2swh" podUID="9a77497b-33c1-4ac2-bfba-58b6edcf871e"
Nov 02 08:05:41.863055 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:41.863020    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zfknz" event={"ID":"d220536b-9c7c-4e34-8ac0-3c25ab4975f7","Type":"ContainerStarted","Data":"dddfb0521c8b80b98845cd23cf30b4c62d2b673ec394c5ad3e467159aed185b2"}
Nov 02 08:05:41.864592 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:41.864563    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zdsw7" event={"ID":"0027996b-31d7-474a-88e9-efc0b6032300","Type":"ContainerStarted","Data":"7a4360c82ba695803be781b41ca0cf014fd2d869d94d3c48c5a587dcf5b8b24b"}
Nov 02 08:05:41.865995 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:41.865970    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gqv8f" event={"ID":"c705cd89-a6cf-4dcf-88b5-5ff2da580f07","Type":"ContainerStarted","Data":"cc75ecdda2d02d96a405b1324a5d8bbbdb344821cf453edf9371a4e06851db0b"}
Nov 02 08:05:41.867262 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:41.867237    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv" event={"ID":"731f7925-494b-4442-b5c4-8d2df9379896","Type":"ContainerStarted","Data":"b290572b501567db428c0dbfb6aa0a1e0464a75a5d2d732421ddaba91f3a965e"}
Nov 02 08:05:41.868896 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:41.868864    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jggtz" event={"ID":"558cdaf8-03cf-4d61-9c28-94a5da9c886d","Type":"ContainerStarted","Data":"5c4b89197d29a063b2e1395c733461dded1121f00371bd8e25803d9f48367fbc"}
Nov 02 08:05:42.186076 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:42.185975    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-01 08:00:39 +0000 UTC" deadline="2028-06-11 12:05:13.752941559 +0000 UTC"
Nov 02 08:05:42.186076 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:42.186027    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14091h59m31.56691855s"
Nov 02 08:05:43.765703 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:43.765327    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a77497b-33c1-4ac2-bfba-58b6edcf871e-original-pull-secret\") pod \"global-pull-secret-syncer-w2swh\" (UID: \"9a77497b-33c1-4ac2-bfba-58b6edcf871e\") " pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:05:43.765703 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:43.765376    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff05c739-4a53-4cfe-942f-df41f812d742-metrics-certs\") pod \"network-metrics-daemon-rh5vc\" (UID: \"ff05c739-4a53-4cfe-942f-df41f812d742\") " pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:05:43.765703 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:43.765509    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 08:05:43.765703 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:43.765574    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff05c739-4a53-4cfe-942f-df41f812d742-metrics-certs podName:ff05c739-4a53-4cfe-942f-df41f812d742 nodeName:}" failed. No retries permitted until 2026-11-02 08:05:47.765556221 +0000 UTC m=+9.402285535 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff05c739-4a53-4cfe-942f-df41f812d742-metrics-certs") pod "network-metrics-daemon-rh5vc" (UID: "ff05c739-4a53-4cfe-942f-df41f812d742") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 08:05:43.765703 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:43.765636    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 02 08:05:43.765703 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:43.765670    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a77497b-33c1-4ac2-bfba-58b6edcf871e-original-pull-secret podName:9a77497b-33c1-4ac2-bfba-58b6edcf871e nodeName:}" failed. No retries permitted until 2026-11-02 08:05:47.765659175 +0000 UTC m=+9.402388491 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a77497b-33c1-4ac2-bfba-58b6edcf871e-original-pull-secret") pod "global-pull-secret-syncer-w2swh" (UID: "9a77497b-33c1-4ac2-bfba-58b6edcf871e") : object "kube-system"/"original-pull-secret" not registered
Nov 02 08:05:43.848148 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:43.847694    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:05:43.848148 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:43.847838    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh5vc" podUID="ff05c739-4a53-4cfe-942f-df41f812d742"
Nov 02 08:05:43.848148 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:43.847910    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:05:43.848148 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:43.847976    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qkvj" podUID="c03021d1-d458-46a8-af56-bfba0cc4b4b4"
Nov 02 08:05:43.848148 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:43.848017    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:05:43.848148 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:43.848079    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2swh" podUID="9a77497b-33c1-4ac2-bfba-58b6edcf871e"
Nov 02 08:05:43.866855 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:43.866549    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpq4r\" (UniqueName: \"kubernetes.io/projected/c03021d1-d458-46a8-af56-bfba0cc4b4b4-kube-api-access-rpq4r\") pod \"network-check-target-5qkvj\" (UID: \"c03021d1-d458-46a8-af56-bfba0cc4b4b4\") " pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:05:43.866855 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:43.866728    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 02 08:05:43.866855 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:43.866747    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 02 08:05:43.866855 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:43.866759    2577 projected.go:196] Error preparing data for projected volume kube-api-access-rpq4r for pod openshift-network-diagnostics/network-check-target-5qkvj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 08:05:43.866855 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:43.866819    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c03021d1-d458-46a8-af56-bfba0cc4b4b4-kube-api-access-rpq4r podName:c03021d1-d458-46a8-af56-bfba0cc4b4b4 nodeName:}" failed. No retries permitted until 2026-11-02 08:05:47.866798944 +0000 UTC m=+9.503528257 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rpq4r" (UniqueName: "kubernetes.io/projected/c03021d1-d458-46a8-af56-bfba0cc4b4b4-kube-api-access-rpq4r") pod "network-check-target-5qkvj" (UID: "c03021d1-d458-46a8-af56-bfba0cc4b4b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 08:05:44.902460 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:44.902221    2577 generic.go:356] "Generic (PLEG): container finished" podID="05f90c13-3432-4e94-b368-66226fa6ff26" containerID="4325d77f3622b6cffc8d2ae0798c015f1876d9c6db3751142c8fcbb86ae248a7" exitCode=0
Nov 02 08:05:44.902934 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:44.902566    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qsmp" event={"ID":"05f90c13-3432-4e94-b368-66226fa6ff26","Type":"ContainerDied","Data":"4325d77f3622b6cffc8d2ae0798c015f1876d9c6db3751142c8fcbb86ae248a7"}
Nov 02 08:05:44.928134 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:44.928080    2577 generic.go:356] "Generic (PLEG): container finished" podID="8a70872874f68c480b6b252a06401797" containerID="e8c1e351c48cb912e17501c29531601a7158ce63a2dae3d206bf6592f2213636" exitCode=0
Nov 02 08:05:44.928262 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:44.928171    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal" event={"ID":"8a70872874f68c480b6b252a06401797","Type":"ContainerDied","Data":"e8c1e351c48cb912e17501c29531601a7158ce63a2dae3d206bf6592f2213636"}
Nov 02 08:05:45.848245 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:45.847683    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:05:45.848245 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:45.847813    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh5vc" podUID="ff05c739-4a53-4cfe-942f-df41f812d742"
Nov 02 08:05:45.848245 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:45.847903    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:05:45.848245 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:45.847979    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qkvj" podUID="c03021d1-d458-46a8-af56-bfba0cc4b4b4"
Nov 02 08:05:45.848245 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:45.848032    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:05:45.848245 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:45.848098    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2swh" podUID="9a77497b-33c1-4ac2-bfba-58b6edcf871e"
Nov 02 08:05:45.936116 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:45.935895    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.us-west-2.compute.internal" event={"ID":"5efd6818a2d6de09c2e33ba0444837d8","Type":"ContainerStarted","Data":"5401020d53e52925f8e344a09e9479afbbf4d3264484fe3891c77e98c3338172"}
Nov 02 08:05:46.161390 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:46.161331    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.us-west-2.compute.internal" podStartSLOduration=7.161314903 podStartE2EDuration="7.161314903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 08:05:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:05:46.048246181 +0000 UTC m=+7.684975515" watchObservedRunningTime="2026-11-02 08:05:46.161314903 +0000 UTC m=+7.798044238"
Nov 02 08:05:46.944652 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:46.944614    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal" event={"ID":"8a70872874f68c480b6b252a06401797","Type":"ContainerStarted","Data":"3ec24be3851c8f88eeacb344f71df57396299a64644c1451f16019f57c63b2f8"}
Nov 02 08:05:46.950399 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:46.950370    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zdsw7" event={"ID":"0027996b-31d7-474a-88e9-efc0b6032300","Type":"ContainerStarted","Data":"8260561379c62d23f17c7173b9fb1678626ade86b0595f3d3cd0f31ea905c887"}
Nov 02 08:05:47.176836 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:47.176766    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal" podStartSLOduration=8.176748161 podStartE2EDuration="8.176748161s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 08:05:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:05:47.061007325 +0000 UTC m=+8.697736660" watchObservedRunningTime="2026-11-02 08:05:47.176748161 +0000 UTC m=+8.813477496"
Nov 02 08:05:47.801706 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:47.801666    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a77497b-33c1-4ac2-bfba-58b6edcf871e-original-pull-secret\") pod \"global-pull-secret-syncer-w2swh\" (UID: \"9a77497b-33c1-4ac2-bfba-58b6edcf871e\") " pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:05:47.801706 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:47.801714    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff05c739-4a53-4cfe-942f-df41f812d742-metrics-certs\") pod \"network-metrics-daemon-rh5vc\" (UID: \"ff05c739-4a53-4cfe-942f-df41f812d742\") " pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:05:47.801935 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:47.801896    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 08:05:47.801998 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:47.801958    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff05c739-4a53-4cfe-942f-df41f812d742-metrics-certs podName:ff05c739-4a53-4cfe-942f-df41f812d742 nodeName:}" failed. No retries permitted until 2026-11-02 08:05:55.80194045 +0000 UTC m=+17.438669768 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff05c739-4a53-4cfe-942f-df41f812d742-metrics-certs") pod "network-metrics-daemon-rh5vc" (UID: "ff05c739-4a53-4cfe-942f-df41f812d742") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 08:05:47.802059 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:47.802013    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 02 08:05:47.802059 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:47.802037    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a77497b-33c1-4ac2-bfba-58b6edcf871e-original-pull-secret podName:9a77497b-33c1-4ac2-bfba-58b6edcf871e nodeName:}" failed. No retries permitted until 2026-11-02 08:05:55.802030261 +0000 UTC m=+17.438759574 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a77497b-33c1-4ac2-bfba-58b6edcf871e-original-pull-secret") pod "global-pull-secret-syncer-w2swh" (UID: "9a77497b-33c1-4ac2-bfba-58b6edcf871e") : object "kube-system"/"original-pull-secret" not registered
Nov 02 08:05:47.847402 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:47.847368    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:05:47.847568 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:47.847487    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2swh" podUID="9a77497b-33c1-4ac2-bfba-58b6edcf871e"
Nov 02 08:05:47.847568 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:47.847566    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:05:47.847683 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:47.847650    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh5vc" podUID="ff05c739-4a53-4cfe-942f-df41f812d742"
Nov 02 08:05:47.847741 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:47.847703    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:05:47.847794 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:47.847771    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qkvj" podUID="c03021d1-d458-46a8-af56-bfba0cc4b4b4"
Nov 02 08:05:47.902325 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:47.902292    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpq4r\" (UniqueName: \"kubernetes.io/projected/c03021d1-d458-46a8-af56-bfba0cc4b4b4-kube-api-access-rpq4r\") pod \"network-check-target-5qkvj\" (UID: \"c03021d1-d458-46a8-af56-bfba0cc4b4b4\") " pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:05:47.902476 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:47.902459    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 02 08:05:47.902541 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:47.902485    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 02 08:05:47.902541 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:47.902497    2577 projected.go:196] Error preparing data for projected volume kube-api-access-rpq4r for pod openshift-network-diagnostics/network-check-target-5qkvj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 08:05:47.902645 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:47.902557    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c03021d1-d458-46a8-af56-bfba0cc4b4b4-kube-api-access-rpq4r podName:c03021d1-d458-46a8-af56-bfba0cc4b4b4 nodeName:}" failed. No retries permitted until 2026-11-02 08:05:55.902536556 +0000 UTC m=+17.539265882 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rpq4r" (UniqueName: "kubernetes.io/projected/c03021d1-d458-46a8-af56-bfba0cc4b4b4-kube-api-access-rpq4r") pod "network-check-target-5qkvj" (UID: "c03021d1-d458-46a8-af56-bfba0cc4b4b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 08:05:47.959634 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:47.959599    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zfknz" event={"ID":"d220536b-9c7c-4e34-8ac0-3c25ab4975f7","Type":"ContainerStarted","Data":"301e98bda7397d59a8181c7260eadbb656a2d1aef54707006df0c6d4909b66cf"}
Nov 02 08:05:48.072296 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:48.072227    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zdsw7" podStartSLOduration=4.580636449 podStartE2EDuration="9.072210194s" totalImagesPullingTime="4.491573745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:05:47.185730055 +0000 UTC m=+8.822459390" watchObservedRunningTime="2026-11-02 08:05:48.072210194 +0000 UTC m=+9.708939533"
Nov 02 08:05:48.963398 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:48.963366    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv" event={"ID":"731f7925-494b-4442-b5c4-8d2df9379896","Type":"ContainerStarted","Data":"4863333f485f6975963f490500e1e36ac64d02c3b48553d0455a9ced9820bfb2"}
Nov 02 08:05:49.848251 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:49.847780    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:05:49.848251 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:49.847944    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh5vc" podUID="ff05c739-4a53-4cfe-942f-df41f812d742"
Nov 02 08:05:49.848251 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:49.848017    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:05:49.848251 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:49.848086    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qkvj" podUID="c03021d1-d458-46a8-af56-bfba0cc4b4b4"
Nov 02 08:05:49.848251 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:49.848139    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:05:49.848251 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:49.848186    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2swh" podUID="9a77497b-33c1-4ac2-bfba-58b6edcf871e"
Nov 02 08:05:49.971701 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:49.971668    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gqv8f" event={"ID":"c705cd89-a6cf-4dcf-88b5-5ff2da580f07","Type":"ContainerStarted","Data":"4dbf718dd433500fc5e48d5ca9a845e5776519076f3c532a1d8290b5a9c15efe"}
Nov 02 08:05:49.975079 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:49.975050    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dfp7b" event={"ID":"5b54f688-470c-4797-b685-8b9826e361a8","Type":"ContainerStarted","Data":"61aab21cfdd5b9b6ff6aad917ef433dc50de35f09930a6105bfb230814ce24bd"}
Nov 02 08:05:50.058334 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:50.058137    2577 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 02 08:05:50.087525 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:50.087476    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-gqv8f" podStartSLOduration=3.805129552 podStartE2EDuration="12.087461285s" totalImagesPullingTime="8.282331733s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 08:05:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:05:50.087163476 +0000 UTC m=+11.723892811" watchObservedRunningTime="2026-11-02 08:05:50.087461285 +0000 UTC m=+11.724190620"
Nov 02 08:05:50.087993 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:50.087957    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zfknz" podStartSLOduration=5.3546259339999995 podStartE2EDuration="11.087942018s" totalImagesPullingTime="5.733316084s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 08:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:05:48.072706195 +0000 UTC m=+9.709435530" watchObservedRunningTime="2026-11-02 08:05:50.087942018 +0000 UTC m=+11.724671353"
Nov 02 08:05:50.808130 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:50.808015    2577 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-02T08:05:50.058330116Z","UUID":"4acf4286-d300-4b52-824d-b2faca9348d1","Handler":null,"Name":"","Endpoint":""}
Nov 02 08:05:50.809623 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:50.809598    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 02 08:05:50.809623 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:50.809626    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 02 08:05:50.979042 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:50.979004    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv" event={"ID":"731f7925-494b-4442-b5c4-8d2df9379896","Type":"ContainerStarted","Data":"84343c9f95c52dbd489ee2cbf139e6422b2040792f21c9372e27f89964352014"}
Nov 02 08:05:50.980994 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:50.980946    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zt85z" event={"ID":"79843809-80ac-4069-b436-ba1a26348505","Type":"ContainerStarted","Data":"f4fb7b679f7a6029407686c4b8583009a47092ff2dba94f2911f8f4be823374a"}
Nov 02 08:05:50.983046 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:50.983020    2577 generic.go:356] "Generic (PLEG): container finished" podID="05f90c13-3432-4e94-b368-66226fa6ff26" containerID="1dd371729015a9625ef16911ec923e192b09d8b26c24cee2e956c5be89040665" exitCode=0
Nov 02 08:05:50.983824 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:50.983804    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qsmp" event={"ID":"05f90c13-3432-4e94-b368-66226fa6ff26","Type":"ContainerDied","Data":"1dd371729015a9625ef16911ec923e192b09d8b26c24cee2e956c5be89040665"}
Nov 02 08:05:51.099558 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:51.099466    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-dfp7b" podStartSLOduration=3.649783615 podStartE2EDuration="12.099450358s" totalImagesPullingTime="8.449666743s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 08:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:05:50.201360524 +0000 UTC m=+11.838089860" watchObservedRunningTime="2026-11-02 08:05:51.099450358 +0000 UTC m=+12.736179692"
Nov 02 08:05:51.220618 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:51.219938    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zt85z" podStartSLOduration=3.335407804 podStartE2EDuration="12.219919881s" totalImagesPullingTime="8.884512077s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 08:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:05:51.099897507 +0000 UTC m=+12.736626838" watchObservedRunningTime="2026-11-02 08:05:51.219919881 +0000 UTC m=+12.856649217"
Nov 02 08:05:51.232700 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:51.232669    2577 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zdsw7"
Nov 02 08:05:51.233114 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:51.233089    2577 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zdsw7"
Nov 02 08:05:51.847746 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:51.847719    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:05:51.847746 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:51.847719    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:05:51.847946 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:51.847898    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2swh" podUID="9a77497b-33c1-4ac2-bfba-58b6edcf871e"
Nov 02 08:05:51.847946 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:51.847927    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:05:51.848035 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:51.848018    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qkvj" podUID="c03021d1-d458-46a8-af56-bfba0cc4b4b4"
Nov 02 08:05:51.848104 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:51.848092    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh5vc" podUID="ff05c739-4a53-4cfe-942f-df41f812d742"
Nov 02 08:05:51.988141 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:51.988060    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv" event={"ID":"731f7925-494b-4442-b5c4-8d2df9379896","Type":"ContainerStarted","Data":"a73a133908c2945ab143a0fda2bcb19240a941f5a0e3593d75603fee3e1144a1"}
Nov 02 08:05:51.990387 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:51.990362    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jggtz" event={"ID":"558cdaf8-03cf-4d61-9c28-94a5da9c886d","Type":"ContainerStarted","Data":"55bbaef00e8f53d15056f5c13bc7ff5da35627ce1b07fff71088d996343157e5"}
Nov 02 08:05:52.105464 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:52.105416    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv" podStartSLOduration=3.257385303 podStartE2EDuration="13.105401284s" totalImagesPullingTime="9.848015981s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 08:05:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:05:52.105162681 +0000 UTC m=+13.741892015" watchObservedRunningTime="2026-11-02 08:05:52.105401284 +0000 UTC m=+13.742130621"
Nov 02 08:05:52.222464 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:52.222412    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jggtz" podStartSLOduration=3.782828516 podStartE2EDuration="14.222397468s" totalImagesPullingTime="10.439568952s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 08:05:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:05:52.222158459 +0000 UTC m=+13.858887795" watchObservedRunningTime="2026-11-02 08:05:52.222397468 +0000 UTC m=+13.859126801"
Nov 02 08:05:52.995426 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:52.995344    2577 generic.go:356] "Generic (PLEG): container finished" podID="05f90c13-3432-4e94-b368-66226fa6ff26" containerID="7a606672ef16b1abf66973bd8d1469e67af0d77ee6155e81b73bbe49cf49d477" exitCode=0
Nov 02 08:05:52.995895 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:52.995424    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qsmp" event={"ID":"05f90c13-3432-4e94-b368-66226fa6ff26","Type":"ContainerDied","Data":"7a606672ef16b1abf66973bd8d1469e67af0d77ee6155e81b73bbe49cf49d477"}
Nov 02 08:05:53.007359 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:53.007342    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dfp7b_5b54f688-470c-4797-b685-8b9826e361a8/dns-node-resolver/0.log"
Nov 02 08:05:53.847352 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:53.847116    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:05:53.847513 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:53.847433    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh5vc" podUID="ff05c739-4a53-4cfe-942f-df41f812d742"
Nov 02 08:05:53.847513 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:53.847193    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:05:53.847513 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:53.847149    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:05:53.847654 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:53.847516    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2swh" podUID="9a77497b-33c1-4ac2-bfba-58b6edcf871e"
Nov 02 08:05:53.847654 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:53.847589    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qkvj" podUID="c03021d1-d458-46a8-af56-bfba0cc4b4b4"
Nov 02 08:05:54.243866 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:54.243696    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zfknz_d220536b-9c7c-4e34-8ac0-3c25ab4975f7/node-ca/0.log"
Nov 02 08:05:55.002382 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:55.002348    2577 generic.go:356] "Generic (PLEG): container finished" podID="05f90c13-3432-4e94-b368-66226fa6ff26" containerID="29be0744f4609c45a46121dc3795edcd3978e977f6533a742add759aa6b9bfd7" exitCode=0
Nov 02 08:05:55.002520 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:55.002412    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qsmp" event={"ID":"05f90c13-3432-4e94-b368-66226fa6ff26","Type":"ContainerDied","Data":"29be0744f4609c45a46121dc3795edcd3978e977f6533a742add759aa6b9bfd7"}
Nov 02 08:05:55.847982 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:55.847948    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:05:55.847982 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:55.847978    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:05:55.848409 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:55.847947    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:05:55.848409 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:55.848065    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2swh" podUID="9a77497b-33c1-4ac2-bfba-58b6edcf871e"
Nov 02 08:05:55.848409 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:55.848144    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh5vc" podUID="ff05c739-4a53-4cfe-942f-df41f812d742"
Nov 02 08:05:55.848409 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:55.848200    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qkvj" podUID="c03021d1-d458-46a8-af56-bfba0cc4b4b4"
Nov 02 08:05:55.868168 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:55.868143    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a77497b-33c1-4ac2-bfba-58b6edcf871e-original-pull-secret\") pod \"global-pull-secret-syncer-w2swh\" (UID: \"9a77497b-33c1-4ac2-bfba-58b6edcf871e\") " pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:05:55.868236 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:55.868172    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff05c739-4a53-4cfe-942f-df41f812d742-metrics-certs\") pod \"network-metrics-daemon-rh5vc\" (UID: \"ff05c739-4a53-4cfe-942f-df41f812d742\") " pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:05:55.868294 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:55.868278    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 02 08:05:55.868336 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:55.868321    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 08:05:55.868336 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:55.868334    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a77497b-33c1-4ac2-bfba-58b6edcf871e-original-pull-secret podName:9a77497b-33c1-4ac2-bfba-58b6edcf871e nodeName:}" failed. No retries permitted until 2026-11-02 08:06:11.868320617 +0000 UTC m=+33.505049934 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a77497b-33c1-4ac2-bfba-58b6edcf871e-original-pull-secret") pod "global-pull-secret-syncer-w2swh" (UID: "9a77497b-33c1-4ac2-bfba-58b6edcf871e") : object "kube-system"/"original-pull-secret" not registered
Nov 02 08:05:55.868408 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:55.868354    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff05c739-4a53-4cfe-942f-df41f812d742-metrics-certs podName:ff05c739-4a53-4cfe-942f-df41f812d742 nodeName:}" failed. No retries permitted until 2026-11-02 08:06:11.868344737 +0000 UTC m=+33.505074063 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff05c739-4a53-4cfe-942f-df41f812d742-metrics-certs") pod "network-metrics-daemon-rh5vc" (UID: "ff05c739-4a53-4cfe-942f-df41f812d742") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 08:05:55.969084 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:55.969058    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpq4r\" (UniqueName: \"kubernetes.io/projected/c03021d1-d458-46a8-af56-bfba0cc4b4b4-kube-api-access-rpq4r\") pod \"network-check-target-5qkvj\" (UID: \"c03021d1-d458-46a8-af56-bfba0cc4b4b4\") " pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:05:55.969220 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:55.969202    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 02 08:05:55.969288 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:55.969222    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 02 08:05:55.969288 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:55.969232    2577 projected.go:196] Error preparing data for projected volume kube-api-access-rpq4r for pod openshift-network-diagnostics/network-check-target-5qkvj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 08:05:55.969288 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:55.969280    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c03021d1-d458-46a8-af56-bfba0cc4b4b4-kube-api-access-rpq4r podName:c03021d1-d458-46a8-af56-bfba0cc4b4b4 nodeName:}" failed. No retries permitted until 2026-11-02 08:06:11.96926336 +0000 UTC m=+33.605992673 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rpq4r" (UniqueName: "kubernetes.io/projected/c03021d1-d458-46a8-af56-bfba0cc4b4b4-kube-api-access-rpq4r") pod "network-check-target-5qkvj" (UID: "c03021d1-d458-46a8-af56-bfba0cc4b4b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 08:05:57.009727 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:57.009547    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb77f_3e7ae74c-fcd8-4820-a8b7-769a5fff9f15/ovn-acl-logging/0.log"
Nov 02 08:05:57.010208 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:57.010088    2577 generic.go:356] "Generic (PLEG): container finished" podID="3e7ae74c-fcd8-4820-a8b7-769a5fff9f15" containerID="64e9f0396d8fd3a93e130bb9540f9a52b2f6009eecad42bd40bb370eff0f9e74" exitCode=1
Nov 02 08:05:57.010208 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:57.010152    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jb77f" event={"ID":"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15","Type":"ContainerStarted","Data":"84f92b7248584354786ddb544d059d34e33da14f31cdbb301fe9a381333a8ffd"}
Nov 02 08:05:57.010287 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:57.010221    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jb77f" event={"ID":"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15","Type":"ContainerStarted","Data":"8d95ddc8c2e20448779d7b17b71d5e3c21a01d5846b9baea10a60c22f1a3e8ac"}
Nov 02 08:05:57.010287 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:57.010252    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jb77f" event={"ID":"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15","Type":"ContainerStarted","Data":"5526099d7357b1f44ee240fb360e566c5d56b7ab54181e24f2468069c5c7bce8"}
Nov 02 08:05:57.010376 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:57.010325    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jb77f" event={"ID":"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15","Type":"ContainerStarted","Data":"11444912fc95af7636471bf99c51cc5cc65e9f741f0f649a643ab3a066cfe858"}
Nov 02 08:05:57.010376 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:57.010370    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jb77f" event={"ID":"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15","Type":"ContainerDied","Data":"64e9f0396d8fd3a93e130bb9540f9a52b2f6009eecad42bd40bb370eff0f9e74"}
Nov 02 08:05:57.010436 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:57.010414    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jb77f" event={"ID":"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15","Type":"ContainerStarted","Data":"654c425f80c264c24a54005f4c01e8260bb8f2b681246d79fdeb5566dfb3b8d5"}
Nov 02 08:05:57.847382 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:57.847293    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:05:57.847382 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:57.847318    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:05:57.847382 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:57.847335    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:05:57.847582 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:57.847410    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qkvj" podUID="c03021d1-d458-46a8-af56-bfba0cc4b4b4"
Nov 02 08:05:57.847582 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:57.847534    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh5vc" podUID="ff05c739-4a53-4cfe-942f-df41f812d742"
Nov 02 08:05:57.847646 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:57.847598    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2swh" podUID="9a77497b-33c1-4ac2-bfba-58b6edcf871e"
Nov 02 08:05:58.014274 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:58.014242    2577 generic.go:356] "Generic (PLEG): container finished" podID="05f90c13-3432-4e94-b368-66226fa6ff26" containerID="b4f10e6dcc44bc1114e28f7460bf83844bb26ad5279b02a1b2e4462a6f6e34f7" exitCode=0
Nov 02 08:05:58.014723 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:58.014309    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qsmp" event={"ID":"05f90c13-3432-4e94-b368-66226fa6ff26","Type":"ContainerDied","Data":"b4f10e6dcc44bc1114e28f7460bf83844bb26ad5279b02a1b2e4462a6f6e34f7"}
Nov 02 08:05:59.018944 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:59.018851    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb77f_3e7ae74c-fcd8-4820-a8b7-769a5fff9f15/ovn-acl-logging/0.log"
Nov 02 08:05:59.019462 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:59.019209    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jb77f" event={"ID":"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15","Type":"ContainerStarted","Data":"7cf038c0d36ab2e5e2aadb0d79a00e51c0d469cb491ba032948143fdf8cc5a00"}
Nov 02 08:05:59.021780 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:59.021754    2577 generic.go:356] "Generic (PLEG): container finished" podID="05f90c13-3432-4e94-b368-66226fa6ff26" containerID="df153442f34cf136d04ea692024f71fb8e469d7fcb7eb31a3abb23bf4bbb9c24" exitCode=0
Nov 02 08:05:59.021904 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:59.021805    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qsmp" event={"ID":"05f90c13-3432-4e94-b368-66226fa6ff26","Type":"ContainerDied","Data":"df153442f34cf136d04ea692024f71fb8e469d7fcb7eb31a3abb23bf4bbb9c24"}
Nov 02 08:05:59.848018 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:59.847988    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:05:59.848018 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:59.848021    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:05:59.848247 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:05:59.847998    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:05:59.848247 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:59.848101    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2swh" podUID="9a77497b-33c1-4ac2-bfba-58b6edcf871e"
Nov 02 08:05:59.848247 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:59.848170    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qkvj" podUID="c03021d1-d458-46a8-af56-bfba0cc4b4b4"
Nov 02 08:05:59.848387 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:05:59.848247    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh5vc" podUID="ff05c739-4a53-4cfe-942f-df41f812d742"
Nov 02 08:06:00.027179 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:00.027146    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qsmp" event={"ID":"05f90c13-3432-4e94-b368-66226fa6ff26","Type":"ContainerStarted","Data":"98a1343db41fe526ea1e09e46964710c654de1dbae031e9b8b656964614ba421"}
Nov 02 08:06:00.145118 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:00.145028    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9qsmp" podStartSLOduration=7.71904097 podStartE2EDuration="21.145015309s" totalImagesPullingTime="13.425974339s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 08:05:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:06:00.144931424 +0000 UTC m=+21.781660759" watchObservedRunningTime="2026-11-02 08:06:00.145015309 +0000 UTC m=+21.781744643"
Nov 02 08:06:01.032567 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:01.032355    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb77f_3e7ae74c-fcd8-4820-a8b7-769a5fff9f15/ovn-acl-logging/0.log"
Nov 02 08:06:01.033094 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:01.032918    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jb77f" event={"ID":"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15","Type":"ContainerStarted","Data":"0b3da29b3ccf2e0876d575b2cbc52b0c7fa739f591867279752bb0861b8159a2"}
Nov 02 08:06:01.033442 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:01.033422    2577 scope.go:122] "RemoveContainer" containerID="64e9f0396d8fd3a93e130bb9540f9a52b2f6009eecad42bd40bb370eff0f9e74"
Nov 02 08:06:01.847763 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:01.847728    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:06:01.847976 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:01.847742    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:06:01.847976 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:01.847848    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh5vc" podUID="ff05c739-4a53-4cfe-942f-df41f812d742"
Nov 02 08:06:01.847976 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:01.847751    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:06:01.847976 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:01.847914    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2swh" podUID="9a77497b-33c1-4ac2-bfba-58b6edcf871e"
Nov 02 08:06:01.847976 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:01.847968    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qkvj" podUID="c03021d1-d458-46a8-af56-bfba0cc4b4b4"
Nov 02 08:06:02.039259 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:02.039232    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb77f_3e7ae74c-fcd8-4820-a8b7-769a5fff9f15/ovn-acl-logging/0.log"
Nov 02 08:06:02.039665 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:02.039586    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jb77f" event={"ID":"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15","Type":"ContainerStarted","Data":"2eada4c781594463ad72abbbd0218eba4e9ebe8c447959e83d947efdaeed4c15"}
Nov 02 08:06:02.039853 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:02.039836    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:02.039934 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:02.039923    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:02.039993 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:02.039965    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:02.054941 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:02.054909    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:02.060419 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:02.060398    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:02.216332 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:02.216233    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jb77f" podStartSLOduration=7.734408252 podStartE2EDuration="23.216219838s" totalImagesPullingTime="15.481811586s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 08:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:06:02.215787857 +0000 UTC m=+23.852517190" watchObservedRunningTime="2026-11-02 08:06:02.216219838 +0000 UTC m=+23.852949229"
Nov 02 08:06:03.847766 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:03.847739    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:06:03.847766 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:03.847767    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:06:03.848293 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:03.847927    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh5vc" podUID="ff05c739-4a53-4cfe-942f-df41f812d742"
Nov 02 08:06:03.848293 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:03.847972    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2swh" podUID="9a77497b-33c1-4ac2-bfba-58b6edcf871e"
Nov 02 08:06:03.848293 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:03.848026    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:06:03.848293 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:03.848073    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qkvj" podUID="c03021d1-d458-46a8-af56-bfba0cc4b4b4"
Nov 02 08:06:05.847210 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:05.847172    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:06:05.847210 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:05.847197    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:06:05.847623 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:05.847279    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:06:05.847623 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:05.847298    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qkvj" podUID="c03021d1-d458-46a8-af56-bfba0cc4b4b4"
Nov 02 08:06:05.847623 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:05.847348    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2swh" podUID="9a77497b-33c1-4ac2-bfba-58b6edcf871e"
Nov 02 08:06:05.847623 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:05.847389    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh5vc" podUID="ff05c739-4a53-4cfe-942f-df41f812d742"
Nov 02 08:06:06.991088 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:06.991054    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zdsw7"
Nov 02 08:06:06.991675 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:06.991209    2577 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 02 08:06:06.991675 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:06.991604    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zdsw7"
Nov 02 08:06:07.847573 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:07.847486    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:06:07.847739 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:07.847580    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:06:07.847739 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:07.847588    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qkvj" podUID="c03021d1-d458-46a8-af56-bfba0cc4b4b4"
Nov 02 08:06:07.847739 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:07.847611    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:06:07.847739 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:07.847701    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2swh" podUID="9a77497b-33c1-4ac2-bfba-58b6edcf871e"
Nov 02 08:06:07.847982 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:07.847790    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh5vc" podUID="ff05c739-4a53-4cfe-942f-df41f812d742"
Nov 02 08:06:09.848039 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:09.848002    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:06:09.848510 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:09.848107    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:06:09.848510 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:09.848117    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2swh" podUID="9a77497b-33c1-4ac2-bfba-58b6edcf871e"
Nov 02 08:06:09.848510 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:09.848136    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:06:09.848510 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:09.848219    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qkvj" podUID="c03021d1-d458-46a8-af56-bfba0cc4b4b4"
Nov 02 08:06:09.848510 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:09.848279    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh5vc" podUID="ff05c739-4a53-4cfe-942f-df41f812d742"
Nov 02 08:06:11.847468 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:11.847433    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:06:11.847848 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:11.847431    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:06:11.847848 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:11.847562    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh5vc" podUID="ff05c739-4a53-4cfe-942f-df41f812d742"
Nov 02 08:06:11.847848 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:11.847450    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:06:11.847848 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:11.847622    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2swh" podUID="9a77497b-33c1-4ac2-bfba-58b6edcf871e"
Nov 02 08:06:11.847848 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:11.847693    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qkvj" podUID="c03021d1-d458-46a8-af56-bfba0cc4b4b4"
Nov 02 08:06:11.882555 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:11.882526    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a77497b-33c1-4ac2-bfba-58b6edcf871e-original-pull-secret\") pod \"global-pull-secret-syncer-w2swh\" (UID: \"9a77497b-33c1-4ac2-bfba-58b6edcf871e\") " pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:06:11.882693 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:11.882559    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff05c739-4a53-4cfe-942f-df41f812d742-metrics-certs\") pod \"network-metrics-daemon-rh5vc\" (UID: \"ff05c739-4a53-4cfe-942f-df41f812d742\") " pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:06:11.882693 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:11.882657    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 08:06:11.882693 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:11.882672    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 02 08:06:11.882811 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:11.882705    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff05c739-4a53-4cfe-942f-df41f812d742-metrics-certs podName:ff05c739-4a53-4cfe-942f-df41f812d742 nodeName:}" failed. No retries permitted until 2026-11-02 08:06:43.882692288 +0000 UTC m=+65.519421600 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff05c739-4a53-4cfe-942f-df41f812d742-metrics-certs") pod "network-metrics-daemon-rh5vc" (UID: "ff05c739-4a53-4cfe-942f-df41f812d742") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 08:06:11.882811 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:11.882730    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a77497b-33c1-4ac2-bfba-58b6edcf871e-original-pull-secret podName:9a77497b-33c1-4ac2-bfba-58b6edcf871e nodeName:}" failed. No retries permitted until 2026-11-02 08:06:43.882712701 +0000 UTC m=+65.519442014 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a77497b-33c1-4ac2-bfba-58b6edcf871e-original-pull-secret") pod "global-pull-secret-syncer-w2swh" (UID: "9a77497b-33c1-4ac2-bfba-58b6edcf871e") : object "kube-system"/"original-pull-secret" not registered
Nov 02 08:06:11.983098 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:11.983057    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpq4r\" (UniqueName: \"kubernetes.io/projected/c03021d1-d458-46a8-af56-bfba0cc4b4b4-kube-api-access-rpq4r\") pod \"network-check-target-5qkvj\" (UID: \"c03021d1-d458-46a8-af56-bfba0cc4b4b4\") " pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:06:11.983262 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:11.983217    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 02 08:06:11.983262 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:11.983234    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 02 08:06:11.983262 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:11.983246    2577 projected.go:196] Error preparing data for projected volume kube-api-access-rpq4r for pod openshift-network-diagnostics/network-check-target-5qkvj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 08:06:11.983359 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:11.983309    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c03021d1-d458-46a8-af56-bfba0cc4b4b4-kube-api-access-rpq4r podName:c03021d1-d458-46a8-af56-bfba0cc4b4b4 nodeName:}" failed. No retries permitted until 2026-11-02 08:06:43.983292785 +0000 UTC m=+65.620022111 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rpq4r" (UniqueName: "kubernetes.io/projected/c03021d1-d458-46a8-af56-bfba0cc4b4b4-kube-api-access-rpq4r") pod "network-check-target-5qkvj" (UID: "c03021d1-d458-46a8-af56-bfba0cc4b4b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 08:06:13.847979 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:13.847950    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:06:13.848440 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:13.848074    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:06:13.848440 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:13.848101    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:06:13.848440 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:13.848090    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2swh" podUID="9a77497b-33c1-4ac2-bfba-58b6edcf871e"
Nov 02 08:06:13.848440 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:13.848172    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh5vc" podUID="ff05c739-4a53-4cfe-942f-df41f812d742"
Nov 02 08:06:13.848440 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:13.848226    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qkvj" podUID="c03021d1-d458-46a8-af56-bfba0cc4b4b4"
Nov 02 08:06:14.409169 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:14.408761    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5qkvj"]
Nov 02 08:06:14.409169 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:14.408871    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:06:14.409169 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:14.408983    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qkvj" podUID="c03021d1-d458-46a8-af56-bfba0cc4b4b4"
Nov 02 08:06:14.412462 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:14.412436    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w2swh"]
Nov 02 08:06:14.412586 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:14.412533    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:06:14.412644 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:14.412630    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2swh" podUID="9a77497b-33c1-4ac2-bfba-58b6edcf871e"
Nov 02 08:06:14.413096 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:14.413076    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rh5vc"]
Nov 02 08:06:14.413182 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:14.413152    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:06:14.413244 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:14.413230    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh5vc" podUID="ff05c739-4a53-4cfe-942f-df41f812d742"
Nov 02 08:06:15.443832 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:15.443663    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dfp7b_5b54f688-470c-4797-b685-8b9826e361a8/dns-node-resolver/0.log"
Nov 02 08:06:15.847685 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:15.847603    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:06:15.847685 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:15.847634    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:06:15.847899 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:15.847706    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qkvj" podUID="c03021d1-d458-46a8-af56-bfba0cc4b4b4"
Nov 02 08:06:15.847899 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:15.847762    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:06:15.847899 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:15.847830    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2swh" podUID="9a77497b-33c1-4ac2-bfba-58b6edcf871e"
Nov 02 08:06:15.848017 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:15.847901    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh5vc" podUID="ff05c739-4a53-4cfe-942f-df41f812d742"
Nov 02 08:06:17.043410 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:17.043378    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zfknz_d220536b-9c7c-4e34-8ac0-3c25ab4975f7/node-ca/0.log"
Nov 02 08:06:17.847746 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:17.847720    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:06:17.848016 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:17.847719    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:06:17.848016 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:17.847838    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2swh" podUID="9a77497b-33c1-4ac2-bfba-58b6edcf871e"
Nov 02 08:06:17.848016 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:17.847719    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:06:17.848016 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:17.847897    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5qkvj" podUID="c03021d1-d458-46a8-af56-bfba0cc4b4b4"
Nov 02 08:06:17.848016 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:17.847959    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh5vc" podUID="ff05c739-4a53-4cfe-942f-df41f812d742"
Nov 02 08:06:19.618638 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.618556    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-235.us-west-2.compute.internal" event="NodeReady"
Nov 02 08:06:19.619219 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.619049    2577 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Nov 02 08:06:19.774512 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.774475    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-p2f6f"]
Nov 02 08:06:19.799059 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.799027    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9b8f9"]
Nov 02 08:06:19.799213 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.799149    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p2f6f"
Nov 02 08:06:19.815069 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.815040    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6rcb9"]
Nov 02 08:06:19.815182 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.815142    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9b8f9"
Nov 02 08:06:19.829112 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.829092    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6rcb9"
Nov 02 08:06:19.836374 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.835932    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p2f6f"]
Nov 02 08:06:19.838482 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.838459    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6rcb9"]
Nov 02 08:06:19.839058 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.839042    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9b8f9"]
Nov 02 08:06:19.847966 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.847948    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:06:19.848049 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.847973    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:06:19.848104 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.848091    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:06:19.852221 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.852192    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Nov 02 08:06:19.852313 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.852232    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9ztjt\""
Nov 02 08:06:19.852313 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.852256    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Nov 02 08:06:19.867434 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.867418    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Nov 02 08:06:19.867535 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.867520    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Nov 02 08:06:19.867586 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.867553    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9tsd7\""
Nov 02 08:06:19.867630 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.867623    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Nov 02 08:06:19.867701 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.867683    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Nov 02 08:06:19.885357 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.885310    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Nov 02 08:06:19.885432 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.885390    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-t9rxp\""
Nov 02 08:06:19.885432 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.885430    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Nov 02 08:06:19.887982 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.887963    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Nov 02 08:06:19.902113 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.902094    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j6nct\""
Nov 02 08:06:19.902219 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.902130    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 02 08:06:19.902219 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.902188    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-ghx8m\""
Nov 02 08:06:19.902316 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.902243    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 02 08:06:19.902316 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.902255    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 02 08:06:19.902316 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.902269    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-4v7vr\""
Nov 02 08:06:19.902316 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.902308    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 02 08:06:19.945654 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.945632    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9dbb1434-9e62-4d55-86a3-b7e4b469fb42-metrics-tls\") pod \"dns-default-p2f6f\" (UID: \"9dbb1434-9e62-4d55-86a3-b7e4b469fb42\") " pod="openshift-dns/dns-default-p2f6f"
Nov 02 08:06:19.945746 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.945664    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q98x\" (UniqueName: \"kubernetes.io/projected/9dbb1434-9e62-4d55-86a3-b7e4b469fb42-kube-api-access-7q98x\") pod \"dns-default-p2f6f\" (UID: \"9dbb1434-9e62-4d55-86a3-b7e4b469fb42\") " pod="openshift-dns/dns-default-p2f6f"
Nov 02 08:06:19.945746 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.945697    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9b8f9\" (UID: \"cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8\") " pod="openshift-insights/insights-runtime-extractor-9b8f9"
Nov 02 08:06:19.945811 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.945775    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bbc2\" (UniqueName: \"kubernetes.io/projected/2a263223-99a0-43f4-9e93-f9b990f7c57d-kube-api-access-4bbc2\") pod \"ingress-canary-6rcb9\" (UID: \"2a263223-99a0-43f4-9e93-f9b990f7c57d\") " pod="openshift-ingress-canary/ingress-canary-6rcb9"
Nov 02 08:06:19.945811 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.945805    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8-data-volume\") pod \"insights-runtime-extractor-9b8f9\" (UID: \"cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8\") " pod="openshift-insights/insights-runtime-extractor-9b8f9"
Nov 02 08:06:19.945872 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.945824    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8-crio-socket\") pod \"insights-runtime-extractor-9b8f9\" (UID: \"cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8\") " pod="openshift-insights/insights-runtime-extractor-9b8f9"
Nov 02 08:06:19.945872 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.945854    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9dbb1434-9e62-4d55-86a3-b7e4b469fb42-config-volume\") pod \"dns-default-p2f6f\" (UID: \"9dbb1434-9e62-4d55-86a3-b7e4b469fb42\") " pod="openshift-dns/dns-default-p2f6f"
Nov 02 08:06:19.945963 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.945894    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dbb1434-9e62-4d55-86a3-b7e4b469fb42-tmp-dir\") pod \"dns-default-p2f6f\" (UID: \"9dbb1434-9e62-4d55-86a3-b7e4b469fb42\") " pod="openshift-dns/dns-default-p2f6f"
Nov 02 08:06:19.945963 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.945956    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9b8f9\" (UID: \"cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8\") " pod="openshift-insights/insights-runtime-extractor-9b8f9"
Nov 02 08:06:19.946052 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.946005    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a263223-99a0-43f4-9e93-f9b990f7c57d-cert\") pod \"ingress-canary-6rcb9\" (UID: \"2a263223-99a0-43f4-9e93-f9b990f7c57d\") " pod="openshift-ingress-canary/ingress-canary-6rcb9"
Nov 02 08:06:19.946090 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:19.946073    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcq5p\" (UniqueName: \"kubernetes.io/projected/cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8-kube-api-access-dcq5p\") pod \"insights-runtime-extractor-9b8f9\" (UID: \"cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8\") " pod="openshift-insights/insights-runtime-extractor-9b8f9"
Nov 02 08:06:20.047107 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:20.047073    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q98x\" (UniqueName: \"kubernetes.io/projected/9dbb1434-9e62-4d55-86a3-b7e4b469fb42-kube-api-access-7q98x\") pod \"dns-default-p2f6f\" (UID: \"9dbb1434-9e62-4d55-86a3-b7e4b469fb42\") " pod="openshift-dns/dns-default-p2f6f"
Nov 02 08:06:20.047261 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:20.047117    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9b8f9\" (UID: \"cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8\") " pod="openshift-insights/insights-runtime-extractor-9b8f9"
Nov 02 08:06:20.047261 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:20.047145    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bbc2\" (UniqueName: \"kubernetes.io/projected/2a263223-99a0-43f4-9e93-f9b990f7c57d-kube-api-access-4bbc2\") pod \"ingress-canary-6rcb9\" (UID: \"2a263223-99a0-43f4-9e93-f9b990f7c57d\") " pod="openshift-ingress-canary/ingress-canary-6rcb9"
Nov 02 08:06:20.047365 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:20.047302    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8-data-volume\") pod \"insights-runtime-extractor-9b8f9\" (UID: \"cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8\") " pod="openshift-insights/insights-runtime-extractor-9b8f9"
Nov 02 08:06:20.047365 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:20.047336    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8-crio-socket\") pod \"insights-runtime-extractor-9b8f9\" (UID: \"cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8\") " pod="openshift-insights/insights-runtime-extractor-9b8f9"
Nov 02 08:06:20.047462 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:20.047371    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9dbb1434-9e62-4d55-86a3-b7e4b469fb42-config-volume\") pod \"dns-default-p2f6f\" (UID: \"9dbb1434-9e62-4d55-86a3-b7e4b469fb42\") " pod="openshift-dns/dns-default-p2f6f"
Nov 02 08:06:20.047462 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:20.047389    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dbb1434-9e62-4d55-86a3-b7e4b469fb42-tmp-dir\") pod \"dns-default-p2f6f\" (UID: \"9dbb1434-9e62-4d55-86a3-b7e4b469fb42\") " pod="openshift-dns/dns-default-p2f6f"
Nov 02 08:06:20.047462 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:20.047406    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9b8f9\" (UID: \"cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8\") " pod="openshift-insights/insights-runtime-extractor-9b8f9"
Nov 02 08:06:20.047462 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:20.047430    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a263223-99a0-43f4-9e93-f9b990f7c57d-cert\") pod \"ingress-canary-6rcb9\" (UID: \"2a263223-99a0-43f4-9e93-f9b990f7c57d\") " pod="openshift-ingress-canary/ingress-canary-6rcb9"
Nov 02 08:06:20.047462 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:20.047448    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcq5p\" (UniqueName: \"kubernetes.io/projected/cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8-kube-api-access-dcq5p\") pod \"insights-runtime-extractor-9b8f9\" (UID: \"cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8\") " pod="openshift-insights/insights-runtime-extractor-9b8f9"
Nov 02 08:06:20.047462 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:20.047452    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8-crio-socket\") pod \"insights-runtime-extractor-9b8f9\" (UID: \"cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8\") " pod="openshift-insights/insights-runtime-extractor-9b8f9"
Nov 02 08:06:20.047751 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:20.047469    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9dbb1434-9e62-4d55-86a3-b7e4b469fb42-metrics-tls\") pod \"dns-default-p2f6f\" (UID: \"9dbb1434-9e62-4d55-86a3-b7e4b469fb42\") " pod="openshift-dns/dns-default-p2f6f"
Nov 02 08:06:20.047751 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:20.047725    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dbb1434-9e62-4d55-86a3-b7e4b469fb42-tmp-dir\") pod \"dns-default-p2f6f\" (UID: \"9dbb1434-9e62-4d55-86a3-b7e4b469fb42\") " pod="openshift-dns/dns-default-p2f6f"
Nov 02 08:06:20.047751 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:20.047743    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8-data-volume\") pod \"insights-runtime-extractor-9b8f9\" (UID: \"cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8\") " pod="openshift-insights/insights-runtime-extractor-9b8f9"
Nov 02 08:06:20.048246 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:20.048221    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9b8f9\" (UID: \"cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8\") " pod="openshift-insights/insights-runtime-extractor-9b8f9"
Nov 02 08:06:20.048332 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:20.048245    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9dbb1434-9e62-4d55-86a3-b7e4b469fb42-config-volume\") pod \"dns-default-p2f6f\" (UID: \"9dbb1434-9e62-4d55-86a3-b7e4b469fb42\") " pod="openshift-dns/dns-default-p2f6f"
Nov 02 08:06:20.051057 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:20.051035    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9dbb1434-9e62-4d55-86a3-b7e4b469fb42-metrics-tls\") pod \"dns-default-p2f6f\" (UID: \"9dbb1434-9e62-4d55-86a3-b7e4b469fb42\") " pod="openshift-dns/dns-default-p2f6f"
Nov 02 08:06:20.051140 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:20.051041    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9b8f9\" (UID: \"cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8\") " pod="openshift-insights/insights-runtime-extractor-9b8f9"
Nov 02 08:06:20.051140 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:20.051106    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a263223-99a0-43f4-9e93-f9b990f7c57d-cert\") pod \"ingress-canary-6rcb9\" (UID: \"2a263223-99a0-43f4-9e93-f9b990f7c57d\") " pod="openshift-ingress-canary/ingress-canary-6rcb9"
Nov 02 08:06:20.104615 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:20.104589    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q98x\" (UniqueName: \"kubernetes.io/projected/9dbb1434-9e62-4d55-86a3-b7e4b469fb42-kube-api-access-7q98x\") pod \"dns-default-p2f6f\" (UID: \"9dbb1434-9e62-4d55-86a3-b7e4b469fb42\") " pod="openshift-dns/dns-default-p2f6f"
Nov 02 08:06:20.104735 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:20.104681    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcq5p\" (UniqueName: \"kubernetes.io/projected/cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8-kube-api-access-dcq5p\") pod \"insights-runtime-extractor-9b8f9\" (UID: \"cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8\") " pod="openshift-insights/insights-runtime-extractor-9b8f9"
Nov 02 08:06:20.105108 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:20.105088    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bbc2\" (UniqueName: \"kubernetes.io/projected/2a263223-99a0-43f4-9e93-f9b990f7c57d-kube-api-access-4bbc2\") pod \"ingress-canary-6rcb9\" (UID: \"2a263223-99a0-43f4-9e93-f9b990f7c57d\") " pod="openshift-ingress-canary/ingress-canary-6rcb9"
Nov 02 08:06:20.137114 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:20.137054    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p2f6f"
Nov 02 08:06:20.188640 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:20.188543    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9b8f9"
Nov 02 08:06:20.221568 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:20.221548    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6rcb9"
Nov 02 08:06:20.684215 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:20.684184    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6rcb9"]
Nov 02 08:06:20.684714 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:06:20.684223    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a263223_99a0_43f4_9e93_f9b990f7c57d.slice/crio-e736bfab51da96e2f687a517ac31db8f2d94e5f927f76c9663e6fca54c6c4deb WatchSource:0}: Error finding container e736bfab51da96e2f687a517ac31db8f2d94e5f927f76c9663e6fca54c6c4deb: Status 404 returned error can't find the container with id e736bfab51da96e2f687a517ac31db8f2d94e5f927f76c9663e6fca54c6c4deb
Nov 02 08:06:20.687158 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:20.687021    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9b8f9"]
Nov 02 08:06:20.687672 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:20.687656    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p2f6f"]
Nov 02 08:06:20.726763 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:06:20.725847    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dbb1434_9e62_4d55_86a3_b7e4b469fb42.slice/crio-ea04eff886357b11cf3d1ec2d183d95053646a4314da7062299ed28005ad0805 WatchSource:0}: Error finding container ea04eff886357b11cf3d1ec2d183d95053646a4314da7062299ed28005ad0805: Status 404 returned error can't find the container with id ea04eff886357b11cf3d1ec2d183d95053646a4314da7062299ed28005ad0805
Nov 02 08:06:20.729171 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:06:20.729152    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfa1be69_6ed1_4bcd_b32d_f45b30b91ca8.slice/crio-9ce77a411ccd220fbc6ba34a25e9f6e8a7360339a4c2ad6d59ac9f70bf9c6ea1 WatchSource:0}: Error finding container 9ce77a411ccd220fbc6ba34a25e9f6e8a7360339a4c2ad6d59ac9f70bf9c6ea1: Status 404 returned error can't find the container with id 9ce77a411ccd220fbc6ba34a25e9f6e8a7360339a4c2ad6d59ac9f70bf9c6ea1
Nov 02 08:06:21.078335 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:21.078303    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6rcb9" event={"ID":"2a263223-99a0-43f4-9e93-f9b990f7c57d","Type":"ContainerStarted","Data":"e736bfab51da96e2f687a517ac31db8f2d94e5f927f76c9663e6fca54c6c4deb"}
Nov 02 08:06:21.079805 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:21.079781    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9b8f9" event={"ID":"cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8","Type":"ContainerStarted","Data":"8749527011e6a90b0e84b3687fd0fe9e819d9377e246707bd48e1d0d01ee24a0"}
Nov 02 08:06:21.079941 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:21.079824    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9b8f9" event={"ID":"cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8","Type":"ContainerStarted","Data":"9ce77a411ccd220fbc6ba34a25e9f6e8a7360339a4c2ad6d59ac9f70bf9c6ea1"}
Nov 02 08:06:21.080844 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:21.080823    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p2f6f" event={"ID":"9dbb1434-9e62-4d55-86a3-b7e4b469fb42","Type":"ContainerStarted","Data":"ea04eff886357b11cf3d1ec2d183d95053646a4314da7062299ed28005ad0805"}
Nov 02 08:06:23.089265 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.089237    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9b8f9" event={"ID":"cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8","Type":"ContainerStarted","Data":"3320c3a56b13dba9aa0c9f262cd9c2614fa0d9ade081a04d9d255cf365e98109"}
Nov 02 08:06:23.335850 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.335768    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-sz4kk"]
Nov 02 08:06:23.338226 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.338202    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sz4kk"
Nov 02 08:06:23.377051 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.376631    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcp9h\" (UniqueName: \"kubernetes.io/projected/8b58f599-6735-4461-8657-ef5abab78403-kube-api-access-hcp9h\") pod \"openshift-state-metrics-7bd7489957-sz4kk\" (UID: \"8b58f599-6735-4461-8657-ef5abab78403\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sz4kk"
Nov 02 08:06:23.377051 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.376692    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b58f599-6735-4461-8657-ef5abab78403-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-sz4kk\" (UID: \"8b58f599-6735-4461-8657-ef5abab78403\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sz4kk"
Nov 02 08:06:23.377051 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.376724    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b58f599-6735-4461-8657-ef5abab78403-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-sz4kk\" (UID: \"8b58f599-6735-4461-8657-ef5abab78403\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sz4kk"
Nov 02 08:06:23.377051 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.376760    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b58f599-6735-4461-8657-ef5abab78403-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-sz4kk\" (UID: \"8b58f599-6735-4461-8657-ef5abab78403\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sz4kk"
Nov 02 08:06:23.392770 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.392672    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-sz4kk"]
Nov 02 08:06:23.429131 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.429073    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Nov 02 08:06:23.441895 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.441848    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Nov 02 08:06:23.441895 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.441867    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Nov 02 08:06:23.442125 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.441987    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Nov 02 08:06:23.442125 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.442094    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Nov 02 08:06:23.442802 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.442779    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-2z55d\""
Nov 02 08:06:23.443303 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.443248    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c"]
Nov 02 08:06:23.445608 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.445585    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c"
Nov 02 08:06:23.477339 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.477297    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcp9h\" (UniqueName: \"kubernetes.io/projected/8b58f599-6735-4461-8657-ef5abab78403-kube-api-access-hcp9h\") pod \"openshift-state-metrics-7bd7489957-sz4kk\" (UID: \"8b58f599-6735-4461-8657-ef5abab78403\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sz4kk"
Nov 02 08:06:23.477339 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.477342    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/437fc0dd-7f5a-4e18-8252-810aab07ff3c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-w7d6c\" (UID: \"437fc0dd-7f5a-4e18-8252-810aab07ff3c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c"
Nov 02 08:06:23.477582 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.477379    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b58f599-6735-4461-8657-ef5abab78403-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-sz4kk\" (UID: \"8b58f599-6735-4461-8657-ef5abab78403\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sz4kk"
Nov 02 08:06:23.477582 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.477410    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b58f599-6735-4461-8657-ef5abab78403-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-sz4kk\" (UID: \"8b58f599-6735-4461-8657-ef5abab78403\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sz4kk"
Nov 02 08:06:23.477582 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.477442    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/437fc0dd-7f5a-4e18-8252-810aab07ff3c-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-w7d6c\" (UID: \"437fc0dd-7f5a-4e18-8252-810aab07ff3c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c"
Nov 02 08:06:23.477582 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.477463    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/437fc0dd-7f5a-4e18-8252-810aab07ff3c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-w7d6c\" (UID: \"437fc0dd-7f5a-4e18-8252-810aab07ff3c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c"
Nov 02 08:06:23.477582 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.477486    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b58f599-6735-4461-8657-ef5abab78403-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-sz4kk\" (UID: \"8b58f599-6735-4461-8657-ef5abab78403\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sz4kk"
Nov 02 08:06:23.477582 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.477538    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/437fc0dd-7f5a-4e18-8252-810aab07ff3c-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-w7d6c\" (UID: \"437fc0dd-7f5a-4e18-8252-810aab07ff3c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c"
Nov 02 08:06:23.477582 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.477565    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/437fc0dd-7f5a-4e18-8252-810aab07ff3c-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-w7d6c\" (UID: \"437fc0dd-7f5a-4e18-8252-810aab07ff3c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c"
Nov 02 08:06:23.477582 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.477582    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbn9c\" (UniqueName: \"kubernetes.io/projected/437fc0dd-7f5a-4e18-8252-810aab07ff3c-kube-api-access-kbn9c\") pod \"kube-state-metrics-5dc8d7d89b-w7d6c\" (UID: \"437fc0dd-7f5a-4e18-8252-810aab07ff3c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c"
Nov 02 08:06:23.479437 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.479277    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b58f599-6735-4461-8657-ef5abab78403-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-sz4kk\" (UID: \"8b58f599-6735-4461-8657-ef5abab78403\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sz4kk"
Nov 02 08:06:23.480681 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.480656    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-z4kx5"]
Nov 02 08:06:23.482721 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.482700    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:23.484168 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.484148    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b58f599-6735-4461-8657-ef5abab78403-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-sz4kk\" (UID: \"8b58f599-6735-4461-8657-ef5abab78403\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sz4kk"
Nov 02 08:06:23.484274 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.484178    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b58f599-6735-4461-8657-ef5abab78403-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-sz4kk\" (UID: \"8b58f599-6735-4461-8657-ef5abab78403\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sz4kk"
Nov 02 08:06:23.501274 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.501245    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Nov 02 08:06:23.503989 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.503956    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Nov 02 08:06:23.505476 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.505393    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c"]
Nov 02 08:06:23.536271 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.536238    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcp9h\" (UniqueName: \"kubernetes.io/projected/8b58f599-6735-4461-8657-ef5abab78403-kube-api-access-hcp9h\") pod \"openshift-state-metrics-7bd7489957-sz4kk\" (UID: \"8b58f599-6735-4461-8657-ef5abab78403\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sz4kk"
Nov 02 08:06:23.567803 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.567773    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Nov 02 08:06:23.568112 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.567982    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lbg2j\""
Nov 02 08:06:23.568318 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.568299    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-lgch7\""
Nov 02 08:06:23.568546 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.568504    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Nov 02 08:06:23.568599 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.568567    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Nov 02 08:06:23.578070 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.578041    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/437fc0dd-7f5a-4e18-8252-810aab07ff3c-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-w7d6c\" (UID: \"437fc0dd-7f5a-4e18-8252-810aab07ff3c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c"
Nov 02 08:06:23.578174 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.578090    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-node-exporter-wtmp\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:23.578174 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.578123    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-metrics-client-ca\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:23.578174 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.578148    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-node-exporter-accelerators-collector-config\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:23.578174 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.578173    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-sys\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:23.578366 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.578190    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:23.578366 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.578209    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc7fm\" (UniqueName: \"kubernetes.io/projected/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-kube-api-access-sc7fm\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:23.578366 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.578229    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/437fc0dd-7f5a-4e18-8252-810aab07ff3c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-w7d6c\" (UID: \"437fc0dd-7f5a-4e18-8252-810aab07ff3c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c"
Nov 02 08:06:23.578366 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.578292    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-root\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:23.578366 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.578321    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbn9c\" (UniqueName: \"kubernetes.io/projected/437fc0dd-7f5a-4e18-8252-810aab07ff3c-kube-api-access-kbn9c\") pod \"kube-state-metrics-5dc8d7d89b-w7d6c\" (UID: \"437fc0dd-7f5a-4e18-8252-810aab07ff3c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c"
Nov 02 08:06:23.578366 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.578348    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/437fc0dd-7f5a-4e18-8252-810aab07ff3c-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-w7d6c\" (UID: \"437fc0dd-7f5a-4e18-8252-810aab07ff3c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c"
Nov 02 08:06:23.578698 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.578377    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-node-exporter-textfile\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:23.578698 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.578423    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-node-exporter-tls\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:23.578698 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.578456    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/437fc0dd-7f5a-4e18-8252-810aab07ff3c-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-w7d6c\" (UID: \"437fc0dd-7f5a-4e18-8252-810aab07ff3c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c"
Nov 02 08:06:23.578698 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.578482    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/437fc0dd-7f5a-4e18-8252-810aab07ff3c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-w7d6c\" (UID: \"437fc0dd-7f5a-4e18-8252-810aab07ff3c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c"
Nov 02 08:06:23.582302 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.582278    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/437fc0dd-7f5a-4e18-8252-810aab07ff3c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-w7d6c\" (UID: \"437fc0dd-7f5a-4e18-8252-810aab07ff3c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c"
Nov 02 08:06:23.583393 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.583372    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/437fc0dd-7f5a-4e18-8252-810aab07ff3c-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-w7d6c\" (UID: \"437fc0dd-7f5a-4e18-8252-810aab07ff3c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c"
Nov 02 08:06:23.591935 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.583967    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/437fc0dd-7f5a-4e18-8252-810aab07ff3c-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-w7d6c\" (UID: \"437fc0dd-7f5a-4e18-8252-810aab07ff3c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c"
Nov 02 08:06:23.591935 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.587341    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/437fc0dd-7f5a-4e18-8252-810aab07ff3c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-w7d6c\" (UID: \"437fc0dd-7f5a-4e18-8252-810aab07ff3c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c"
Nov 02 08:06:23.591935 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.589334    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/437fc0dd-7f5a-4e18-8252-810aab07ff3c-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-w7d6c\" (UID: \"437fc0dd-7f5a-4e18-8252-810aab07ff3c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c"
Nov 02 08:06:23.601154 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.601131    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Nov 02 08:06:23.642704 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.642670    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbn9c\" (UniqueName: \"kubernetes.io/projected/437fc0dd-7f5a-4e18-8252-810aab07ff3c-kube-api-access-kbn9c\") pod \"kube-state-metrics-5dc8d7d89b-w7d6c\" (UID: \"437fc0dd-7f5a-4e18-8252-810aab07ff3c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c"
Nov 02 08:06:23.653470 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.653437    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sz4kk"
Nov 02 08:06:23.683384 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.683352    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-root\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:23.683655 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.683402    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-node-exporter-textfile\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:23.683655 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.683449    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-node-exporter-tls\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:23.683655 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.683504    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-node-exporter-wtmp\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:23.683655 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.683564    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-metrics-client-ca\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:23.683655 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.683592    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-node-exporter-accelerators-collector-config\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:23.683655 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.683624    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-sys\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:23.683655 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.683650    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:23.683960 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.683682    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc7fm\" (UniqueName: \"kubernetes.io/projected/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-kube-api-access-sc7fm\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:23.684064 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.684049    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-root\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:23.684298 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.684284    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-node-exporter-textfile\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:23.685189 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.684655    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-sys\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:23.685189 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.684768    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-node-exporter-wtmp\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:23.685189 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.685148    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-node-exporter-accelerators-collector-config\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:23.685189 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.685160    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-metrics-client-ca\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:23.687056 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.687031    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-node-exporter-tls\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:23.687148 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.687098    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:23.742594 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.742543    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc7fm\" (UniqueName: \"kubernetes.io/projected/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-kube-api-access-sc7fm\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:23.761409 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.761380    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c"
Nov 02 08:06:23.809410 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:23.809371    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:24.078331 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:06:24.078293    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b58f599_6735_4461_8657_ef5abab78403.slice/crio-8efcb5a5b85d2078c44d199766b6e88735990eadb1f706f241a7f4e27f5ebe87 WatchSource:0}: Error finding container 8efcb5a5b85d2078c44d199766b6e88735990eadb1f706f241a7f4e27f5ebe87: Status 404 returned error can't find the container with id 8efcb5a5b85d2078c44d199766b6e88735990eadb1f706f241a7f4e27f5ebe87
Nov 02 08:06:24.078626 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:24.078598    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-sz4kk"]
Nov 02 08:06:24.094121 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:24.094046    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z4kx5" event={"ID":"f8e6a0b5-f8b9-4d1b-848b-d3517004d495","Type":"ContainerStarted","Data":"b45f036757b3fa6c88c3143507672dc50a6817a55c98e6c6f651301fe8063d60"}
Nov 02 08:06:24.096729 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:24.096701    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p2f6f" event={"ID":"9dbb1434-9e62-4d55-86a3-b7e4b469fb42","Type":"ContainerStarted","Data":"9d212e5bd6e023acadcb6697fbdcff41ed4dd27e1fc9474c6bfd5db0fcd1a7ee"}
Nov 02 08:06:24.096832 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:24.096758    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p2f6f" event={"ID":"9dbb1434-9e62-4d55-86a3-b7e4b469fb42","Type":"ContainerStarted","Data":"6c5f9017eb157a033a69a57ee154c044f218c27c8d588f63d794d804ed4e2885"}
Nov 02 08:06:24.096909 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:24.096842    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-p2f6f"
Nov 02 08:06:24.098156 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:24.098131    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sz4kk" event={"ID":"8b58f599-6735-4461-8657-ef5abab78403","Type":"ContainerStarted","Data":"8efcb5a5b85d2078c44d199766b6e88735990eadb1f706f241a7f4e27f5ebe87"}
Nov 02 08:06:24.134466 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:24.134438    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c"]
Nov 02 08:06:24.134654 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:06:24.134627    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod437fc0dd_7f5a_4e18_8252_810aab07ff3c.slice/crio-aaa2c55a85fa19ec7d9f6fda37f7ae5b5ab15db3dd4247c80128f87c35867318 WatchSource:0}: Error finding container aaa2c55a85fa19ec7d9f6fda37f7ae5b5ab15db3dd4247c80128f87c35867318: Status 404 returned error can't find the container with id aaa2c55a85fa19ec7d9f6fda37f7ae5b5ab15db3dd4247c80128f87c35867318
Nov 02 08:06:24.215479 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:24.215279    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-p2f6f" podStartSLOduration=2.87626502 podStartE2EDuration="5.215259919s" totalImagesPullingTime="2.338994899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:06:24.214086779 +0000 UTC m=+45.850816115" watchObservedRunningTime="2026-11-02 08:06:24.215259919 +0000 UTC m=+45.851989255"
Nov 02 08:06:25.106570 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:25.106536    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9b8f9" event={"ID":"cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8","Type":"ContainerStarted","Data":"544901a176df2a7822f7c724713c61fa94ac3da68529473b5ff402b926521349"}
Nov 02 08:06:25.108270 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:25.108241    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6rcb9" event={"ID":"2a263223-99a0-43f4-9e93-f9b990f7c57d","Type":"ContainerStarted","Data":"a0fe50937bc982564ec0167579594ece2d623b08c2d0b7a42de2daa4d21ed50f"}
Nov 02 08:06:25.110174 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:25.110149    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sz4kk" event={"ID":"8b58f599-6735-4461-8657-ef5abab78403","Type":"ContainerStarted","Data":"c16b505747fce0e1d1d9faf41a7dea9435f6b7407cdf9dbc7afc102b588690c3"}
Nov 02 08:06:25.110256 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:25.110204    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sz4kk" event={"ID":"8b58f599-6735-4461-8657-ef5abab78403","Type":"ContainerStarted","Data":"8180b336fadd8afc5b83cd90dc236f4326fece866e2064eafcb10316a9093b79"}
Nov 02 08:06:25.111337 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:25.111313    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c" event={"ID":"437fc0dd-7f5a-4e18-8252-810aab07ff3c","Type":"ContainerStarted","Data":"aaa2c55a85fa19ec7d9f6fda37f7ae5b5ab15db3dd4247c80128f87c35867318"}
Nov 02 08:06:25.221703 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:25.221651    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9b8f9" podStartSLOduration=2.744403815 podStartE2EDuration="6.221635466s" totalImagesPullingTime="3.477231651s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 08:06:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:06:25.221239384 +0000 UTC m=+46.857968719" watchObservedRunningTime="2026-11-02 08:06:25.221635466 +0000 UTC m=+46.858364804"
Nov 02 08:06:25.334870 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:25.334820    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6rcb9" podStartSLOduration=2.823433516 podStartE2EDuration="6.3348047s" totalImagesPullingTime="3.511371184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:06:25.334191738 +0000 UTC m=+46.970921072" watchObservedRunningTime="2026-11-02 08:06:25.3348047 +0000 UTC m=+46.971534031"
Nov 02 08:06:26.003501 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.003477    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"]
Nov 02 08:06:26.007120 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.007097    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:26.062942 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.062860    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Nov 02 08:06:26.063080 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.062972    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Nov 02 08:06:26.063080 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.063032    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Nov 02 08:06:26.063080 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.063033    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Nov 02 08:06:26.063080 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.063042    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Nov 02 08:06:26.063255 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.063105    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-tkgw4\""
Nov 02 08:06:26.108824 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.108760    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d276266f-fed6-4266-89b3-c57743cc7179-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:26.108824 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.108810    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d276266f-fed6-4266-89b3-c57743cc7179-tmp\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:26.109222 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.108838    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d276266f-fed6-4266-89b3-c57743cc7179-secret-grpc-tls\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:26.109222 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.108978    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d276266f-fed6-4266-89b3-c57743cc7179-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:26.109222 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.109037    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d276266f-fed6-4266-89b3-c57743cc7179-metrics-client-ca\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:26.109222 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.109111    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d276266f-fed6-4266-89b3-c57743cc7179-secret-thanos-querier-tls\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:26.109222 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.109154    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d276266f-fed6-4266-89b3-c57743cc7179-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:26.109381 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.109237    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvz67\" (UniqueName: \"kubernetes.io/projected/d276266f-fed6-4266-89b3-c57743cc7179-kube-api-access-xvz67\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:26.109381 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.109255    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d276266f-fed6-4266-89b3-c57743cc7179-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:26.113467 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.113447    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2mp4bbie57vjb\""
Nov 02 08:06:26.114848 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.114828    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"]
Nov 02 08:06:26.119557 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.119536    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c" event={"ID":"437fc0dd-7f5a-4e18-8252-810aab07ff3c","Type":"ContainerStarted","Data":"2c603acdec2547442a0210945e9a1a8771ede3f8dd2d4e8625c052011f03c9d6"}
Nov 02 08:06:26.119659 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.119584    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c" event={"ID":"437fc0dd-7f5a-4e18-8252-810aab07ff3c","Type":"ContainerStarted","Data":"346e7528e25288f62fd212159dd7f62bbeae72ac53d4e16d5a1e136ce657355d"}
Nov 02 08:06:26.121652 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.121633    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sz4kk" event={"ID":"8b58f599-6735-4461-8657-ef5abab78403","Type":"ContainerStarted","Data":"3e4599817e4ad0a50ef6f06b4d87cfac861b00128445e92da6e05fd9c6f29994"}
Nov 02 08:06:26.123065 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.123048    2577 generic.go:356] "Generic (PLEG): container finished" podID="f8e6a0b5-f8b9-4d1b-848b-d3517004d495" containerID="e7c7d6b4cee5098d3348008fd4fe4f188fbb9eb4ca33600caf43b886e88aeb96" exitCode=0
Nov 02 08:06:26.123135 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.123119    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z4kx5" event={"ID":"f8e6a0b5-f8b9-4d1b-848b-d3517004d495","Type":"ContainerDied","Data":"e7c7d6b4cee5098d3348008fd4fe4f188fbb9eb4ca33600caf43b886e88aeb96"}
Nov 02 08:06:26.210085 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.210059    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d276266f-fed6-4266-89b3-c57743cc7179-secret-thanos-querier-tls\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:26.210211 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.210091    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d276266f-fed6-4266-89b3-c57743cc7179-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:26.210211 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.210123    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvz67\" (UniqueName: \"kubernetes.io/projected/d276266f-fed6-4266-89b3-c57743cc7179-kube-api-access-xvz67\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:26.210211 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.210148    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d276266f-fed6-4266-89b3-c57743cc7179-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:26.210356 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.210241    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d276266f-fed6-4266-89b3-c57743cc7179-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:26.210356 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.210284    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d276266f-fed6-4266-89b3-c57743cc7179-tmp\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:26.210356 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.210314    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d276266f-fed6-4266-89b3-c57743cc7179-secret-grpc-tls\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:26.210356 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.210349    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d276266f-fed6-4266-89b3-c57743cc7179-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:26.210529 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.210392    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d276266f-fed6-4266-89b3-c57743cc7179-metrics-client-ca\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:26.212394 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.212363    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d276266f-fed6-4266-89b3-c57743cc7179-tmp\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:26.213082 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.213056    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d276266f-fed6-4266-89b3-c57743cc7179-metrics-client-ca\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:26.213757 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.213697    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d276266f-fed6-4266-89b3-c57743cc7179-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:26.214098 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.214073    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d276266f-fed6-4266-89b3-c57743cc7179-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:26.214182 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.214153    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d276266f-fed6-4266-89b3-c57743cc7179-secret-thanos-querier-tls\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:26.214263 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.214239    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d276266f-fed6-4266-89b3-c57743cc7179-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:26.214311 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.214257    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d276266f-fed6-4266-89b3-c57743cc7179-secret-grpc-tls\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:26.214311 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.214239    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d276266f-fed6-4266-89b3-c57743cc7179-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:26.276901 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.276849    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvz67\" (UniqueName: \"kubernetes.io/projected/d276266f-fed6-4266-89b3-c57743cc7179-kube-api-access-xvz67\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:26.323113 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.323082    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:26.781612 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.781547    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sz4kk" podStartSLOduration=2.1343130439999998 podStartE2EDuration="3.781528155s" totalImagesPullingTime="1.647215111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:06:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:06:26.366576943 +0000 UTC m=+48.003306278" watchObservedRunningTime="2026-11-02 08:06:26.781528155 +0000 UTC m=+48.418257494"
Nov 02 08:06:26.782965 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:26.782945    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"]
Nov 02 08:06:26.816482 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:06:26.816437    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd276266f_fed6_4266_89b3_c57743cc7179.slice/crio-b9990fc470c4c5eaecdb9f9f238d04a4fbaf12c51705bb3594d8f19f3ea9592e WatchSource:0}: Error finding container b9990fc470c4c5eaecdb9f9f238d04a4fbaf12c51705bb3594d8f19f3ea9592e: Status 404 returned error can't find the container with id b9990fc470c4c5eaecdb9f9f238d04a4fbaf12c51705bb3594d8f19f3ea9592e
Nov 02 08:06:27.127943 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:27.127829    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z4kx5" event={"ID":"f8e6a0b5-f8b9-4d1b-848b-d3517004d495","Type":"ContainerStarted","Data":"1b2f58bfad3006faed7be97e1d8eef61f1dad2c93ded5fcec380cecb6f5b3d8e"}
Nov 02 08:06:27.127943 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:27.127915    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z4kx5" event={"ID":"f8e6a0b5-f8b9-4d1b-848b-d3517004d495","Type":"ContainerStarted","Data":"3fca001978a2c43ed2e3d7dbf8a9ae6982627317de0dbf7285e0a563369a1751"}
Nov 02 08:06:27.129940 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:27.129908    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c" event={"ID":"437fc0dd-7f5a-4e18-8252-810aab07ff3c","Type":"ContainerStarted","Data":"c358510792303ebde5c9aa39b908b2801bc04b23876beeb62005edf79f433c5c"}
Nov 02 08:06:27.131024 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:27.131001    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn" event={"ID":"d276266f-fed6-4266-89b3-c57743cc7179","Type":"ContainerStarted","Data":"b9990fc470c4c5eaecdb9f9f238d04a4fbaf12c51705bb3594d8f19f3ea9592e"}
Nov 02 08:06:27.248026 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:27.247976    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-z4kx5" podStartSLOduration=2.558152266 podStartE2EDuration="4.247957983s" totalImagesPullingTime="1.60992683s" totalInitContainerRuntime="79.878887ms" isStatefulPod=true podCreationTimestamp="2026-11-02 08:06:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:06:27.247790936 +0000 UTC m=+48.884520270" watchObservedRunningTime="2026-11-02 08:06:27.247957983 +0000 UTC m=+48.884687314"
Nov 02 08:06:27.365418 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:27.365370    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c" podStartSLOduration=2.534950746 podStartE2EDuration="4.36535117s" totalImagesPullingTime="1.830400424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:06:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:06:27.364710714 +0000 UTC m=+49.001440047" watchObservedRunningTime="2026-11-02 08:06:27.36535117 +0000 UTC m=+49.002080503"
Nov 02 08:06:28.242918 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.242865    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-tnr2r"]
Nov 02 08:06:28.245113 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.245094    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-tnr2r"
Nov 02 08:06:28.278385 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.278353    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-669ff9f66c-ch5df"]
Nov 02 08:06:28.280314 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.280297    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:28.298257 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.298228    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Nov 02 08:06:28.299204 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.299178    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-tnr2r"]
Nov 02 08:06:28.326021 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.325992    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2ed28bb0-f551-4b15-8d8e-04da752a23ec-audit-log\") pod \"metrics-server-669ff9f66c-ch5df\" (UID: \"2ed28bb0-f551-4b15-8d8e-04da752a23ec\") " pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:28.326180 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.326034    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5twnn\" (UniqueName: \"kubernetes.io/projected/2ed28bb0-f551-4b15-8d8e-04da752a23ec-kube-api-access-5twnn\") pod \"metrics-server-669ff9f66c-ch5df\" (UID: \"2ed28bb0-f551-4b15-8d8e-04da752a23ec\") " pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:28.326252 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.326209    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2ed28bb0-f551-4b15-8d8e-04da752a23ec-secret-metrics-server-client-certs\") pod \"metrics-server-669ff9f66c-ch5df\" (UID: \"2ed28bb0-f551-4b15-8d8e-04da752a23ec\") " pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:28.326308 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.326260    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h6hj\" (UniqueName: \"kubernetes.io/projected/bff203a8-2155-4ef1-9efd-b1a6d7e1eabe-kube-api-access-6h6hj\") pod \"monitoring-plugin-77f4f76594-tnr2r\" (UID: \"bff203a8-2155-4ef1-9efd-b1a6d7e1eabe\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-tnr2r"
Nov 02 08:06:28.326380 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.326363    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2ed28bb0-f551-4b15-8d8e-04da752a23ec-secret-metrics-server-tls\") pod \"metrics-server-669ff9f66c-ch5df\" (UID: \"2ed28bb0-f551-4b15-8d8e-04da752a23ec\") " pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:28.326435 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.326400    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ed28bb0-f551-4b15-8d8e-04da752a23ec-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-669ff9f66c-ch5df\" (UID: \"2ed28bb0-f551-4b15-8d8e-04da752a23ec\") " pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:28.326478 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.326431    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ed28bb0-f551-4b15-8d8e-04da752a23ec-client-ca-bundle\") pod \"metrics-server-669ff9f66c-ch5df\" (UID: \"2ed28bb0-f551-4b15-8d8e-04da752a23ec\") " pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:28.326513 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.326498    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bff203a8-2155-4ef1-9efd-b1a6d7e1eabe-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-tnr2r\" (UID: \"bff203a8-2155-4ef1-9efd-b1a6d7e1eabe\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-tnr2r"
Nov 02 08:06:28.326552 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.326542    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2ed28bb0-f551-4b15-8d8e-04da752a23ec-metrics-server-audit-profiles\") pod \"metrics-server-669ff9f66c-ch5df\" (UID: \"2ed28bb0-f551-4b15-8d8e-04da752a23ec\") " pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:28.327665 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.327646    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-sp2hs\""
Nov 02 08:06:28.333384 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.333326    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Nov 02 08:06:28.343991 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.343968    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Nov 02 08:06:28.361800 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.361773    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-669ff9f66c-ch5df"]
Nov 02 08:06:28.402180 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.402143    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cg3935crgf1l5\""
Nov 02 08:06:28.402180 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.402174    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Nov 02 08:06:28.402403 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.402268    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Nov 02 08:06:28.402403 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.402349    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-9l54h\""
Nov 02 08:06:28.426962 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.426928    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bff203a8-2155-4ef1-9efd-b1a6d7e1eabe-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-tnr2r\" (UID: \"bff203a8-2155-4ef1-9efd-b1a6d7e1eabe\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-tnr2r"
Nov 02 08:06:28.426962 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.426969    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2ed28bb0-f551-4b15-8d8e-04da752a23ec-metrics-server-audit-profiles\") pod \"metrics-server-669ff9f66c-ch5df\" (UID: \"2ed28bb0-f551-4b15-8d8e-04da752a23ec\") " pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:28.427217 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:28.427107    2577 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Nov 02 08:06:28.427217 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.427167    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2ed28bb0-f551-4b15-8d8e-04da752a23ec-audit-log\") pod \"metrics-server-669ff9f66c-ch5df\" (UID: \"2ed28bb0-f551-4b15-8d8e-04da752a23ec\") " pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:28.427217 ip-10-0-135-235 kubenswrapper[2577]: E1102 08:06:28.427176    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bff203a8-2155-4ef1-9efd-b1a6d7e1eabe-monitoring-plugin-cert podName:bff203a8-2155-4ef1-9efd-b1a6d7e1eabe nodeName:}" failed. No retries permitted until 2026-11-02 08:06:28.927156265 +0000 UTC m=+50.563885594 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/bff203a8-2155-4ef1-9efd-b1a6d7e1eabe-monitoring-plugin-cert") pod "monitoring-plugin-77f4f76594-tnr2r" (UID: "bff203a8-2155-4ef1-9efd-b1a6d7e1eabe") : secret "monitoring-plugin-cert" not found
Nov 02 08:06:28.427217 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.427206    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5twnn\" (UniqueName: \"kubernetes.io/projected/2ed28bb0-f551-4b15-8d8e-04da752a23ec-kube-api-access-5twnn\") pod \"metrics-server-669ff9f66c-ch5df\" (UID: \"2ed28bb0-f551-4b15-8d8e-04da752a23ec\") " pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:28.427445 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.427288    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2ed28bb0-f551-4b15-8d8e-04da752a23ec-secret-metrics-server-client-certs\") pod \"metrics-server-669ff9f66c-ch5df\" (UID: \"2ed28bb0-f551-4b15-8d8e-04da752a23ec\") " pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:28.427445 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.427325    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h6hj\" (UniqueName: \"kubernetes.io/projected/bff203a8-2155-4ef1-9efd-b1a6d7e1eabe-kube-api-access-6h6hj\") pod \"monitoring-plugin-77f4f76594-tnr2r\" (UID: \"bff203a8-2155-4ef1-9efd-b1a6d7e1eabe\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-tnr2r"
Nov 02 08:06:28.427445 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.427363    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2ed28bb0-f551-4b15-8d8e-04da752a23ec-secret-metrics-server-tls\") pod \"metrics-server-669ff9f66c-ch5df\" (UID: \"2ed28bb0-f551-4b15-8d8e-04da752a23ec\") " pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:28.427445 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.427391    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ed28bb0-f551-4b15-8d8e-04da752a23ec-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-669ff9f66c-ch5df\" (UID: \"2ed28bb0-f551-4b15-8d8e-04da752a23ec\") " pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:28.427445 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.427413    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ed28bb0-f551-4b15-8d8e-04da752a23ec-client-ca-bundle\") pod \"metrics-server-669ff9f66c-ch5df\" (UID: \"2ed28bb0-f551-4b15-8d8e-04da752a23ec\") " pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:28.427714 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.427692    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2ed28bb0-f551-4b15-8d8e-04da752a23ec-audit-log\") pod \"metrics-server-669ff9f66c-ch5df\" (UID: \"2ed28bb0-f551-4b15-8d8e-04da752a23ec\") " pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:28.428175 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.428149    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2ed28bb0-f551-4b15-8d8e-04da752a23ec-metrics-server-audit-profiles\") pod \"metrics-server-669ff9f66c-ch5df\" (UID: \"2ed28bb0-f551-4b15-8d8e-04da752a23ec\") " pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:28.428411 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.428394    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ed28bb0-f551-4b15-8d8e-04da752a23ec-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-669ff9f66c-ch5df\" (UID: \"2ed28bb0-f551-4b15-8d8e-04da752a23ec\") " pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:28.430067 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.430034    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ed28bb0-f551-4b15-8d8e-04da752a23ec-client-ca-bundle\") pod \"metrics-server-669ff9f66c-ch5df\" (UID: \"2ed28bb0-f551-4b15-8d8e-04da752a23ec\") " pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:28.430177 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.430128    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2ed28bb0-f551-4b15-8d8e-04da752a23ec-secret-metrics-server-client-certs\") pod \"metrics-server-669ff9f66c-ch5df\" (UID: \"2ed28bb0-f551-4b15-8d8e-04da752a23ec\") " pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:28.430233 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.430212    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2ed28bb0-f551-4b15-8d8e-04da752a23ec-secret-metrics-server-tls\") pod \"metrics-server-669ff9f66c-ch5df\" (UID: \"2ed28bb0-f551-4b15-8d8e-04da752a23ec\") " pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:28.485030 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.485001    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5twnn\" (UniqueName: \"kubernetes.io/projected/2ed28bb0-f551-4b15-8d8e-04da752a23ec-kube-api-access-5twnn\") pod \"metrics-server-669ff9f66c-ch5df\" (UID: \"2ed28bb0-f551-4b15-8d8e-04da752a23ec\") " pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:28.485173 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.485091    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h6hj\" (UniqueName: \"kubernetes.io/projected/bff203a8-2155-4ef1-9efd-b1a6d7e1eabe-kube-api-access-6h6hj\") pod \"monitoring-plugin-77f4f76594-tnr2r\" (UID: \"bff203a8-2155-4ef1-9efd-b1a6d7e1eabe\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-tnr2r"
Nov 02 08:06:28.592936 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.592854    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:28.932847 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.932766    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bff203a8-2155-4ef1-9efd-b1a6d7e1eabe-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-tnr2r\" (UID: \"bff203a8-2155-4ef1-9efd-b1a6d7e1eabe\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-tnr2r"
Nov 02 08:06:28.935388 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:28.935363    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bff203a8-2155-4ef1-9efd-b1a6d7e1eabe-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-tnr2r\" (UID: \"bff203a8-2155-4ef1-9efd-b1a6d7e1eabe\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-tnr2r"
Nov 02 08:06:29.007008 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:06:29.006973    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ed28bb0_f551_4b15_8d8e_04da752a23ec.slice/crio-7f253d41761290dc6a934bc44aeabf58bd435de2c9171d88ada2371b769c7c2b WatchSource:0}: Error finding container 7f253d41761290dc6a934bc44aeabf58bd435de2c9171d88ada2371b769c7c2b: Status 404 returned error can't find the container with id 7f253d41761290dc6a934bc44aeabf58bd435de2c9171d88ada2371b769c7c2b
Nov 02 08:06:29.007666 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.007646    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-669ff9f66c-ch5df"]
Nov 02 08:06:29.072009 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.071973    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"]
Nov 02 08:06:29.075370 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.075348    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:29.133425 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.133391    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Nov 02 08:06:29.134224 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.134193    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1aff1f9f-94a9-486f-a807-76b15fb88cfa-telemeter-trusted-ca-bundle\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:29.134339 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.134257    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1aff1f9f-94a9-486f-a807-76b15fb88cfa-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:29.134392 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.134347    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1aff1f9f-94a9-486f-a807-76b15fb88cfa-secret-telemeter-client\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:29.134478 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.134458    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1aff1f9f-94a9-486f-a807-76b15fb88cfa-metrics-client-ca\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:29.134537 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.134508    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1aff1f9f-94a9-486f-a807-76b15fb88cfa-serving-certs-ca-bundle\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:29.134605 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.134589    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94rml\" (UniqueName: \"kubernetes.io/projected/1aff1f9f-94a9-486f-a807-76b15fb88cfa-kube-api-access-94rml\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:29.134698 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.134683    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1aff1f9f-94a9-486f-a807-76b15fb88cfa-telemeter-client-tls\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:29.134759 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.134711    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1aff1f9f-94a9-486f-a807-76b15fb88cfa-federate-client-tls\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:29.142662 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.142635    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df" event={"ID":"2ed28bb0-f551-4b15-8d8e-04da752a23ec","Type":"ContainerStarted","Data":"7f253d41761290dc6a934bc44aeabf58bd435de2c9171d88ada2371b769c7c2b"}
Nov 02 08:06:29.157947 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.157917    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-tnr2r"
Nov 02 08:06:29.235051 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.235020    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\""
Nov 02 08:06:29.235181 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.235159    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Nov 02 08:06:29.235289 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.235276    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-9xpw6\""
Nov 02 08:06:29.235362 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.235350    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Nov 02 08:06:29.235458 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.235437    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Nov 02 08:06:29.235559 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.235547    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Nov 02 08:06:29.238794 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.238769    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"]
Nov 02 08:06:29.239184 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.239164    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1aff1f9f-94a9-486f-a807-76b15fb88cfa-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:29.239287 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.239215    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1aff1f9f-94a9-486f-a807-76b15fb88cfa-secret-telemeter-client\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:29.239287 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.239248    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1aff1f9f-94a9-486f-a807-76b15fb88cfa-metrics-client-ca\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:29.239528 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.239499    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1aff1f9f-94a9-486f-a807-76b15fb88cfa-serving-certs-ca-bundle\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:29.239632 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.239566    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94rml\" (UniqueName: \"kubernetes.io/projected/1aff1f9f-94a9-486f-a807-76b15fb88cfa-kube-api-access-94rml\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:29.239632 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.239618    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1aff1f9f-94a9-486f-a807-76b15fb88cfa-telemeter-client-tls\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:29.239774 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.239645    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1aff1f9f-94a9-486f-a807-76b15fb88cfa-federate-client-tls\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:29.239774 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.239696    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1aff1f9f-94a9-486f-a807-76b15fb88cfa-telemeter-trusted-ca-bundle\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:29.241033 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.241010    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1aff1f9f-94a9-486f-a807-76b15fb88cfa-serving-certs-ca-bundle\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:29.241141 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.241010    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1aff1f9f-94a9-486f-a807-76b15fb88cfa-metrics-client-ca\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:29.241872 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.241849    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1aff1f9f-94a9-486f-a807-76b15fb88cfa-telemeter-trusted-ca-bundle\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:29.242073 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.242055    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1aff1f9f-94a9-486f-a807-76b15fb88cfa-secret-telemeter-client\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:29.242214 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.242193    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1aff1f9f-94a9-486f-a807-76b15fb88cfa-telemeter-client-tls\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:29.242756 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.242731    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1aff1f9f-94a9-486f-a807-76b15fb88cfa-federate-client-tls\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:29.243815 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.243769    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1aff1f9f-94a9-486f-a807-76b15fb88cfa-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:29.299165 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.299125    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94rml\" (UniqueName: \"kubernetes.io/projected/1aff1f9f-94a9-486f-a807-76b15fb88cfa-kube-api-access-94rml\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:29.389843 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.389806    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:29.527328 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.527295    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-tnr2r"]
Nov 02 08:06:29.803068 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:06:29.803036    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aff1f9f_94a9_486f_a807_76b15fb88cfa.slice/crio-503d3e0b79afafd0016e62422fd47acaa47a3af87cfade3ce2584debe4f580b3 WatchSource:0}: Error finding container 503d3e0b79afafd0016e62422fd47acaa47a3af87cfade3ce2584debe4f580b3: Status 404 returned error can't find the container with id 503d3e0b79afafd0016e62422fd47acaa47a3af87cfade3ce2584debe4f580b3
Nov 02 08:06:29.804613 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:29.804587    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"]
Nov 02 08:06:30.147614 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:30.147539    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5" event={"ID":"1aff1f9f-94a9-486f-a807-76b15fb88cfa","Type":"ContainerStarted","Data":"503d3e0b79afafd0016e62422fd47acaa47a3af87cfade3ce2584debe4f580b3"}
Nov 02 08:06:30.148733 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:30.148704    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-tnr2r" event={"ID":"bff203a8-2155-4ef1-9efd-b1a6d7e1eabe","Type":"ContainerStarted","Data":"afcf5184d93f78966481a88ea7691e2090b6a8f9f0ab7a4ca078527971c2e337"}
Nov 02 08:06:30.150761 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:30.150739    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn" event={"ID":"d276266f-fed6-4266-89b3-c57743cc7179","Type":"ContainerStarted","Data":"6cb176352da7e8aabb4c4e976c4a7bba7f8b37108a71b716f108d66cbe8d4cbf"}
Nov 02 08:06:30.150839 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:30.150797    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn" event={"ID":"d276266f-fed6-4266-89b3-c57743cc7179","Type":"ContainerStarted","Data":"e45958117f164460f76b6e681f5a2f612940f5afd16493c4edad198f3c1596f7"}
Nov 02 08:06:30.150839 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:30.150828    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn" event={"ID":"d276266f-fed6-4266-89b3-c57743cc7179","Type":"ContainerStarted","Data":"5469039c402fb23ae7852064915b33ae4faa8df797218db62b1d83c08e20b7be"}
Nov 02 08:06:31.163688 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:31.163626    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn" event={"ID":"d276266f-fed6-4266-89b3-c57743cc7179","Type":"ContainerStarted","Data":"2a034e8d7c5b27b771c3be6f30ad7f1e87d64a791b4396b89126f41e485fbb8d"}
Nov 02 08:06:32.168790 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:32.168746    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df" event={"ID":"2ed28bb0-f551-4b15-8d8e-04da752a23ec","Type":"ContainerStarted","Data":"582823209f4111a86f7f4eb66acbcf0eab84a2622b101655aa6fc1c7b899b5de"}
Nov 02 08:06:32.170794 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:32.170764    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-tnr2r" event={"ID":"bff203a8-2155-4ef1-9efd-b1a6d7e1eabe","Type":"ContainerStarted","Data":"169642753b1a2ffbfaa6b65e7e40b08ec89b06893f6cd4884f572bae848b8ac7"}
Nov 02 08:06:32.170920 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:32.170819    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-tnr2r"
Nov 02 08:06:32.174161 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:32.174139    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn" event={"ID":"d276266f-fed6-4266-89b3-c57743cc7179","Type":"ContainerStarted","Data":"2e538c769fd7e094d72f55bbcc73c7e589cdb4ac14167d29e9d59dab76e3d39f"}
Nov 02 08:06:32.174270 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:32.174202    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn" event={"ID":"d276266f-fed6-4266-89b3-c57743cc7179","Type":"ContainerStarted","Data":"121c25676bdb19f202cdaaba56df1e4591ab2cbe7c8f840fde755885b415189f"}
Nov 02 08:06:32.174321 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:32.174295    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:32.176788 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:32.176769    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-tnr2r"
Nov 02 08:06:32.287196 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:32.287146    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df" podStartSLOduration=2.004900897 podStartE2EDuration="4.287132554s" totalImagesPullingTime="2.282231657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:06:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:06:32.286603949 +0000 UTC m=+53.923333280" watchObservedRunningTime="2026-11-02 08:06:32.287132554 +0000 UTC m=+53.923861887"
Nov 02 08:06:32.412008 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:32.411958    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn" podStartSLOduration=3.335408397 podStartE2EDuration="7.411943344s" totalImagesPullingTime="4.076534947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:06:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:06:32.410435785 +0000 UTC m=+54.047165118" watchObservedRunningTime="2026-11-02 08:06:32.411943344 +0000 UTC m=+54.048672698"
Nov 02 08:06:32.527191 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:32.527141    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-77f4f76594-tnr2r" podStartSLOduration=2.449165503 podStartE2EDuration="4.527128626s" totalImagesPullingTime="2.077963123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:06:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:06:32.526602411 +0000 UTC m=+54.163331744" watchObservedRunningTime="2026-11-02 08:06:32.527128626 +0000 UTC m=+54.163857959"
Nov 02 08:06:33.179562 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:33.179524    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5" event={"ID":"1aff1f9f-94a9-486f-a807-76b15fb88cfa","Type":"ContainerStarted","Data":"be1a87f81ed4d1bdb6ff718974f2f53215b4a07e6b5b0cdf8b9d510eacb5628a"}
Nov 02 08:06:34.056274 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:34.056194    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:34.120798 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:34.120769    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-p2f6f"
Nov 02 08:06:34.185821 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:34.185788    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5" event={"ID":"1aff1f9f-94a9-486f-a807-76b15fb88cfa","Type":"ContainerStarted","Data":"c073bf158385d85b4887a35636d0bfdc1d19e9f7a1aebc417c7b5629213e8243"}
Nov 02 08:06:34.186226 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:34.185854    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5" event={"ID":"1aff1f9f-94a9-486f-a807-76b15fb88cfa","Type":"ContainerStarted","Data":"f272f2c5c39dd54331c9f24d32feb9861ff32f60d33cba0f2a6a59de996e698d"}
Nov 02 08:06:34.455820 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:34.455722    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5" podStartSLOduration=1.5332541800000001 podStartE2EDuration="5.455708525s" totalImagesPullingTime="3.922454345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:06:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:06:34.454981307 +0000 UTC m=+56.091710640" watchObservedRunningTime="2026-11-02 08:06:34.455708525 +0000 UTC m=+56.092437859"
Nov 02 08:06:38.185958 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:38.185931    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:43.971604 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:43.971561    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff05c739-4a53-4cfe-942f-df41f812d742-metrics-certs\") pod \"network-metrics-daemon-rh5vc\" (UID: \"ff05c739-4a53-4cfe-942f-df41f812d742\") " pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:06:43.972102 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:43.971636    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a77497b-33c1-4ac2-bfba-58b6edcf871e-original-pull-secret\") pod \"global-pull-secret-syncer-w2swh\" (UID: \"9a77497b-33c1-4ac2-bfba-58b6edcf871e\") " pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:06:44.024010 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:44.023977    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 02 08:06:44.034260 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:44.034235    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff05c739-4a53-4cfe-942f-df41f812d742-metrics-certs\") pod \"network-metrics-daemon-rh5vc\" (UID: \"ff05c739-4a53-4cfe-942f-df41f812d742\") " pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:06:44.072821 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:44.072784    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpq4r\" (UniqueName: \"kubernetes.io/projected/c03021d1-d458-46a8-af56-bfba0cc4b4b4-kube-api-access-rpq4r\") pod \"network-check-target-5qkvj\" (UID: \"c03021d1-d458-46a8-af56-bfba0cc4b4b4\") " pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:06:44.074330 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:44.074313    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 02 08:06:44.084394 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:44.084367    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a77497b-33c1-4ac2-bfba-58b6edcf871e-original-pull-secret\") pod \"global-pull-secret-syncer-w2swh\" (UID: \"9a77497b-33c1-4ac2-bfba-58b6edcf871e\") " pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:06:44.124599 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:44.124576    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 02 08:06:44.185321 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:44.185294    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 02 08:06:44.196589 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:44.196565    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpq4r\" (UniqueName: \"kubernetes.io/projected/c03021d1-d458-46a8-af56-bfba0cc4b4b4-kube-api-access-rpq4r\") pod \"network-check-target-5qkvj\" (UID: \"c03021d1-d458-46a8-af56-bfba0cc4b4b4\") " pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:06:44.252321 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:44.252263    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-ghx8m\""
Nov 02 08:06:44.261374 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:44.261351    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:06:44.304275 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:44.304244    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-4v7vr\""
Nov 02 08:06:44.313100 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:44.313066    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:06:44.321937 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:44.321694    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j6nct\""
Nov 02 08:06:44.327250 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:44.327230    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:06:44.622321 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:06:44.622280    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc03021d1_d458_46a8_af56_bfba0cc4b4b4.slice/crio-2b7ecfd3deee44f05899c495fab004c5ef09a329e99052207be967a096505354 WatchSource:0}: Error finding container 2b7ecfd3deee44f05899c495fab004c5ef09a329e99052207be967a096505354: Status 404 returned error can't find the container with id 2b7ecfd3deee44f05899c495fab004c5ef09a329e99052207be967a096505354
Nov 02 08:06:44.623287 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:44.623262    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5qkvj"]
Nov 02 08:06:44.725127 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:06:44.725092    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a77497b_33c1_4ac2_bfba_58b6edcf871e.slice/crio-8f3484d327ea71e9e63985577c9d822e7dcb62781278afdff46e58a3544a396f WatchSource:0}: Error finding container 8f3484d327ea71e9e63985577c9d822e7dcb62781278afdff46e58a3544a396f: Status 404 returned error can't find the container with id 8f3484d327ea71e9e63985577c9d822e7dcb62781278afdff46e58a3544a396f
Nov 02 08:06:44.726155 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:44.726115    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w2swh"]
Nov 02 08:06:44.728067 ip-10-0-135-235 kubenswrapper[2577]: W1102 08:06:44.728045    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff05c739_4a53_4cfe_942f_df41f812d742.slice/crio-3569965a0eab278d33dbd724bd7339daf8cd2a3a85728be8a5d302ff0a190d12 WatchSource:0}: Error finding container 3569965a0eab278d33dbd724bd7339daf8cd2a3a85728be8a5d302ff0a190d12: Status 404 returned error can't find the container with id 3569965a0eab278d33dbd724bd7339daf8cd2a3a85728be8a5d302ff0a190d12
Nov 02 08:06:44.729166 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:44.729147    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rh5vc"]
Nov 02 08:06:45.223980 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:45.223943    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w2swh" event={"ID":"9a77497b-33c1-4ac2-bfba-58b6edcf871e","Type":"ContainerStarted","Data":"8f3484d327ea71e9e63985577c9d822e7dcb62781278afdff46e58a3544a396f"}
Nov 02 08:06:45.225103 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:45.225067    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5qkvj" event={"ID":"c03021d1-d458-46a8-af56-bfba0cc4b4b4","Type":"ContainerStarted","Data":"2b7ecfd3deee44f05899c495fab004c5ef09a329e99052207be967a096505354"}
Nov 02 08:06:45.226212 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:45.226191    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rh5vc" event={"ID":"ff05c739-4a53-4cfe-942f-df41f812d742","Type":"ContainerStarted","Data":"3569965a0eab278d33dbd724bd7339daf8cd2a3a85728be8a5d302ff0a190d12"}
Nov 02 08:06:47.238477 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:47.238441    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rh5vc" event={"ID":"ff05c739-4a53-4cfe-942f-df41f812d742","Type":"ContainerStarted","Data":"eeb1b74639cd45a9f9eb03493ea041fd396a053d98ef9fc4104c970426bb37dc"}
Nov 02 08:06:47.238955 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:47.238504    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rh5vc" event={"ID":"ff05c739-4a53-4cfe-942f-df41f812d742","Type":"ContainerStarted","Data":"d7f28986a927eca7c9495572040ed96dc98a9b2f80b67be4515c05d45912b5e0"}
Nov 02 08:06:47.356819 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:47.356685    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rh5vc" podStartSLOduration=66.692608276 podStartE2EDuration="1m8.356656751s" totalImagesPullingTime="1.664048475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:06:47.354437071 +0000 UTC m=+68.991166406" watchObservedRunningTime="2026-11-02 08:06:47.356656751 +0000 UTC m=+68.993386086"
Nov 02 08:06:48.593107 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:48.593074    2577 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:48.593433 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:48.593143    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:49.248582 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:49.248537    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5qkvj" event={"ID":"c03021d1-d458-46a8-af56-bfba0cc4b4b4","Type":"ContainerStarted","Data":"db18b3ce8eb22790616e851049aef7c63be3d83b50b2e4c4cfcd5dd10ea4bfa5"}
Nov 02 08:06:49.248774 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:49.248688    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:06:49.367620 ip-10-0-135-235 kubenswrapper[2577]: I1102 08:06:49.364204    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5qkvj" podStartSLOduration=66.474807089 podStartE2EDuration="1m10.364186568s" totalImagesPullingTime="3.889379479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:06:49.362267968 +0000 UTC m=+70.998997302" watchObservedRunningTime="2026-11-02 08:06:49.364186568 +0000 UTC m=+71.000915903"
Nov 02 08:06:50.183992 ip-10-0-135-235 systemd[1]: Stopping Kubernetes Kubelet...
Nov 02 08:06:50.191581 ip-10-0-135-235 systemd[1]: kubelet.service: Deactivated successfully.
Nov 02 08:06:50.191738 ip-10-0-135-235 systemd[1]: Stopped Kubernetes Kubelet.
Nov 02 08:06:50.191928 ip-10-0-135-235 systemd[1]: kubelet.service: Consumed 4.050s CPU time.
Nov 02 08:06:50.211460 ip-10-0-135-235 systemd[1]: Starting Kubernetes Kubelet...
Nov 02 08:06:50.271310 ip-10-0-135-235 kubenswrapper[6210]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 02 08:06:50.271310 ip-10-0-135-235 kubenswrapper[6210]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 02 08:06:50.271310 ip-10-0-135-235 kubenswrapper[6210]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 02 08:06:50.271310 ip-10-0-135-235 kubenswrapper[6210]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 02 08:06:50.273486 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273410    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 08:06:50.273486 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273488    6210 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 08:06:50.273562 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273492    6210 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 08:06:50.273562 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273496    6210 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 08:06:50.273562 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273499    6210 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 08:06:50.273562 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273502    6210 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 08:06:50.273562 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273505    6210 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 08:06:50.273562 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273508    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 08:06:50.273562 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273510    6210 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 08:06:50.273562 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273513    6210 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 08:06:50.273562 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273516    6210 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 08:06:50.273562 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273519    6210 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 08:06:50.273562 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273521    6210 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 08:06:50.273562 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273524    6210 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 08:06:50.273562 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273527    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 08:06:50.273562 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273530    6210 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 08:06:50.273562 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273532    6210 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 08:06:50.273562 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273535    6210 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 08:06:50.273562 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273538    6210 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 08:06:50.273562 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273540    6210 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 08:06:50.273562 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273545    6210 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 08:06:50.274028 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273549    6210 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 08:06:50.274028 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273552    6210 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 08:06:50.274028 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273555    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 08:06:50.274028 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273558    6210 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 08:06:50.274028 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273561    6210 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 08:06:50.274028 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273563    6210 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 08:06:50.274028 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273566    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 08:06:50.274028 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273569    6210 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 08:06:50.274028 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273579    6210 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 08:06:50.274028 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273582    6210 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 08:06:50.274028 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273585    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 08:06:50.274028 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273587    6210 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 08:06:50.274028 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273590    6210 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 08:06:50.274028 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273592    6210 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 08:06:50.274028 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273595    6210 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 08:06:50.274028 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273597    6210 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 08:06:50.274028 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273600    6210 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 08:06:50.274028 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273602    6210 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 08:06:50.274028 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273605    6210 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 08:06:50.274028 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273608    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 08:06:50.274505 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273610    6210 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 08:06:50.274505 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273613    6210 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 08:06:50.274505 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273615    6210 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 08:06:50.274505 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273619    6210 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 08:06:50.274505 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273621    6210 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 08:06:50.274505 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273625    6210 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 08:06:50.274505 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273629    6210 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 08:06:50.274505 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273632    6210 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 08:06:50.274505 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273635    6210 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 08:06:50.274505 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273638    6210 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 08:06:50.274505 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273640    6210 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 08:06:50.274505 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273643    6210 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 08:06:50.274505 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273645    6210 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 08:06:50.274505 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273648    6210 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 08:06:50.274505 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273651    6210 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 08:06:50.274505 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273654    6210 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 08:06:50.274505 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273656    6210 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 08:06:50.274505 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273659    6210 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 08:06:50.274505 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273661    6210 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 08:06:50.274999 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273663    6210 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 08:06:50.274999 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273666    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 08:06:50.274999 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273669    6210 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 08:06:50.274999 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273672    6210 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 08:06:50.274999 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273674    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 08:06:50.274999 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273677    6210 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 08:06:50.274999 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273680    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 08:06:50.274999 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273682    6210 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 08:06:50.274999 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273685    6210 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 08:06:50.274999 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273687    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 08:06:50.274999 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273690    6210 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 08:06:50.274999 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273693    6210 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 08:06:50.274999 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273695    6210 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 08:06:50.274999 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273698    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 08:06:50.274999 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273700    6210 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 08:06:50.274999 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273703    6210 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 08:06:50.274999 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273706    6210 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 08:06:50.274999 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273708    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 08:06:50.274999 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273711    6210 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 08:06:50.274999 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273713    6210 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 08:06:50.275476 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273716    6210 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 08:06:50.275476 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273725    6210 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 08:06:50.275476 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273727    6210 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 08:06:50.275476 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273730    6210 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 08:06:50.275476 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273733    6210 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 08:06:50.275476 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273735    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 08:06:50.275476 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273738    6210 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 08:06:50.275476 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273741    6210 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 08:06:50.275476 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273743    6210 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 08:06:50.275476 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273746    6210 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 08:06:50.275476 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273749    6210 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 08:06:50.275476 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273751    6210 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 08:06:50.275476 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273754    6210 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 08:06:50.275476 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273756    6210 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 08:06:50.275476 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273759    6210 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 08:06:50.275476 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273761    6210 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 08:06:50.275476 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273764    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 08:06:50.275476 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273767    6210 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 08:06:50.275476 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273769    6210 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 08:06:50.275941 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273772    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 08:06:50.275941 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273776    6210 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 08:06:50.275941 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273779    6210 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 08:06:50.275941 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273782    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 08:06:50.275941 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273785    6210 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 08:06:50.275941 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273787    6210 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 08:06:50.275941 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.273790    6210 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 08:06:50.275941 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274577    6210 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 08:06:50.275941 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274585    6210 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 08:06:50.275941 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274589    6210 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 08:06:50.275941 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274592    6210 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 08:06:50.275941 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274594    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 08:06:50.275941 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274599    6210 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 08:06:50.275941 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274603    6210 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 08:06:50.275941 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274606    6210 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 08:06:50.275941 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274610    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 08:06:50.275941 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274613    6210 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 08:06:50.275941 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274616    6210 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 08:06:50.275941 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274619    6210 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 08:06:50.276397 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274623    6210 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 08:06:50.276397 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274626    6210 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 08:06:50.276397 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274628    6210 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 08:06:50.276397 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274631    6210 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 08:06:50.276397 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274633    6210 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 08:06:50.276397 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274636    6210 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 08:06:50.276397 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274639    6210 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 08:06:50.276397 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274641    6210 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 08:06:50.276397 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274644    6210 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 08:06:50.276397 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274647    6210 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 08:06:50.276397 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274650    6210 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 08:06:50.276397 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274652    6210 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 08:06:50.276397 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274655    6210 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 08:06:50.276397 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274658    6210 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 08:06:50.276397 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274661    6210 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 08:06:50.276397 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274663    6210 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 08:06:50.276397 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274666    6210 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 08:06:50.276397 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274668    6210 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 08:06:50.276397 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274671    6210 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 08:06:50.276397 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274673    6210 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 08:06:50.276896 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274676    6210 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 08:06:50.276896 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274679    6210 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 08:06:50.276896 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274681    6210 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 08:06:50.276896 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274684    6210 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 08:06:50.276896 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274686    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 08:06:50.276896 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274689    6210 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 08:06:50.276896 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274692    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 08:06:50.276896 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274694    6210 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 08:06:50.276896 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274697    6210 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 08:06:50.276896 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274700    6210 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 08:06:50.276896 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274704    6210 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 08:06:50.276896 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274706    6210 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 08:06:50.276896 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274709    6210 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 08:06:50.276896 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274711    6210 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 08:06:50.276896 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274714    6210 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 08:06:50.276896 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274716    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 08:06:50.276896 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274719    6210 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 08:06:50.276896 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274722    6210 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 08:06:50.276896 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274724    6210 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 08:06:50.276896 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274726    6210 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 08:06:50.277370 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274729    6210 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 08:06:50.277370 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274731    6210 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 08:06:50.277370 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274734    6210 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 08:06:50.277370 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274736    6210 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 08:06:50.277370 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274739    6210 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 08:06:50.277370 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274742    6210 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 08:06:50.277370 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274744    6210 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 08:06:50.277370 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274747    6210 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 08:06:50.277370 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274749    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 08:06:50.277370 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274752    6210 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 08:06:50.277370 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274754    6210 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 08:06:50.277370 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274757    6210 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 08:06:50.277370 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274759    6210 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 08:06:50.277370 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274762    6210 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 08:06:50.277370 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274764    6210 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 08:06:50.277370 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274767    6210 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 08:06:50.277370 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274769    6210 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 08:06:50.277370 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274772    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 08:06:50.277370 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274775    6210 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 08:06:50.277805 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274777    6210 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 08:06:50.277805 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274780    6210 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 08:06:50.277805 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274782    6210 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 08:06:50.277805 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274786    6210 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 08:06:50.277805 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274789    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 08:06:50.277805 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274792    6210 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 08:06:50.277805 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274794    6210 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 08:06:50.277805 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274797    6210 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 08:06:50.277805 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274799    6210 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 08:06:50.277805 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274802    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 08:06:50.277805 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274804    6210 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 08:06:50.277805 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274807    6210 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 08:06:50.277805 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274809    6210 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 08:06:50.277805 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274814    6210 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 08:06:50.277805 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274817    6210 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 08:06:50.277805 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274820    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 08:06:50.277805 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274823    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 08:06:50.277805 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274826    6210 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 08:06:50.277805 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274829    6210 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 08:06:50.278281 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274831    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 08:06:50.278281 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274833    6210 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 08:06:50.278281 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274836    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 08:06:50.278281 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274839    6210 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 08:06:50.278281 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274841    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 08:06:50.278281 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274844    6210 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 08:06:50.278281 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274846    6210 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 08:06:50.278281 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274849    6210 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 08:06:50.278281 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274851    6210 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 08:06:50.278281 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274854    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 08:06:50.278281 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274857    6210 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 08:06:50.278281 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274860    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 08:06:50.278281 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274862    6210 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 08:06:50.278281 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274865    6210 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 08:06:50.278281 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274868    6210 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 08:06:50.278281 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.274870    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 08:06:50.278281 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275371    6210 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 08:06:50.278281 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275376    6210 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 08:06:50.278281 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275379    6210 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 08:06:50.278281 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275381    6210 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 08:06:50.278744 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275384    6210 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 08:06:50.278744 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275387    6210 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 08:06:50.278744 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275390    6210 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 08:06:50.278744 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275392    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 08:06:50.278744 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275395    6210 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 08:06:50.278744 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275398    6210 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 08:06:50.278744 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275400    6210 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 08:06:50.278744 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275403    6210 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 08:06:50.278744 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275406    6210 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 08:06:50.278744 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275408    6210 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 08:06:50.278744 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275411    6210 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 08:06:50.278744 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275414    6210 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 08:06:50.278744 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275417    6210 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 08:06:50.278744 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275420    6210 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 08:06:50.278744 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275422    6210 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 08:06:50.278744 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275425    6210 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 08:06:50.278744 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275429    6210 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 08:06:50.278744 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275433    6210 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 08:06:50.278744 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275436    6210 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 08:06:50.279249 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275439    6210 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 08:06:50.279249 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275441    6210 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 08:06:50.279249 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275444    6210 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 08:06:50.279249 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275446    6210 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 08:06:50.279249 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275449    6210 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 08:06:50.279249 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275451    6210 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 08:06:50.279249 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275454    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 08:06:50.279249 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275456    6210 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 08:06:50.279249 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275459    6210 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 08:06:50.279249 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275462    6210 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 08:06:50.279249 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275465    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 08:06:50.279249 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275468    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 08:06:50.279249 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275471    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 08:06:50.279249 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275473    6210 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 08:06:50.279249 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275476    6210 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 08:06:50.279249 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275479    6210 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 08:06:50.279249 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275481    6210 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 08:06:50.279249 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275484    6210 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 08:06:50.279249 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275487    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 08:06:50.279736 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275489    6210 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 08:06:50.279736 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275492    6210 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 08:06:50.279736 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275495    6210 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 08:06:50.279736 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275497    6210 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 08:06:50.279736 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275500    6210 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 08:06:50.279736 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275502    6210 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 08:06:50.279736 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275505    6210 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 08:06:50.279736 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275508    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 08:06:50.279736 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275510    6210 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 08:06:50.279736 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275513    6210 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 08:06:50.279736 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275516    6210 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 08:06:50.279736 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275518    6210 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 08:06:50.279736 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275521    6210 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 08:06:50.279736 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275523    6210 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 08:06:50.279736 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275526    6210 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 08:06:50.279736 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275529    6210 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 08:06:50.279736 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275532    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 08:06:50.279736 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275534    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 08:06:50.279736 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275537    6210 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 08:06:50.279736 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275539    6210 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 08:06:50.280225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275542    6210 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 08:06:50.280225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275544    6210 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 08:06:50.280225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275548    6210 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 08:06:50.280225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275550    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 08:06:50.280225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275553    6210 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 08:06:50.280225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275556    6210 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 08:06:50.280225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275558    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 08:06:50.280225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275560    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 08:06:50.280225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275563    6210 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 08:06:50.280225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275565    6210 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 08:06:50.280225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275568    6210 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 08:06:50.280225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275570    6210 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 08:06:50.280225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275573    6210 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 08:06:50.280225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275575    6210 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 08:06:50.280225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275578    6210 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 08:06:50.280225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275580    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 08:06:50.280225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275583    6210 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 08:06:50.280225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275586    6210 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 08:06:50.280225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275588    6210 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 08:06:50.280225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275591    6210 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 08:06:50.280738 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275594    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 08:06:50.280738 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275596    6210 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 08:06:50.280738 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275599    6210 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 08:06:50.280738 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275601    6210 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 08:06:50.280738 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275604    6210 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 08:06:50.280738 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275606    6210 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 08:06:50.280738 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275609    6210 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 08:06:50.280738 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275611    6210 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 08:06:50.280738 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275614    6210 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 08:06:50.280738 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275616    6210 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 08:06:50.280738 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275619    6210 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 08:06:50.280738 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275621    6210 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 08:06:50.280738 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275625    6210 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 08:06:50.280738 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275629    6210 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 08:06:50.280738 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275635    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 08:06:50.280738 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275638    6210 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 08:06:50.280738 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275641    6210 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 08:06:50.280738 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275644    6210 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 08:06:50.280738 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275647    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 08:06:50.281220 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275649    6210 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 08:06:50.281220 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275652    6210 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 08:06:50.281220 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275654    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 08:06:50.281220 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275657    6210 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 08:06:50.281220 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.275660    6210 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 08:06:50.281220 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275763    6210 flags.go:64] FLAG: --address="0.0.0.0"
Nov 02 08:06:50.281220 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275774    6210 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 02 08:06:50.281220 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275783    6210 flags.go:64] FLAG: --anonymous-auth="true"
Nov 02 08:06:50.281220 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275790    6210 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 02 08:06:50.281220 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275797    6210 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 02 08:06:50.281220 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275803    6210 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 02 08:06:50.281220 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275808    6210 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 02 08:06:50.281220 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275812    6210 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 02 08:06:50.281220 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275816    6210 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 02 08:06:50.281220 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275819    6210 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 02 08:06:50.281220 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275823    6210 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 02 08:06:50.281220 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275826    6210 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 02 08:06:50.281220 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275829    6210 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 02 08:06:50.281220 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275832    6210 flags.go:64] FLAG: --cgroup-root=""
Nov 02 08:06:50.281220 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275837    6210 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 02 08:06:50.281220 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275841    6210 flags.go:64] FLAG: --client-ca-file=""
Nov 02 08:06:50.281220 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275846    6210 flags.go:64] FLAG: --cloud-provider="external"
Nov 02 08:06:50.281220 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275852    6210 flags.go:64] FLAG: --cluster-dns="[]"
Nov 02 08:06:50.281766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275856    6210 flags.go:64] FLAG: --cluster-domain=""
Nov 02 08:06:50.281766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275859    6210 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 02 08:06:50.281766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275862    6210 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 02 08:06:50.281766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275866    6210 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 02 08:06:50.281766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275870    6210 flags.go:64] FLAG: --container-log-max-files="5"
Nov 02 08:06:50.281766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275874    6210 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 02 08:06:50.281766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275891    6210 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 02 08:06:50.281766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275894    6210 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 02 08:06:50.281766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275898    6210 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 02 08:06:50.281766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275901    6210 flags.go:64] FLAG: --contention-profiling="false"
Nov 02 08:06:50.281766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275904    6210 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 02 08:06:50.281766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275907    6210 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 02 08:06:50.281766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275910    6210 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 02 08:06:50.281766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275913    6210 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 02 08:06:50.281766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275918    6210 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 02 08:06:50.281766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275921    6210 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 02 08:06:50.281766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275924    6210 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 02 08:06:50.281766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275927    6210 flags.go:64] FLAG: --enable-load-reader="false"
Nov 02 08:06:50.281766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275930    6210 flags.go:64] FLAG: --enable-server="true"
Nov 02 08:06:50.281766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275934    6210 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 02 08:06:50.281766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275939    6210 flags.go:64] FLAG: --event-burst="100"
Nov 02 08:06:50.281766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275942    6210 flags.go:64] FLAG: --event-qps="50"
Nov 02 08:06:50.281766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275946    6210 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 02 08:06:50.281766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275949    6210 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 02 08:06:50.282398 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275952    6210 flags.go:64] FLAG: --eviction-hard=""
Nov 02 08:06:50.282398 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275956    6210 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 02 08:06:50.282398 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275959    6210 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 02 08:06:50.282398 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275962    6210 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 02 08:06:50.282398 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275966    6210 flags.go:64] FLAG: --eviction-soft=""
Nov 02 08:06:50.282398 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275969    6210 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 02 08:06:50.282398 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275972    6210 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 02 08:06:50.282398 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275975    6210 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 02 08:06:50.282398 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275978    6210 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 02 08:06:50.282398 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275980    6210 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 02 08:06:50.282398 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275983    6210 flags.go:64] FLAG: --fail-swap-on="true"
Nov 02 08:06:50.282398 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275986    6210 flags.go:64] FLAG: --feature-gates=""
Nov 02 08:06:50.282398 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275992    6210 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 02 08:06:50.282398 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275995    6210 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 02 08:06:50.282398 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.275999    6210 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 02 08:06:50.282398 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276002    6210 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 02 08:06:50.282398 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276005    6210 flags.go:64] FLAG: --healthz-port="10248"
Nov 02 08:06:50.282398 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276009    6210 flags.go:64] FLAG: --help="false"
Nov 02 08:06:50.282398 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276012    6210 flags.go:64] FLAG: --hostname-override="ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:06:50.282398 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276016    6210 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 02 08:06:50.282398 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276019    6210 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 02 08:06:50.282398 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276022    6210 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 02 08:06:50.282398 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276026    6210 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 02 08:06:50.282982 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276029    6210 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 02 08:06:50.282982 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276032    6210 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 02 08:06:50.282982 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276035    6210 flags.go:64] FLAG: --image-service-endpoint=""
Nov 02 08:06:50.282982 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276038    6210 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 02 08:06:50.282982 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276042    6210 flags.go:64] FLAG: --kube-api-burst="100"
Nov 02 08:06:50.282982 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276045    6210 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 02 08:06:50.282982 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276049    6210 flags.go:64] FLAG: --kube-api-qps="50"
Nov 02 08:06:50.282982 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276051    6210 flags.go:64] FLAG: --kube-reserved=""
Nov 02 08:06:50.282982 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276054    6210 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 02 08:06:50.282982 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276057    6210 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 02 08:06:50.282982 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276060    6210 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 02 08:06:50.282982 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276063    6210 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 02 08:06:50.282982 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276066    6210 flags.go:64] FLAG: --lock-file=""
Nov 02 08:06:50.282982 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276069    6210 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 02 08:06:50.282982 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276072    6210 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 02 08:06:50.282982 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276075    6210 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 02 08:06:50.282982 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276081    6210 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 02 08:06:50.282982 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276084    6210 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 02 08:06:50.282982 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276087    6210 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 02 08:06:50.282982 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276090    6210 flags.go:64] FLAG: --logging-format="text"
Nov 02 08:06:50.282982 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276093    6210 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 02 08:06:50.282982 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276098    6210 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 02 08:06:50.282982 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276101    6210 flags.go:64] FLAG: --manifest-url=""
Nov 02 08:06:50.282982 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276104    6210 flags.go:64] FLAG: --manifest-url-header=""
Nov 02 08:06:50.282982 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276108    6210 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 02 08:06:50.283595 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276111    6210 flags.go:64] FLAG: --max-open-files="1000000"
Nov 02 08:06:50.283595 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276115    6210 flags.go:64] FLAG: --max-pods="110"
Nov 02 08:06:50.283595 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276118    6210 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 02 08:06:50.283595 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276121    6210 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 02 08:06:50.283595 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276124    6210 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 02 08:06:50.283595 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276127    6210 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 02 08:06:50.283595 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276130    6210 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 02 08:06:50.283595 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276133    6210 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 02 08:06:50.283595 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276136    6210 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 02 08:06:50.283595 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276144    6210 flags.go:64] FLAG: --node-status-max-images="50"
Nov 02 08:06:50.283595 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276147    6210 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 02 08:06:50.283595 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276151    6210 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 02 08:06:50.283595 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276154    6210 flags.go:64] FLAG: --pod-cidr=""
Nov 02 08:06:50.283595 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276157    6210 flags.go:64] FLAG: --pod-manifest-path=""
Nov 02 08:06:50.283595 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276160    6210 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 02 08:06:50.283595 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276163    6210 flags.go:64] FLAG: --pods-per-core="0"
Nov 02 08:06:50.283595 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276166    6210 flags.go:64] FLAG: --port="10250"
Nov 02 08:06:50.283595 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276169    6210 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 02 08:06:50.283595 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276172    6210 flags.go:64] FLAG: --provider-id="aws:///us-west-2a/i-0a82209b6a62da828"
Nov 02 08:06:50.283595 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276176    6210 flags.go:64] FLAG: --qos-reserved=""
Nov 02 08:06:50.283595 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276179    6210 flags.go:64] FLAG: --read-only-port="10255"
Nov 02 08:06:50.283595 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276181    6210 flags.go:64] FLAG: --register-node="true"
Nov 02 08:06:50.283595 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276184    6210 flags.go:64] FLAG: --register-with-taints=""
Nov 02 08:06:50.283595 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276188    6210 flags.go:64] FLAG: --registry-burst="10"
Nov 02 08:06:50.283595 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276191    6210 flags.go:64] FLAG: --registry-qps="5"
Nov 02 08:06:50.283595 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276194    6210 flags.go:64] FLAG: --reserved-cpus=""
Nov 02 08:06:50.284453 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276197    6210 flags.go:64] FLAG: --reserved-memory=""
Nov 02 08:06:50.284453 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276201    6210 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 02 08:06:50.284453 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276206    6210 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 02 08:06:50.284453 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276209    6210 flags.go:64] FLAG: --rotate-certificates="false"
Nov 02 08:06:50.284453 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276212    6210 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 02 08:06:50.284453 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276215    6210 flags.go:64] FLAG: --runonce="false"
Nov 02 08:06:50.284453 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276218    6210 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 02 08:06:50.284453 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276221    6210 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 02 08:06:50.284453 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276224    6210 flags.go:64] FLAG: --seccomp-default="false"
Nov 02 08:06:50.284453 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276234    6210 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 02 08:06:50.284453 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276237    6210 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 02 08:06:50.284453 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276241    6210 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 02 08:06:50.284453 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276244    6210 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 02 08:06:50.284453 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276246    6210 flags.go:64] FLAG: --storage-driver-password="root"
Nov 02 08:06:50.284453 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276249    6210 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 02 08:06:50.284453 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276253    6210 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 02 08:06:50.284453 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276256    6210 flags.go:64] FLAG: --storage-driver-user="root"
Nov 02 08:06:50.284453 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276260    6210 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 02 08:06:50.284453 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276263    6210 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 02 08:06:50.284453 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276266    6210 flags.go:64] FLAG: --system-cgroups=""
Nov 02 08:06:50.284453 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276269    6210 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 02 08:06:50.284453 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276274    6210 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 02 08:06:50.284453 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276277    6210 flags.go:64] FLAG: --tls-cert-file=""
Nov 02 08:06:50.284453 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276280    6210 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 02 08:06:50.284453 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276284    6210 flags.go:64] FLAG: --tls-min-version=""
Nov 02 08:06:50.285375 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276286    6210 flags.go:64] FLAG: --tls-private-key-file=""
Nov 02 08:06:50.285375 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276289    6210 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 02 08:06:50.285375 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276292    6210 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 02 08:06:50.285375 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276295    6210 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 02 08:06:50.285375 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276298    6210 flags.go:64] FLAG: --v="2"
Nov 02 08:06:50.285375 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276303    6210 flags.go:64] FLAG: --version="false"
Nov 02 08:06:50.285375 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276307    6210 flags.go:64] FLAG: --vmodule=""
Nov 02 08:06:50.285375 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276310    6210 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 02 08:06:50.285375 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276314    6210 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 02 08:06:50.285375 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276466    6210 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 08:06:50.285375 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276470    6210 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 08:06:50.285375 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276473    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 08:06:50.285375 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276476    6210 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 08:06:50.285375 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276478    6210 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 08:06:50.285375 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276481    6210 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 08:06:50.285375 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276484    6210 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 08:06:50.285375 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276486    6210 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 08:06:50.285375 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276489    6210 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 08:06:50.285375 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276492    6210 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 08:06:50.285375 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276495    6210 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 08:06:50.285375 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276497    6210 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 08:06:50.285375 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276500    6210 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 08:06:50.285923 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276503    6210 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 08:06:50.285923 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276505    6210 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 08:06:50.285923 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276508    6210 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 08:06:50.285923 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276511    6210 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 08:06:50.285923 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276514    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 08:06:50.285923 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276517    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 08:06:50.285923 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276519    6210 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 08:06:50.285923 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276522    6210 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 08:06:50.285923 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276525    6210 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 08:06:50.285923 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276527    6210 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 08:06:50.285923 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276529    6210 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 08:06:50.285923 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276532    6210 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 08:06:50.285923 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276534    6210 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 08:06:50.285923 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276537    6210 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 08:06:50.285923 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276540    6210 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 08:06:50.285923 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276543    6210 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 08:06:50.285923 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276545    6210 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 08:06:50.285923 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276548    6210 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 08:06:50.285923 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276550    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 08:06:50.285923 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276554    6210 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 08:06:50.286406 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276557    6210 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 08:06:50.286406 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276559    6210 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 08:06:50.286406 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276562    6210 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 08:06:50.286406 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276564    6210 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 08:06:50.286406 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276567    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 08:06:50.286406 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276569    6210 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 08:06:50.286406 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276572    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 08:06:50.286406 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276574    6210 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 08:06:50.286406 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276577    6210 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 08:06:50.286406 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276580    6210 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 08:06:50.286406 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276582    6210 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 08:06:50.286406 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276585    6210 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 08:06:50.286406 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276588    6210 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 08:06:50.286406 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276591    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 08:06:50.286406 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276593    6210 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 08:06:50.286406 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276596    6210 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 08:06:50.286406 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276598    6210 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 08:06:50.286406 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276601    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 08:06:50.286406 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276603    6210 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 08:06:50.286406 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276606    6210 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 08:06:50.286886 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276608    6210 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 08:06:50.286886 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276611    6210 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 08:06:50.286886 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276613    6210 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 08:06:50.286886 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276616    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 08:06:50.286886 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276618    6210 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 08:06:50.286886 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276621    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 08:06:50.286886 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276623    6210 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 08:06:50.286886 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276625    6210 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 08:06:50.286886 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276628    6210 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 08:06:50.286886 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276631    6210 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 08:06:50.286886 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276633    6210 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 08:06:50.286886 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276637    6210 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 08:06:50.286886 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276640    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 08:06:50.286886 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276643    6210 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 08:06:50.286886 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276645    6210 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 08:06:50.286886 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276648    6210 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 08:06:50.286886 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276650    6210 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 08:06:50.286886 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276653    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 08:06:50.286886 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276655    6210 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 08:06:50.287445 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276658    6210 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 08:06:50.287445 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276661    6210 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 08:06:50.287445 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276669    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 08:06:50.287445 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276682    6210 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 08:06:50.287445 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276685    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 08:06:50.287445 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276687    6210 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 08:06:50.287445 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276690    6210 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 08:06:50.287445 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276693    6210 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 08:06:50.287445 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276695    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 08:06:50.287445 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276698    6210 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 08:06:50.287445 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276700    6210 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 08:06:50.287445 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276704    6210 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 08:06:50.287445 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276708    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 08:06:50.287445 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276711    6210 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 08:06:50.287445 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276714    6210 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 08:06:50.287445 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276716    6210 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 08:06:50.287445 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276719    6210 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 08:06:50.287445 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276722    6210 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 08:06:50.287445 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276725    6210 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 08:06:50.288035 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276727    6210 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 08:06:50.288035 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276730    6210 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 08:06:50.288035 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276732    6210 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 08:06:50.288035 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276735    6210 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 08:06:50.288035 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276738    6210 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 08:06:50.288035 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276741    6210 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 08:06:50.288035 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276744    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 08:06:50.288035 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276747    6210 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 08:06:50.288035 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276749    6210 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 08:06:50.288035 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276752    6210 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 08:06:50.288035 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276755    6210 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 08:06:50.288035 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276758    6210 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 08:06:50.288035 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276762    6210 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 08:06:50.288035 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276765    6210 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 08:06:50.288035 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276768    6210 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 08:06:50.288035 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.276794    6210 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 02 08:06:50.288716 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276835    6210 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 08:06:50.288716 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276841    6210 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 08:06:50.288716 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276846    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 08:06:50.288716 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276849    6210 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 08:06:50.288716 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276852    6210 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 08:06:50.288716 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276855    6210 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 08:06:50.288716 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276858    6210 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 08:06:50.288716 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276861    6210 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 08:06:50.288716 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276864    6210 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 08:06:50.288716 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276866    6210 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 08:06:50.288716 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276869    6210 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 08:06:50.288716 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276871    6210 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 08:06:50.288716 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276874    6210 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 08:06:50.288716 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276890    6210 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 08:06:50.288716 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276892    6210 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 08:06:50.288716 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276895    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 08:06:50.288716 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276898    6210 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 08:06:50.288716 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276902    6210 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 08:06:50.288716 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276905    6210 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 08:06:50.289577 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276908    6210 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 08:06:50.289577 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276912    6210 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 08:06:50.289577 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276916    6210 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 08:06:50.289577 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276919    6210 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 08:06:50.289577 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276922    6210 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 08:06:50.289577 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276925    6210 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 08:06:50.289577 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276928    6210 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 08:06:50.289577 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276931    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 08:06:50.289577 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276933    6210 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 08:06:50.289577 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276936    6210 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 08:06:50.289577 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276938    6210 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 08:06:50.289577 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276941    6210 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 08:06:50.289577 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276944    6210 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 08:06:50.289577 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276946    6210 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 08:06:50.289577 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276957    6210 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 08:06:50.289577 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276960    6210 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 08:06:50.289577 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276962    6210 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 08:06:50.289577 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276965    6210 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 08:06:50.289577 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276968    6210 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 08:06:50.289577 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276970    6210 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 08:06:50.290313 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276973    6210 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 08:06:50.290313 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276975    6210 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 08:06:50.290313 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276978    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 08:06:50.290313 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276981    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 08:06:50.290313 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276983    6210 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 08:06:50.290313 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276986    6210 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 08:06:50.290313 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276989    6210 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 08:06:50.290313 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276992    6210 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 08:06:50.290313 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276994    6210 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 08:06:50.290313 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.276996    6210 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 08:06:50.290313 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277001    6210 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 08:06:50.290313 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277003    6210 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 08:06:50.290313 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277006    6210 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 08:06:50.290313 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277009    6210 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 08:06:50.290313 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277012    6210 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 08:06:50.290313 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277015    6210 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 08:06:50.290313 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277017    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 08:06:50.290313 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277020    6210 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 08:06:50.290313 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277023    6210 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 08:06:50.290313 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277025    6210 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 08:06:50.290845 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277028    6210 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 08:06:50.290845 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277030    6210 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 08:06:50.290845 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277033    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 08:06:50.290845 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277035    6210 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 08:06:50.290845 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277037    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 08:06:50.290845 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277040    6210 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 08:06:50.290845 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277043    6210 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 08:06:50.290845 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277046    6210 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 08:06:50.290845 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277048    6210 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 08:06:50.290845 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277051    6210 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 08:06:50.290845 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277053    6210 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 08:06:50.290845 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277056    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 08:06:50.290845 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277059    6210 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 08:06:50.290845 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277061    6210 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 08:06:50.290845 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277064    6210 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 08:06:50.290845 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277066    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 08:06:50.290845 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277073    6210 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 08:06:50.290845 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277075    6210 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 08:06:50.290845 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277078    6210 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 08:06:50.290845 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277080    6210 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 08:06:50.291352 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277083    6210 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 08:06:50.291352 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277086    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 08:06:50.291352 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277090    6210 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 08:06:50.291352 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277092    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 08:06:50.291352 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277095    6210 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 08:06:50.291352 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277098    6210 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 08:06:50.291352 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277100    6210 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 08:06:50.291352 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277103    6210 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 08:06:50.291352 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277106    6210 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 08:06:50.291352 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277108    6210 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 08:06:50.291352 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277111    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 08:06:50.291352 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277114    6210 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 08:06:50.291352 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277117    6210 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 08:06:50.291352 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277119    6210 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 08:06:50.291352 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277122    6210 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 08:06:50.291352 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277124    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 08:06:50.291352 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277127    6210 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 08:06:50.291352 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277130    6210 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 08:06:50.291352 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277133    6210 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 08:06:50.291803 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277135    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 08:06:50.291803 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277139    6210 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 08:06:50.291803 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277141    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 08:06:50.291803 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277144    6210 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 08:06:50.291803 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277148    6210 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 08:06:50.291803 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277151    6210 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 08:06:50.291803 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277153    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 08:06:50.291803 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.277156    6210 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 08:06:50.291803 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.280991    6210 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 02 08:06:50.291803 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.281008    6210 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 02 08:06:50.291803 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.281032    6210 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 02 08:06:50.291803 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.281037    6210 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 02 08:06:50.291803 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281093    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 08:06:50.291803 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281098    6210 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 08:06:50.291803 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281102    6210 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 08:06:50.291803 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281105    6210 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 08:06:50.291803 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281108    6210 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 08:06:50.291803 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281120    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 08:06:50.291803 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281123    6210 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 08:06:50.292276 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281126    6210 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 08:06:50.292276 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281129    6210 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 08:06:50.292276 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281132    6210 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 08:06:50.292276 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281135    6210 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 08:06:50.292276 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281137    6210 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 08:06:50.292276 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281140    6210 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 08:06:50.292276 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281143    6210 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 08:06:50.292276 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281147    6210 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 08:06:50.292276 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281151    6210 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 08:06:50.292276 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281154    6210 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 08:06:50.292276 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281157    6210 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 08:06:50.292276 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281159    6210 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 08:06:50.292276 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281162    6210 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 08:06:50.292276 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281164    6210 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 08:06:50.292276 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281167    6210 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 08:06:50.292276 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281169    6210 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 08:06:50.292276 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281173    6210 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 08:06:50.292276 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281176    6210 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 08:06:50.292276 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281179    6210 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 08:06:50.292732 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281181    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 08:06:50.292732 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281184    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 08:06:50.292732 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281186    6210 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 08:06:50.292732 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281190    6210 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 08:06:50.292732 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281194    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 08:06:50.292732 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281196    6210 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 08:06:50.292732 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281199    6210 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 08:06:50.292732 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281202    6210 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 08:06:50.292732 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281204    6210 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 08:06:50.292732 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281207    6210 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 08:06:50.292732 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281209    6210 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 08:06:50.292732 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281212    6210 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 08:06:50.292732 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281214    6210 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 08:06:50.292732 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281217    6210 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 08:06:50.292732 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281219    6210 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 08:06:50.292732 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281222    6210 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 08:06:50.292732 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281225    6210 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 08:06:50.292732 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281228    6210 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 08:06:50.292732 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281231    6210 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 08:06:50.292732 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281233    6210 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 08:06:50.293225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281236    6210 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 08:06:50.293225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281239    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 08:06:50.293225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281242    6210 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 08:06:50.293225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281244    6210 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 08:06:50.293225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281247    6210 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 08:06:50.293225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281250    6210 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 08:06:50.293225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281253    6210 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 08:06:50.293225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281255    6210 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 08:06:50.293225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281258    6210 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 08:06:50.293225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281261    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 08:06:50.293225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281264    6210 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 08:06:50.293225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281266    6210 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 08:06:50.293225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281269    6210 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 08:06:50.293225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281272    6210 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 08:06:50.293225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281275    6210 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 08:06:50.293225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281277    6210 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 08:06:50.293225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281280    6210 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 08:06:50.293225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281283    6210 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 08:06:50.293225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281285    6210 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 08:06:50.293225 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281288    6210 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 08:06:50.293690 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281291    6210 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 08:06:50.293690 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281293    6210 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 08:06:50.293690 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281295    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 08:06:50.293690 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281298    6210 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 08:06:50.293690 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281301    6210 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 08:06:50.293690 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281303    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 08:06:50.293690 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281306    6210 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 08:06:50.293690 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281308    6210 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 08:06:50.293690 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281311    6210 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 08:06:50.293690 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281314    6210 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 08:06:50.293690 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281317    6210 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 08:06:50.293690 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281319    6210 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 08:06:50.293690 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281322    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 08:06:50.293690 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281324    6210 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 08:06:50.293690 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281327    6210 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 08:06:50.293690 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281329    6210 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 08:06:50.293690 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281332    6210 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 08:06:50.293690 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281335    6210 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 08:06:50.293690 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281339    6210 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 08:06:50.294196 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281343    6210 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 08:06:50.294196 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281346    6210 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 08:06:50.294196 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281350    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 08:06:50.294196 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281353    6210 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 08:06:50.294196 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281356    6210 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 08:06:50.294196 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281359    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 08:06:50.294196 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281362    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 08:06:50.294196 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281364    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 08:06:50.294196 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281367    6210 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 08:06:50.294196 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281370    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 08:06:50.294196 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281373    6210 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 08:06:50.294196 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281376    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 08:06:50.294196 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281378    6210 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 08:06:50.294196 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281381    6210 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 08:06:50.294196 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281383    6210 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 08:06:50.294196 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281386    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 08:06:50.294196 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281388    6210 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 08:06:50.294196 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281391    6210 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 08:06:50.294196 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281393    6210 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 08:06:50.294196 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281396    6210 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 08:06:50.294667 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281398    6210 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 08:06:50.294667 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.281425    6210 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 02 08:06:50.294667 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281561    6210 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 08:06:50.294667 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281565    6210 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 08:06:50.294667 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281568    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 08:06:50.294667 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281570    6210 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 08:06:50.294667 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281574    6210 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 08:06:50.294667 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281579    6210 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 08:06:50.294667 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281582    6210 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 08:06:50.294667 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281585    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 08:06:50.294667 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281587    6210 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 08:06:50.294667 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281590    6210 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 08:06:50.294667 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281593    6210 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 08:06:50.294667 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281596    6210 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 08:06:50.294667 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281599    6210 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 08:06:50.294667 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281601    6210 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 08:06:50.295070 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281603    6210 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 08:06:50.295070 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281606    6210 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 08:06:50.295070 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281608    6210 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 08:06:50.295070 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281611    6210 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 08:06:50.295070 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281613    6210 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 08:06:50.295070 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281616    6210 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 08:06:50.295070 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281623    6210 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 08:06:50.295070 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281626    6210 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 08:06:50.295070 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281629    6210 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 08:06:50.295070 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281632    6210 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 08:06:50.295070 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281635    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 08:06:50.295070 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281637    6210 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 08:06:50.295070 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281640    6210 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 08:06:50.295070 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281642    6210 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 08:06:50.295070 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281645    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 08:06:50.295070 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281648    6210 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 08:06:50.295070 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281650    6210 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 08:06:50.295070 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281653    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 08:06:50.295070 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281655    6210 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 08:06:50.295070 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281658    6210 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 08:06:50.295574 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281662    6210 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 08:06:50.295574 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281666    6210 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 08:06:50.295574 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281669    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 08:06:50.295574 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281672    6210 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 08:06:50.295574 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281674    6210 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 08:06:50.295574 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281677    6210 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 08:06:50.295574 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281680    6210 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 08:06:50.295574 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281682    6210 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 08:06:50.295574 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281685    6210 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 08:06:50.295574 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281688    6210 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 08:06:50.295574 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281690    6210 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 08:06:50.295574 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281693    6210 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 08:06:50.295574 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281695    6210 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 08:06:50.295574 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281698    6210 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 08:06:50.295574 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281700    6210 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 08:06:50.295574 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281703    6210 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 08:06:50.295574 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281705    6210 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 08:06:50.295574 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281708    6210 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 08:06:50.295574 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281712    6210 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 08:06:50.296048 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281714    6210 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 08:06:50.296048 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281717    6210 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 08:06:50.296048 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281720    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 08:06:50.296048 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281723    6210 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 08:06:50.296048 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281725    6210 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 08:06:50.296048 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281728    6210 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 08:06:50.296048 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281731    6210 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 08:06:50.296048 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281733    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 08:06:50.296048 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281736    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 08:06:50.296048 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281738    6210 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 08:06:50.296048 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281741    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 08:06:50.296048 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281743    6210 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 08:06:50.296048 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281746    6210 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 08:06:50.296048 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281748    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 08:06:50.296048 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281751    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 08:06:50.296048 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281754    6210 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 08:06:50.296048 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281756    6210 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 08:06:50.296048 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281759    6210 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 08:06:50.296048 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281761    6210 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 08:06:50.296495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281764    6210 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 08:06:50.296495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281766    6210 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 08:06:50.296495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281769    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 08:06:50.296495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281772    6210 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 08:06:50.296495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281775    6210 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 08:06:50.296495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281778    6210 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 08:06:50.296495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281780    6210 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 08:06:50.296495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281783    6210 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 08:06:50.296495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281786    6210 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 08:06:50.296495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281788    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 08:06:50.296495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281791    6210 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 08:06:50.296495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281793    6210 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 08:06:50.296495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281797    6210 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 08:06:50.296495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281799    6210 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 08:06:50.296495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281802    6210 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 08:06:50.296495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281805    6210 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 08:06:50.296495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281808    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 08:06:50.296495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281810    6210 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 08:06:50.296495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281813    6210 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 08:06:50.296495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281815    6210 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 08:06:50.296998 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281817    6210 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 08:06:50.296998 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281820    6210 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 08:06:50.296998 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281823    6210 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 08:06:50.296998 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281825    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 08:06:50.296998 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281828    6210 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 08:06:50.296998 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281830    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 08:06:50.296998 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281833    6210 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 08:06:50.296998 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281835    6210 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 08:06:50.296998 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281837    6210 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 08:06:50.296998 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281840    6210 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 08:06:50.296998 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281842    6210 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 08:06:50.296998 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281845    6210 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 08:06:50.296998 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281847    6210 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 08:06:50.296998 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281850    6210 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 08:06:50.296998 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.281873    6210 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 02 08:06:50.296998 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281916    6210 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 08:06:50.297378 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281921    6210 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 08:06:50.297378 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281924    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 08:06:50.297378 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281927    6210 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 08:06:50.297378 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281929    6210 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 08:06:50.297378 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281932    6210 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 08:06:50.297378 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281935    6210 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 08:06:50.297378 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281937    6210 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 08:06:50.297378 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281940    6210 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 08:06:50.297378 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281942    6210 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 08:06:50.297378 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281945    6210 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 08:06:50.297378 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281948    6210 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 08:06:50.297378 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281951    6210 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 08:06:50.297378 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281954    6210 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 08:06:50.297378 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281957    6210 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 08:06:50.297378 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281959    6210 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 08:06:50.297378 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281962    6210 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 08:06:50.297378 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281965    6210 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 08:06:50.297378 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281967    6210 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 08:06:50.297378 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281970    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 08:06:50.297378 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281972    6210 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 08:06:50.297852 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281975    6210 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 08:06:50.297852 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281977    6210 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 08:06:50.297852 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281980    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 08:06:50.297852 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281982    6210 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 08:06:50.297852 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281984    6210 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 08:06:50.297852 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281987    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 08:06:50.297852 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281989    6210 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 08:06:50.297852 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281992    6210 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 08:06:50.297852 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.281996    6210 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 08:06:50.297852 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282000    6210 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 08:06:50.297852 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282002    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 08:06:50.297852 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282005    6210 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 08:06:50.297852 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282009    6210 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 08:06:50.297852 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282012    6210 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 08:06:50.297852 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282014    6210 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 08:06:50.297852 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282017    6210 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 08:06:50.297852 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282019    6210 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 08:06:50.297852 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282022    6210 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 08:06:50.297852 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282024    6210 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 08:06:50.298495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282027    6210 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 08:06:50.298495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282029    6210 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 08:06:50.298495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282032    6210 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 08:06:50.298495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282035    6210 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 08:06:50.298495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282037    6210 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 08:06:50.298495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282039    6210 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 08:06:50.298495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282043    6210 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 08:06:50.298495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282045    6210 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 08:06:50.298495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282048    6210 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 08:06:50.298495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282050    6210 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 08:06:50.298495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282052    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 08:06:50.298495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282055    6210 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 08:06:50.298495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282057    6210 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 08:06:50.298495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282060    6210 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 08:06:50.298495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282063    6210 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 08:06:50.298495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282066    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 08:06:50.298495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282068    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 08:06:50.298495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282071    6210 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 08:06:50.298495 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282073    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 08:06:50.298967 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282075    6210 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 08:06:50.298967 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282078    6210 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 08:06:50.298967 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282080    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 08:06:50.298967 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282083    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 08:06:50.298967 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282085    6210 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 08:06:50.298967 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282088    6210 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 08:06:50.298967 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282095    6210 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 08:06:50.298967 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282098    6210 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 08:06:50.298967 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282100    6210 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 08:06:50.298967 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282103    6210 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 08:06:50.298967 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282105    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 08:06:50.298967 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282108    6210 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 08:06:50.298967 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282110    6210 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 08:06:50.298967 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282129    6210 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 08:06:50.298967 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282133    6210 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 08:06:50.298967 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282137    6210 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 08:06:50.298967 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282139    6210 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 08:06:50.298967 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282142    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 08:06:50.298967 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282145    6210 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 08:06:50.298967 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282148    6210 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 08:06:50.299437 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282151    6210 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 08:06:50.299437 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282154    6210 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 08:06:50.299437 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282156    6210 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 08:06:50.299437 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282159    6210 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 08:06:50.299437 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282161    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 08:06:50.299437 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282164    6210 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 08:06:50.299437 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282166    6210 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 08:06:50.299437 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282169    6210 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 08:06:50.299437 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282171    6210 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 08:06:50.299437 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282174    6210 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 08:06:50.299437 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282176    6210 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 08:06:50.299437 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282179    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 08:06:50.299437 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282181    6210 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 08:06:50.299437 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282184    6210 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 08:06:50.299437 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282186    6210 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 08:06:50.299437 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282188    6210 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 08:06:50.299437 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282191    6210 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 08:06:50.299437 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282193    6210 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 08:06:50.299437 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282197    6210 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 08:06:50.299437 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282200    6210 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 08:06:50.299958 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282202    6210 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 08:06:50.299958 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282205    6210 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 08:06:50.299958 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282208    6210 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 08:06:50.299958 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282210    6210 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 08:06:50.299958 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282212    6210 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 08:06:50.299958 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282215    6210 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 08:06:50.299958 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:06:50.282219    6210 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 08:06:50.299958 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.282275    6210 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 02 08:06:50.299958 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.283201    6210 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Nov 02 08:06:50.299958 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.283248    6210 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Nov 02 08:06:50.299958 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.283429    6210 server.go:1014] "Starting client certificate rotation"
Nov 02 08:06:50.299958 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.283562    6210 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 02 08:06:50.299958 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.283610    6210 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-01 08:00:38 +0000 UTC" deadline="2028-07-10 00:30:09.4169171 +0000 UTC"
Nov 02 08:06:50.299958 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.283645    6210 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14776h23m19.133274013s"
Nov 02 08:06:50.299958 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.283864    6210 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 02 08:06:50.299958 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.286305    6210 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 02 08:06:50.300386 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.287676    6210 log.go:25] "Validated CRI v1 runtime API"
Nov 02 08:06:50.300386 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.290015    6210 log.go:25] "Validated CRI v1 image API"
Nov 02 08:06:50.300386 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.290720    6210 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 02 08:06:50.300386 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.292815    6210 fs.go:135] Filesystem UUIDs: map[1d9111a4-5120-4d3c-8e0a-5e7ebbc5a181:/dev/nvme0n1p4 2b27b379-ed27-47e2-a507-b1f3485eeabf:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Nov 02 08:06:50.300519 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.292831    6210 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/01b46fcdb5fd050f0a7da2d941718e1004eaab21d114e64acecc68e1fbb59c1e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/01b46fcdb5fd050f0a7da2d941718e1004eaab21d114e64acecc68e1fbb59c1e/userdata/shm major:0 minor:80 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1ebfc3569d1bfe6378defd79ab0685cf0c8953bc408127f5fdf6681b2dd1c4d0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1ebfc3569d1bfe6378defd79ab0685cf0c8953bc408127f5fdf6681b2dd1c4d0/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2b7ecfd3deee44f05899c495fab004c5ef09a329e99052207be967a096505354/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2b7ecfd3deee44f05899c495fab004c5ef09a329e99052207be967a096505354/userdata/shm major:0 minor:409 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3569965a0eab278d33dbd724bd7339daf8cd2a3a85728be8a5d302ff0a190d12/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3569965a0eab278d33dbd724bd7339daf8cd2a3a85728be8a5d302ff0a190d12/userdata/shm major:0 minor:413 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/45277ab15e1401d38b64135ca5501ccf8f8abe08fd8499494a6c4398d227f2ef/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/45277ab15e1401d38b64135ca5501ccf8f8abe08fd8499494a6c4398d227f2ef/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/503d3e0b79afafd0016e62422fd47acaa47a3af87cfade3ce2584debe4f580b3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/503d3e0b79afafd0016e62422fd47acaa47a3af87cfade3ce2584debe4f580b3/userdata/shm major:0 minor:341 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/61443f19b06c5174067ac167c131cad07f3b1838b1262c254275ef6de87a36a3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/61443f19b06c5174067ac167c131cad07f3b1838b1262c254275ef6de87a36a3/userdata/shm major:0 minor:55 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6e090e4165f5fd0997d74c74596c5e0c2232b822f8935dd2dbc3a0909b3848a7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6e090e4165f5fd0997d74c74596c5e0c2232b822f8935dd2dbc3a0909b3848a7/userdata/shm major:0 minor:54 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7a4360c82ba695803be781b41ca0cf014fd2d869d94d3c48c5a587dcf5b8b24b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7a4360c82ba695803be781b41ca0cf014fd2d869d94d3c48c5a587dcf5b8b24b/userdata/shm major:0 minor:91 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7f253d41761290dc6a934bc44aeabf58bd435de2c9171d88ada2371b769c7c2b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7f253d41761290dc6a934bc44aeabf58bd435de2c9171d88ada2371b769c7c2b/userdata/shm major:0 minor:329 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8efcb5a5b85d2078c44d199766b6e88735990eadb1f706f241a7f4e27f5ebe87/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8efcb5a5b85d2078c44d199766b6e88735990eadb1f706f241a7f4e27f5ebe87/userdata/shm major:0 minor:245 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8f3484d327ea71e9e63985577c9d822e7dcb62781278afdff46e58a3544a396f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8f3484d327ea71e9e63985577c9d822e7dcb62781278afdff46e58a3544a396f/userdata/shm major:0 minor:411 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9ce77a411ccd220fbc6ba34a25e9f6e8a7360339a4c2ad6d59ac9f70bf9c6ea1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9ce77a411ccd220fbc6ba34a25e9f6e8a7360339a4c2ad6d59ac9f70bf9c6ea1/userdata/shm major:0 minor:207 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/aaa2c55a85fa19ec7d9f6fda37f7ae5b5ab15db3dd4247c80128f87c35867318/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/aaa2c55a85fa19ec7d9f6fda37f7ae5b5ab15db3dd4247c80128f87c35867318/userdata/shm major:0 minor:250 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/afcf5184d93f78966481a88ea7691e2090b6a8f9f0ab7a4ca078527971c2e337/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/afcf5184d93f78966481a88ea7691e2090b6a8f9f0ab7a4ca078527971c2e337/userdata/shm major:0 minor:334 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b290572b501567db428c0dbfb6aa0a1e0464a75a5d2d732421ddaba91f3a965e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b290572b501567db428c0dbfb6aa0a1e0464a75a5d2d732421ddaba91f3a965e/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b45f036757b3fa6c88c3143507672dc50a6817a55c98e6c6f651301fe8063d60/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b45f036757b3fa6c88c3143507672dc50a6817a55c98e6c6f651301fe8063d60/userdata/shm major:0 minor:252 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b9990fc470c4c5eaecdb9f9f238d04a4fbaf12c51705bb3594d8f19f3ea9592e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b9990fc470c4c5eaecdb9f9f238d04a4fbaf12c51705bb3594d8f19f3ea9592e/userdata/shm major:0 minor:320 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/cc75ecdda2d02d96a405b1324a5d8bbbdb344821cf453edf9371a4e06851db0b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/cc75ecdda2d02d96a405b1324a5d8bbbdb344821cf453edf9371a4e06851db0b/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/dddfb0521c8b80b98845cd23cf30b4c62d2b673ec394c5ad3e467159aed185b2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/dddfb0521c8b80b98845cd23cf30b4c62d2b673ec394c5ad3e467159aed185b2/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e736bfab51da96e2f687a517ac31db8f2d94e5f927f76c9663e6fca54c6c4deb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e736bfab51da96e2f687a517ac31db8f2d94e5f927f76c9663e6fca54c6c4deb/userdata/shm major:0 minor:209 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ea04eff886357b11cf3d1ec2d183d95053646a4314da7062299ed28005ad0805/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ea04eff886357b11cf3d1ec2d183d95053646a4314da7062299ed28005ad0805/userdata/shm major:0 minor:205 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/fbe098f0e9731181351749c3d5456206f5e9289e5f2df036054281cc8a80596a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/fbe098f0e9731181351749c3d5456206f5e9289e5f2df036054281cc8a80596a/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0027996b-31d7-474a-88e9-efc0b6032300/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/0027996b-31d7-474a-88e9-efc0b6032300/volumes/kubernetes.io~secret/agent-certs major:0 minor:49 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/05f90c13-3432-4e94-b368-66226fa6ff26/volumes/kubernetes.io~projected/kube-api-access-djxm4:{mountpoint:/var/lib/kubelet/pods/05f90c13-3432-4e94-b368-66226fa6ff26/volumes/kubernetes.io~projected/kube-api-access-djxm4 major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1aff1f9f-94a9-486f-a807-76b15fb88cfa/volumes/kubernetes.io~projected/kube-api-access-94rml:{mountpoint:/var/lib/kubelet/pods/1aff1f9f-94a9-486f-a807-76b15fb88cfa/volumes/kubernetes.io~projected/kube-api-access-94rml major:0 minor:340 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1aff1f9f-94a9-486f-a807-76b15fb88cfa/volumes/kubernetes.io~secret/federate-client-tls:{mountpoint:/var/lib/kubelet/pods/1aff1f9f-94a9-486f-a807-76b15fb88cfa/volumes/kubernetes.io~secret/federate-client-tls major:0 minor:338 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1aff1f9f-94a9-486f-a807-76b15fb88cfa/volumes/kubernetes.io~secret/secret-telemeter-client:{mountpoint:/var/lib/kubelet/pods/1aff1f9f-94a9-486f-a807-76b15fb88cfa/volumes/kubernetes.io~secret/secret-telemeter-client major:0 minor:336 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1aff1f9f-94a9-486f-a807-76b15fb88cfa/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/1aff1f9f-94a9-486f-a807-76b15fb88cfa/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config major:0 minor:339 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1aff1f9f-94a9-486f-a807-76b15fb88cfa/volumes/kubernetes.io~secret/telemeter-client-tls:{mountpoint:/var/lib/kubelet/pods/1aff1f9f-94a9-486f-a807-76b15fb88cfa/volumes/kubernetes.io~secret/telemeter-client-tls major:0 minor:337 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2a263223-99a0-43f4-9e93-f9b990f7c57d/volumes/kubernetes.io~projected/kube-api-access-4bbc2:{mountpoint:/var/lib/kubelet/pods/2a263223-99a0-43f4-9e93-f9b990f7c57d/volumes/kubernetes.io~projected/kube-api-access-4bbc2 major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2a263223-99a0-43f4-9e93-f9b990f7c57d/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/2a263223-99a0-43f4-9e93-f9b990f7c57d/volumes/kubernetes.io~secret/cert major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2ed28bb0-f551-4b15-8d8e-04da752a23ec/volumes/kubernetes.io~projected/kube-api-access-5twnn:{mountpoint:/var/lib/kubelet/pods/2ed28bb0-f551-4b15-8d8e-04da752a23ec/volumes/kubernetes.io~projected/kube-api-access-5twnn major:0 minor:327 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2ed28bb0-f551-4b15-8d8e-04da752a23ec/volumes/kubernetes.io~secret/client-ca-bundle:{mountpoint:/var/lib/kubelet/pods/2ed28bb0-f551-4b15-8d8e-04da752a23ec/volumes/kubernetes.io~secret/client-ca-bundle major:0 minor:324 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2ed28bb0-f551-4b15-8d8e-04da752a23ec/volumes/kubernetes.io~secret/secret-metrics-server-client-certs:{mountpoint:/var/lib/kubelet/pods/2ed28bb0-f551-4b15-8d8e-04da752a23ec/volumes/kubernetes.io~secret/secret-metrics-server-client-certs major:0 minor:325 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2ed28bb0-f551-4b15-8d8e-04da752a23ec/volumes/kubernetes.io~secret/secret-metrics-server-tls:{mountpoint:/var/lib/kubelet/pods/2ed28bb0-f551-4b15-8d8e-04da752a23ec/volumes/kubernetes.io~secret/secret-metrics-server-tls major:0 minor:326 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15/volumes/kubernetes.io~projected/kube-api-access-l4c4m:{mountpoint:/var/lib/kubelet/pods/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15/volumes/kubernetes.io~projected/kube-api-access-l4c4m major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:53 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/437fc0dd-7f5a-4e18-8252-810aab07ff3c/volumes/kubernetes.io~projected/kube-api-access-kbn9c:{mountpoint:/var/lib/kubelet/pods/437fc0dd-7f5a-4e18-8252-810aab07ff3c/volumes/kubernetes.io~projected/kube-api-access-kbn9c major:0 minor:244 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/437fc0dd-7f5a-4e18-8252-810aab07ff3c/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/437fc0dd-7f5a-4e18-8252-810aab07ff3c/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config major:0 minor:242 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/437fc0dd-7f5a-4e18-8252-810aab07ff3c/volumes/kubernetes.io~secret/kube-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/437fc0dd-7f5a-4e18-8252-810aab07ff3c/volumes/kubernetes.io~secret/kube-state-metrics-tls major:0 minor:243 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/558cdaf8-03cf-4d61-9c28-94a5da9c886d/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/558cdaf8-03cf-4d61-9c28-94a5da9c886d/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:48 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/558cdaf8-03cf-4d61-9c28-94a5da9c886d/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/558cdaf8-03cf-4d61-9c28-94a5da9c886d/volumes/kubernetes.io~empty-dir/tmp major:0 minor:47 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/558cdaf8-03cf-4d61-9c28-94a5da9c886d/volumes/kubernetes.io~projected/kube-api-access-djtkk:{mountpoint:/var/lib/kubelet/pods/558cdaf8-03cf-4d61-9c28-94a5da9c886d/volumes/kubernetes.io~projected/kube-api-access-djtkk major:0 minor:51 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5b54f688-470c-4797-b685-8b9826e361a8/volumes/kubernetes.io~projected/kube-api-access-rc2kl:{mountpoint:/var/lib/kubelet/pods/5b54f688-470c-4797-b685-8b9826e361a8/volumes/kubernetes.io~projected/kube-api-access-rc2kl major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/731f7925-494b-4442-b5c4-8d2df9379896/volumes/kubernetes.io~projected/kube-api-access-q7pwz:{mountpoint:/var/lib/kubelet/pods/731f7925-494b-4442-b5c4-8d2df9379896/volumes/kubernetes.io~projected/kube-api-access-q7pwz major:0 minor:52 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/79843809-80ac-4069-b436-ba1a26348505/volumes/kubernetes.io~projected/kube-api-access-lwd27:{mountpoint:/var/lib/kubelet/pods/79843809-80ac-4069-b436-ba1a26348505/volumes/kubernetes.io~projected/kube-api-access-lwd27 major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8b58f599-6735-4461-8657-ef5abab78403/volumes/kubernetes.io~projected/kube-api-access-hcp9h:{mountpoint:/var/lib/kubelet/pods/8b58f599-6735-4461-8657-ef5abab78403/volumes/kubernetes.io~projected/kube-api-access-hcp9h major:0 minor:241 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8b58f599-6735-4461-8657-ef5abab78403/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/8b58f599-6735-4461-8657-ef5abab78403/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config major:0 minor:240 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8b58f599-6735-4461-8657-ef5abab78403/volumes/kubernetes.io~secret/openshift-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/8b58f599-6735-4461-8657-ef5abab78403/volumes/kubernetes.io~secret/openshift-state-metrics-tls major:0 minor:236 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9a77497b-33c1-4ac2-bfba-58b6edcf871e/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/9a77497b-33c1-4ac2-bfba-58b6edcf871e/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:407 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9dbb1434-9e62-4d55-86a3-b7e4b469fb42/volumes/kubernetes.io~projected/kube-api-access-7q98x:{mountpoint:/var/lib/kubelet/pods/9dbb1434-9e62-4d55-86a3-b7e4b469fb42/volumes/kubernetes.io~projected/kube-api-access-7q98x major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9dbb1434-9e62-4d55-86a3-b7e4b469fb42/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/9dbb1434-9e62-4d55-86a3-b7e4b469fb42/volumes/kubernetes.io~secret/metrics-tls major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bff203a8-2155-4ef1-9efd-b1a6d7e1eabe/volumes/kubernetes.io~projected/kube-api-access-6h6hj:{mountpoint:/var/lib/kubelet/pods/bff203a8-2155-4ef1-9efd-b1a6d7e1eabe/volumes/kubernetes.io~projected/kube-api-access-6h6hj major:0 minor:328 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bff203a8-2155-4ef1-9efd-b1a6d7e1eabe/volumes/kubernetes.io~secret/monitoring-plugin-cert:{mountpoint:/var/lib/kubelet/pods/bff203a8-2155-4ef1-9efd-b1a6d7e1eabe/volumes/kubernetes.io~secret/monitoring-plugin-cert major:0 minor:331 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c03021d1-d458-46a8-af56-bfba0cc4b4b4/volumes/kubernetes.io~projected/kube-api-access-rpq4r:{mountpoint:/var/lib/kubelet/pods/c03021d1-d458-46a8-af56-bfba0cc4b4b4/volumes/kubernetes.io~projected/kube-api-access-rpq4r major:0 minor:408 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c705cd89-a6cf-4dcf-88b5-5ff2da580f07/volumes/kubernetes.io~projected/kube-api-access-hk9zl:{mountpoint:/var/lib/kubelet/pods/c705cd89-a6cf-4dcf-88b5-5ff2da580f07/volumes/kubernetes.io~projected/kube-api-access-hk9zl major:0 minor:50 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8/volumes/kubernetes.io~projected/kube-api-access-dcq5p:{mountpoint:/var/lib/kubelet/pods/cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8/volumes/kubernetes.io~projected/kube-api-access-dcq5p major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d220536b-9c7c-4e34-8ac0-3c25ab4975f7/volumes/kubernetes.io~projected/kube-api-access-pgzlc:{mountpoint:/var/lib/kubelet/pods/d220536b-9c7c-4e34-8ac0-3c25ab4975f7/volumes/kubernetes.io~projected/kube-api-access-pgzlc major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d276266f-fed6-4266-89b3-c57743cc7179/volumes/kubernetes.io~projected/kube-api-access-xvz67:{mountpoint:/var/lib/kubelet/pods/d276266f-fed6-4266-89b3-c57743cc7179/volumes/kubernetes.io~projected/kube-api-access-xvz67 major:0 minor:310 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d276266f-fed6-4266-89b3-c57743cc7179/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/d276266f-fed6-4266-89b3-c57743cc7179/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:318 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d276266f-fed6-4266-89b3-c57743cc7179/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/d276266f-fed6-4266-89b3-c57743cc7179/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy major:0 minor:314 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d276266f-fed6-4266-89b3-c57743cc7179/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics:{mountpoint:/var/lib/kubelet/pods/d276266f-fed6-4266-89b3-c57743cc7179/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics major:0 minor:317 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d276266f-fed6-4266-89b3-c57743cc7179/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules:{mountpoint:/var/lib/kubelet/pods/d276266f-fed6-4266-89b3-c57743cc7179/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules major:0 minor:316 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d276266f-fed6-4266-89b3-c57743cc7179/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/d276266f-fed6-4266-89b3-c57743cc7179/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web major:0 minor:315 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d276266f-fed6-4266-89b3-c57743cc7179/volumes/kubernetes.io~secret/secret-thanos-querier-tls:{mountpoint:/var/lib/kubelet/pods/d276266f-fed6-4266-89b3-c57743cc7179/volumes/kubernetes.io~secret/secret-thanos-querier-tls major:0 minor:319 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f8e6a0b5-f8b9-4d1b-848b-d3517004d495/volumes/kubernetes.io~projected/kube-api-access-sc7fm:{mountpoint:/var/lib/kubelet/pods/f8e6a0b5-f8b9-4d1b-848b-d3517004d495/volumes/kubernetes.io~projected/kube-api-access-sc7fm major:0 minor:249 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f8e6a0b5-f8b9-4d1b-848b-d3517004d495/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/f8e6a0b5-f8b9-4d1b-848b-d3517004d495/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:248 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f8e6a0b5-f8b9-4d1b-848b-d3517004d495/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/f8e6a0b5-f8b9-4d1b-848b-d3517004d495/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:247 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ff05c739-4a53-4cfe-942f-df41f812d742/volumes/kubernetes.io~projected/kube-api-access-px425:{mountpoint:/var/lib/kubelet/pods/ff05c739-4a53-4cfe-942f-df41f812d742/volumes/kubernetes.io~projected/kube-api-access-px425 major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ff05c739-4a53-4cfe-942f-df41f812d742/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/ff05c739-4a53-4cfe-942f-df41f812d742/volumes/kubernetes.io~secret/metrics-certs major:0 minor:403 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/bf7a24436d7d7c07bf887e16857ef01e4dff23d047552395acf6cf44782e458a/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/fbf5a3146c55a024f06bc8dd1e1a1a7396909c73271a1fb85080260ce114eb47/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/1b9dc526f47eb7979195974d547d6da7ac321e321e18a27be89a5fd8b7e6f442/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-109:{mountpoint:/var/lib/containers/storage/overlay/db35bccec1234bf19c0c65ac80609b124a869530cfd22032c1918483086ee588/merged major:0 minor:109 fsType:overlay blockSize:0} overlay_0-113:{mountpoint:/var/lib/containers/storage/overlay/67bd80e08e85e0ca5a8f6eb64ba562746181e301e57eb5a0fa0b47d9435d4ae5/merged major:0 minor:113 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/c5e7cfd85804c455e31cbae6f3063ec2498f32cbf846ae396d9fe2a0fda8ae86/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/68ae4807dd0a9fd2b2651d2bdf6bcdad7f3b55ad810de0a19b08cb1fd66f7910/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/bac07051310aeb350b410b9f7b42ba75d7b433104807a71ce851a3c169ebd954/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/8084ed7f7f589529b0bd8a4571f5e5c8a5859e8a8259a003982fd6fa76d9ab73/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-134:{mountpoint:/var/lib/containers/storage/overlay/101812bf676205e7c89d3defcd2abeb846366ce514e2e0033e6f9779d8e82b44/merged major:0 minor:134 fsType:overlay blockSize:0} overlay_0-138:{mountpoint:/var/lib/containers/storage/overlay/3ac7c4e790d1d1a9828cc2b2ed378b0d25779629cace34d06184b411af70e616/merged major:0 minor:138 fsType:overlay blockSize:0} overlay_0-147:{mountpoint:/var/lib/containers/storage/overlay/7623c9b3a58a5812b58607cfd543266cbdc966b788eb905da23a6be2af29ee8d/merged major:0 minor:147 fsType:overlay blockSize:0} overlay_0-153:{mountpoint:/var/lib/containers/storage/overlay/932d32237d71a706d917fb190e0dcc4003dfdad6f72c9beec776a84ef705179a/merged major:0 minor:153 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/ef93037659cd5032dc5df1fc0a7780d8be00a7217d43563855405858da3b8371/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/4b0c7e881eb0f158ecc9f816358d010fa6f30b1bbc7bf2865eff8428e62f94c5/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/5cb93e62970e704e9302563fcaa38bf04cd1af0c1f2b2e4d9294407d7eaa2ca2/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/ddfb063d5e3ed3e0c8af0700dfe8fdedd65b0d8bd942e868cb3b1fe520d3d63b/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/151a09fad5af217b2d0308e09fddca22df618bd66018b4970da6e96b13a3573f/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/4ee9516c925e25e83093b1ca3b310aec0bc86ace50ed765a21245a381bd7c8e0/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/5bda8d50809a058854849b19fa3c7576bc04bd55b6db195b81ac9110fb68533e/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/32ddf6405278dd1a6b11fe4cfe61bcbb9e518d222b370394a80afe92810d21ab/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-211:{mountpoint:/var/lib/containers/storage/overlay/5e4ca944571dea9102c26794308b6b9635b826006d97751ba9290c60190bed52/merged major:0 minor:211 fsType:overlay blockSize:0} overlay_0-213:{mountpoint:/var/lib/containers/storage/overlay/175656732cba5238b6b4447922660ff64ef9e10af43d2dd2babb4c9aed1ed42b/merged major:0 minor:213 fsType:overlay blockSize:0} overlay_0-215:{mountpoint:/var/lib/containers/storage/overlay/fd4d078936c4a60d93f56eef0eda6139da1e7a8bbfe4e3cb0701b8c3f437f8ce/merged major:0 minor:215 fsType:overlay blockSize:0} overlay_0-217:{mountpoint:/var/lib/containers/storage/overlay/036040523dd583d91675630c0692a8f640ab63dc5246341ae32116a6a44b280f/merged major:0 minor:217 fsType:overlay blockSize:0} overlay_0-219:{mountpoint:/var/lib/containers/storage/overlay/3f91eb8c736dc9a368e60e064f8d0c11a9c418ecd43c3d3a017a83576db1eb97/merged major:0 minor:219 fsType:overlay blockSize:0} overlay_0-225:{mountpoint:/var/lib/containers/storage/overlay/a1a2b2bf5aaf507f064fd9f05cf5682f5ce7147aeca603d394cfad51073fe7a9/merged major:0 minor:225 fsType:overlay blockSize:0} overlay_0-230:{mountpoint:/var/lib/containers/storage/overlay/0a1a139ce3cc0b71e682c18044317d40484f1ce3334508e91b6cd21a4e35ae95/merged major:0 minor:230 fsType:overlay blockSize:0} overlay_0-254:{mountpoint:/var/lib/containers/storage/overlay/358ff7a327d35d5466c105a413e1e9a1596bacf81cab0b723be4db8a79a09f10/merged major:0 minor:254 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/dd4ef073bed5ad353658056e33460293664d7d52a7ba81090f1e21e42d5dbe6d/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/d508ad06ef46952bb9fb11c68d6467898e314e7fd91b7fbd7f16e1dbda0eb58a/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/b16d4751909714fcafe56dbde3b3df8f7ad4b27463304edd38cdd01c45b9fa4f/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-265:{mountpoint:/var/lib/containers/storage/overlay/4a1d193c17d3c1e5c78cad3daf118662a32915d9826ec9035237e921488e63d5/merged major:0 minor:265 fsType:overlay blockSize:0} overlay_0-268:{mountpoint:/var/lib/containers/storage/overlay/dd676aa9ccac8aeb99c7d5d7266bb1d92fc172ea4132f0c265f7bac979fbdc56/merged major:0 minor:268 fsType:overlay blockSize:0} overlay_0-272:{mountpoint:/var/lib/containers/storage/overlay/1f02b9bb8e77febfbd01347081f7a5a7ec1a5cea0a81efc6ae9c986343f69fa7/merged major:0 minor:272 fsType:overlay blockSize:0} overlay_0-279:{mountpoint:/var/lib/containers/storage/overlay/c2290dbacbcce3407292f38e3f0da1c981953d4c2d13ce884dee7164dc4b0530/merged major:0 minor:279 fsType:overlay blockSize:0} overlay_0-284:{mountpoint:/var/lib/containers/storage/overlay/15bee3334b75ba8bb418087727ddf143644c74fc9b16a46c54a3d15708c180ee/merged major:0 minor:284 fsType:overlay blockSize:0} overlay_0-289:{mountpoint:/var/lib/containers/storage/overlay/36b132a5727d82794578f2b08da0173865edacd8e0b6d3d6a2e1bf4aa848fb3f/merged major:0 minor:289 fsType:overlay blockSize:0} overlay_0-295:{mountpoint:/var/lib/containers/storage/overlay/07c0eeec910592ebf3e45d28c77c2db4c50b2ac9857398358bd8051b1928c2a9/merged major:0 minor:295 fsType:overlay blockSize:0} overlay_0-300:{mountpoint:/var/lib/containers/storage/overlay/37a83cd288c25b7aa5418e61ecf14c4cde6c3127eea2b9ad52acbde03f041f17/merged major:0 minor:300 fsType:overlay blockSize:0} overlay_0-304:{mountpoint:/var/lib/containers/storage/overlay/607b5ade134f3b6e4671643b35ef64dd3d8f733cf6525a5be25a71cf921a6dfe/merged major:0 minor:304 fsType:overlay blockSize:0} overlay_0-322:{mountpoint:/var/lib/containers/storage/overlay/e442da2528ed4e5f1cdf3b3b1829ca6488ac62700dd8f711a2bfdab2c934adc4/merged major:0 minor:322 fsType:overlay blockSize:0} overlay_0-332:{mountpoint:/var/lib/containers/storage/overlay/12e174105faee8c4b84aead7120451fc1b0df67dc8cdf4e643cd87321d6ca627/merged major:0 minor:332 fsType:overlay blockSize:0} overlay_0-343:{mountpoint:/var/lib/containers/storage/overlay/377bd8803d6a57f968711c54f0982347901df8cca772de87c84af182704c4ad6/merged major:0 minor:343 fsType:overlay blockSize:0} overlay_0-345:{mountpoint:/var/lib/containers/storage/overlay/1b957e4becb21de55415b2b5f913395466dc1a069f14108032cdcc963a165fe3/merged major:0 minor:345 fsType:overlay blockSize:0} overlay_0-351:{mountpoint:/var/lib/containers/storage/overlay/d6f4b8f904ba14580629f8aef305c713e5bc81e12155fd533ed51b48e694ffc3/merged major:0 minor:351 fsType:overlay blockSize:0} overlay_0-352:{mountpoint:/var/lib/containers/storage/overlay/6a869e434086de0eaa744a68103165c0410bd45e0e50184640b518cefefc7efd/merged major:0 minor:352 fsType:overlay blockSize:0} overlay_0-358:{mountpoint:/var/lib/containers/storage/overlay/68dabfbc45a4ae631d55b4641b381cc59fd44018d0ca356e80cad428fe20708c/merged major:0 minor:358 fsType:overlay blockSize:0} overlay_0-363:{mountpoint:/var/lib/containers/storage/overlay/6a072ae8e3c6f45ea03fb7bbeb101fd64c322dc0490f0b92e141ce782451f221/merged major:0 minor:363 fsType:overlay blockSize:0} overlay_0-365:{mountpoint:/var/lib/containers/storage/overlay/7ee3fcab14347e9cac96cb9964028df7dcff084d889ac32287e4c27aba27be87/merged major:0 minor:365 fsType:overlay blockSize:0} overlay_0-370:{mountpoint:/var/lib/containers/storage/overlay/66bfd13a655fca95302bcabf4403f2de119425ff2fce522885d6293788c396bd/merged major:0 minor:370 fsType:overlay blockSize:0} overlay_0-375:{mountpoint:/var/lib/containers/storage/overlay/b14936ac6d19b37df2afcb779db87ce5713eeb5fa628dc5a77942df53470819e/merged major:0 minor:375 fsType:overlay blockSize:0} overlay_0-380:{mountpoint:/var/lib/containers/storage/overlay/b37653c4234f264b69530bea3a00dfef2d0bf48415b50761d1b8f9f9d0240d03/merged major:0 minor:380 fsType:overlay blockSize:0} overlay_0-386:{mountpoint:/var/lib/containers/storage/overlay/0d2b073098de69a85e99c19bdcbbc0335fc200fa622889e1026fa717b49cf518/merged major:0 minor:386 fsType:overlay blockSize:0} overlay_0-392:{mountpoint:/var/lib/containers/storage/overlay/37b082cdc5f679ad51654e1d74aaad0b0b063e2e0c03d97b3482a2e6a1945942/merged major:0 minor:392 fsType:overlay blockSize:0} overlay_0-398:{mountpoint:/var/lib/containers/storage/overlay/21cc0d484f629b6e4f9c2ed40cc25bb60f7138e630148227ffc77a48917104e0/merged major:0 minor:398 fsType:overlay blockSize:0} overlay_0-415:{mountpoint:/var/lib/containers/storage/overlay/783c89564c8365b94b4eaae715e2fe1b2035cf9b2efabc49067b2a7116176164/merged major:0 minor:415 fsType:overlay blockSize:0} overlay_0-417:{mountpoint:/var/lib/containers/storage/overlay/9bda4f0d9b94b493703a5578b727394a2be675af18cc6af2b32bca984f0085e7/merged major:0 minor:417 fsType:overlay blockSize:0} overlay_0-419:{mountpoint:/var/lib/containers/storage/overlay/87345f1c4ea9eb3a56a6f38494a27553e9e3c19325e0ff83b7ad20d036cb36fd/merged major:0 minor:419 fsType:overlay blockSize:0} overlay_0-421:{mountpoint:/var/lib/containers/storage/overlay/9b1523741a57cca0781cd7dc55dd573e22c4d0126dedaa88849aafb2472f4f07/merged major:0 minor:421 fsType:overlay blockSize:0} overlay_0-423:{mountpoint:/var/lib/containers/storage/overlay/134fb713cdc7349abd73a650676525e5217dca616fefac2d2fc40d67f92b3392/merged major:0 minor:423 fsType:overlay blockSize:0} overlay_0-429:{mountpoint:/var/lib/containers/storage/overlay/363419ac8ac57fef5307e6114f2d32e89e3a9ba7a599a5963e4a864f78826851/merged major:0 minor:429 fsType:overlay blockSize:0} overlay_0-434:{mountpoint:/var/lib/containers/storage/overlay/60b22ff5e0342b88532ebe976b495c7cb271697f78f2eb60528afb69b9b8939b/merged major:0 minor:434 fsType:overlay blockSize:0} overlay_0-64:{mountpoint:/var/lib/containers/storage/overlay/90604f31150aca74f5990736f16c8fc0992106396260bae4d8d6598d892f654f/merged major:0 minor:64 fsType:overlay blockSize:0} overlay_0-66:{mountpoint:/var/lib/containers/storage/overlay/1c3c6e787d6f43f180059da095e038d4a13d8b40788f8b2dc000f84033622b7e/merged major:0 minor:66 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/3f01a3e2c1b34fd574fafa7ecb8130cebae6df9084b850b38b71c5cf3c9d4c4c/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/897f7c7541b4542e2e62e947835fec3b30e619e853c4c88e9406677859f5e350/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/bb69223053e7c7793db5b808fcc3c371128fea09545b945f297dc7473e7e0eaa/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/4a022398679f433a6594583a605ce7c1205240936f27d94cbdfa3c6b8a33511e/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/df7a5b5c8b38f6de45c9502a4db27fa323c70b10debf774a90a917beea85c02f/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/6849d530d239ed6b00f8ff6891c2f8c405460afd1ec1fee1ef6bc2d1d420872b/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-94:{mountpoint:/var/lib/containers/storage/overlay/bd67f5f08396e1bc91427aeef7c02ba12751a14723ca9ff64f91a87619055363/merged major:0 minor:94 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/4083ed1d378c66865fb20db615eba41ad4db02b5d92422723ee30e86505a59ed/merged major:0 minor:96 fsType:overlay blockSize:0}]
Nov 02 08:06:50.300787 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.299995    6210 manager.go:217] Machine: {Timestamp:2026-11-02 08:06:50.299531593 +0000 UTC m=+0.057960317 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099720 MemoryCapacity:33164337152 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2034206d82aa81e5573c94dd4d1af5 SystemUUID:ec203420-6d82-aa81-e557-3c94dd4d1af5 BootID:dacaf683-edef-46e1-aed1-391f63f199e9 Filesystems:[{Device:/var/lib/kubelet/pods/d220536b-9c7c-4e34-8ac0-3c25ab4975f7/volumes/kubernetes.io~projected/kube-api-access-pgzlc DeviceMajor:0 DeviceMinor:57 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-113 DeviceMajor:0 DeviceMinor:113 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2a263223-99a0-43f4-9e93-f9b990f7c57d/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:45 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/f8e6a0b5-f8b9-4d1b-848b-d3517004d495/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:248 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-398 DeviceMajor:0 DeviceMinor:398 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ea04eff886357b11cf3d1ec2d183d95053646a4314da7062299ed28005ad0805/userdata/shm DeviceMajor:0 DeviceMinor:205 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b45f036757b3fa6c88c3143507672dc50a6817a55c98e6c6f651301fe8063d60/userdata/shm DeviceMajor:0 DeviceMinor:252 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6e090e4165f5fd0997d74c74596c5e0c2232b822f8935dd2dbc3a0909b3848a7/userdata/shm DeviceMajor:0 DeviceMinor:54 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/9dbb1434-9e62-4d55-86a3-b7e4b469fb42/volumes/kubernetes.io~projected/kube-api-access-7q98x DeviceMajor:0 DeviceMinor:202 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-363 DeviceMajor:0 DeviceMinor:363 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-415 DeviceMajor:0 DeviceMinor:415 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15/volumes/kubernetes.io~projected/kube-api-access-l4c4m DeviceMajor:0 DeviceMinor:59 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/aaa2c55a85fa19ec7d9f6fda37f7ae5b5ab15db3dd4247c80128f87c35867318/userdata/shm DeviceMajor:0 DeviceMinor:250 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-265 DeviceMajor:0 DeviceMinor:265 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/bff203a8-2155-4ef1-9efd-b1a6d7e1eabe/volumes/kubernetes.io~secret/monitoring-plugin-cert DeviceMajor:0 DeviceMinor:331 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/558cdaf8-03cf-4d61-9c28-94a5da9c886d/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:48 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b9990fc470c4c5eaecdb9f9f238d04a4fbaf12c51705bb3594d8f19f3ea9592e/userdata/shm DeviceMajor:0 DeviceMinor:320 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-345 DeviceMajor:0 DeviceMinor:345 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-352 DeviceMajor:0 DeviceMinor:352 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/bff203a8-2155-4ef1-9efd-b1a6d7e1eabe/volumes/kubernetes.io~projected/kube-api-access-6h6hj DeviceMajor:0 DeviceMinor:328 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-138 DeviceMajor:0 DeviceMinor:138 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-217 DeviceMajor:0 DeviceMinor:217 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-230 DeviceMajor:0 DeviceMinor:230 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3569965a0eab278d33dbd724bd7339daf8cd2a3a85728be8a5d302ff0a190d12/userdata/shm DeviceMajor:0 DeviceMinor:413 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e736bfab51da96e2f687a517ac31db8f2d94e5f927f76c9663e6fca54c6c4deb/userdata/shm DeviceMajor:0 DeviceMinor:209 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d276266f-fed6-4266-89b3-c57743cc7179/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:315 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/558cdaf8-03cf-4d61-9c28-94a5da9c886d/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:47 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d276266f-fed6-4266-89b3-c57743cc7179/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:318 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/afcf5184d93f78966481a88ea7691e2090b6a8f9f0ab7a4ca078527971c2e337/userdata/shm DeviceMajor:0 DeviceMinor:334 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/503d3e0b79afafd0016e62422fd47acaa47a3af87cfade3ce2584debe4f580b3/userdata/shm DeviceMajor:0 DeviceMinor:341 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1aff1f9f-94a9-486f-a807-76b15fb88cfa/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:339 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-380 DeviceMajor:0 DeviceMinor:380 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8f3484d327ea71e9e63985577c9d822e7dcb62781278afdff46e58a3544a396f/userdata/shm DeviceMajor:0 DeviceMinor:411 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-375 DeviceMajor:0 DeviceMinor:375 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/731f7925-494b-4442-b5c4-8d2df9379896/volumes/kubernetes.io~projected/kube-api-access-q7pwz DeviceMajor:0 DeviceMinor:52 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/5b54f688-470c-4797-b685-8b9826e361a8/volumes/kubernetes.io~projected/kube-api-access-rc2kl DeviceMajor:0 DeviceMinor:56 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:201 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/f8e6a0b5-f8b9-4d1b-848b-d3517004d495/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:247 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/558cdaf8-03cf-4d61-9c28-94a5da9c886d/volumes/kubernetes.io~projected/kube-api-access-djtkk DeviceMajor:0 DeviceMinor:51 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/ff05c739-4a53-4cfe-942f-df41f812d742/volumes/kubernetes.io~projected/kube-api-access-px425 DeviceMajor:0 DeviceMinor:61 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-66 DeviceMajor:0 DeviceMinor:66 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2ed28bb0-f551-4b15-8d8e-04da752a23ec/volumes/kubernetes.io~secret/secret-metrics-server-client-certs DeviceMajor:0 DeviceMinor:325 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/1aff1f9f-94a9-486f-a807-76b15fb88cfa/volumes/kubernetes.io~projected/kube-api-access-94rml DeviceMajor:0 DeviceMinor:340 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1ebfc3569d1bfe6378defd79ab0685cf0c8953bc408127f5fdf6681b2dd1c4d0/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/fbe098f0e9731181351749c3d5456206f5e9289e5f2df036054281cc8a80596a/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8b58f599-6735-4461-8657-ef5abab78403/volumes/kubernetes.io~secret/openshift-state-metrics-tls DeviceMajor:0 DeviceMinor:236 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2ed28bb0-f551-4b15-8d8e-04da752a23ec/volumes/kubernetes.io~projected/kube-api-access-5twnn DeviceMajor:0 DeviceMinor:327 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d276266f-fed6-4266-89b3-c57743cc7179/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules DeviceMajor:0 DeviceMinor:316 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/dddfb0521c8b80b98845cd23cf30b4c62d2b673ec394c5ad3e467159aed185b2/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-134 DeviceMajor:0 DeviceMinor:134 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-332 DeviceMajor:0 DeviceMinor:332 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-358 DeviceMajor:0 DeviceMinor:358 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2b7ecfd3deee44f05899c495fab004c5ef09a329e99052207be967a096505354/userdata/shm DeviceMajor:0 DeviceMinor:409 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9dbb1434-9e62-4d55-86a3-b7e4b469fb42/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:197 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-219 DeviceMajor:0 DeviceMinor:219 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c03021d1-d458-46a8-af56-bfba0cc4b4b4/volumes/kubernetes.io~projected/kube-api-access-rpq4r DeviceMajor:0 DeviceMinor:408 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8b58f599-6735-4461-8657-ef5abab78403/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:240 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-215 DeviceMajor:0 DeviceMinor:215 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-279 DeviceMajor:0 DeviceMinor:279 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-351 DeviceMajor:0 DeviceMinor:351 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-417 DeviceMajor:0 DeviceMinor:417 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-419 DeviceMajor:0 DeviceMinor:419 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-268 DeviceMajor:0 DeviceMinor:268 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:53 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-64 DeviceMajor:0 DeviceMinor:64 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-147 DeviceMajor:0 DeviceMinor:147 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2a263223-99a0-43f4-9e93-f9b990f7c57d/volumes/kubernetes.io~projected/kube-api-access-4bbc2 DeviceMajor:0 DeviceMinor:204 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-109 DeviceMajor:0 DeviceMinor:109 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d276266f-fed6-4266-89b3-c57743cc7179/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics DeviceMajor:0 DeviceMinor:317 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/ff05c739-4a53-4cfe-942f-df41f812d742/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:403 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-94 DeviceMajor:0 DeviceMinor:94 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d276266f-fed6-4266-89b3-c57743cc7179/volumes/kubernetes.io~projected/kube-api-access-xvz67 DeviceMajor:0 DeviceMinor:310 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-429 DeviceMajor:0 DeviceMinor:429 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-304 DeviceMajor:0 DeviceMinor:304 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-386 DeviceMajor:0 DeviceMinor:386 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/437fc0dd-7f5a-4e18-8252-810aab07ff3c/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:242 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/437fc0dd-7f5a-4e18-8252-810aab07ff3c/volumes/kubernetes.io~projected/kube-api-access-kbn9c DeviceMajor:0 DeviceMinor:244 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d276266f-fed6-4266-89b3-c57743cc7179/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy DeviceMajor:0 DeviceMinor:314 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/1aff1f9f-94a9-486f-a807-76b15fb88cfa/volumes/kubernetes.io~secret/secret-telemeter-client DeviceMajor:0 DeviceMinor:336 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-392 DeviceMajor:0 DeviceMinor:392 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f8e6a0b5-f8b9-4d1b-848b-d3517004d495/volumes/kubernetes.io~projected/kube-api-access-sc7fm DeviceMajor:0 DeviceMinor:249 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-284 DeviceMajor:0 DeviceMinor:284 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d276266f-fed6-4266-89b3-c57743cc7179/volumes/kubernetes.io~secret/secret-thanos-querier-tls DeviceMajor:0 DeviceMinor:319 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-365 DeviceMajor:0 DeviceMinor:365 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c705cd89-a6cf-4dcf-88b5-5ff2da580f07/volumes/kubernetes.io~projected/kube-api-access-hk9zl DeviceMajor:0 DeviceMinor:50 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/2ed28bb0-f551-4b15-8d8e-04da752a23ec/volumes/kubernetes.io~secret/secret-metrics-server-tls DeviceMajor:0 DeviceMinor:326 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-370 DeviceMajor:0 DeviceMinor:370 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/45277ab15e1401d38b64135ca5501ccf8f8abe08fd8499494a6c4398d227f2ef/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/cc75ecdda2d02d96a405b1324a5d8bbbdb344821cf453edf9371a4e06851db0b/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b290572b501567db428c0dbfb6aa0a1e0464a75a5d2d732421ddaba91f3a965e/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/8b58f599-6735-4461-8657-ef5abab78403/volumes/kubernetes.io~projected/kube-api-access-hcp9h DeviceMajor:0 DeviceMinor:241 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/437fc0dd-7f5a-4e18-8252-810aab07ff3c/volumes/kubernetes.io~secret/kube-state-metrics-tls DeviceMajor:0 DeviceMinor:243 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7f253d41761290dc6a934bc44aeabf58bd435de2c9171d88ada2371b769c7c2b/userdata/shm DeviceMajor:0 DeviceMinor:329 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/1aff1f9f-94a9-486f-a807-76b15fb88cfa/volumes/kubernetes.io~secret/telemeter-client-tls DeviceMajor:0 DeviceMinor:337 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-272 DeviceMajor:0 DeviceMinor:272 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-300 DeviceMajor:0 DeviceMinor:300 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-322 DeviceMajor:0 DeviceMinor:322 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/05f90c13-3432-4e94-b368-66226fa6ff26/volumes/kubernetes.io~projected/kube-api-access-djxm4 DeviceMajor:0 DeviceMinor:58 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/79843809-80ac-4069-b436-ba1a26348505/volumes/kubernetes.io~projected/kube-api-access-lwd27 DeviceMajor:0 DeviceMinor:60 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-213 DeviceMajor:0 DeviceMinor:213 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7a4360c82ba695803be781b41ca0cf014fd2d869d94d3c48c5a587dcf5b8b24b/userdata/shm DeviceMajor:0 DeviceMinor:91 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-153 DeviceMajor:0 DeviceMinor:153 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8/volumes/kubernetes.io~projected/kube-api-access-dcq5p DeviceMajor:0 DeviceMinor:203 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/2ed28bb0-f551-4b15-8d8e-04da752a23ec/volumes/kubernetes.io~secret/client-ca-bundle DeviceMajor:0 DeviceMinor:324 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/61443f19b06c5174067ac167c131cad07f3b1838b1262c254275ef6de87a36a3/userdata/shm DeviceMajor:0 DeviceMinor:55 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-225 DeviceMajor:0 DeviceMinor:225 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-254 DeviceMajor:0 DeviceMinor:254 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-289 DeviceMajor:0 DeviceMinor:289 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9a77497b-33c1-4ac2-bfba-58b6edcf871e/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:407 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-434 DeviceMajor:0 DeviceMinor:434 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-211 DeviceMajor:0 DeviceMinor:211 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-295 DeviceMajor:0 DeviceMinor:295 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1aff1f9f-94a9-486f-a807-76b15fb88cfa/volumes/kubernetes.io~secret/federate-client-tls DeviceMajor:0 DeviceMinor:338 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-343 DeviceMajor:0 DeviceMinor:343 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-421 DeviceMajor:0 DeviceMinor:421 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-423 DeviceMajor:0 DeviceMinor:423 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/01b46fcdb5fd050f0a7da2d941718e1004eaab21d114e64acecc68e1fbb59c1e/userdata/shm DeviceMajor:0 DeviceMinor:80 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9ce77a411ccd220fbc6ba34a25e9f6e8a7360339a4c2ad6d59ac9f70bf9c6ea1/userdata/shm DeviceMajor:0 DeviceMinor:207 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8efcb5a5b85d2078c44d199766b6e88735990eadb1f706f241a7f4e27f5ebe87/userdata/shm DeviceMajor:0 DeviceMinor:245 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/0027996b-31d7-474a-88e9-efc0b6032300/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:49 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:2b7ecfd3deee44f MacAddress:4a:c2:af:fa:74:b5 Speed:10000 Mtu:8901} {Name:3569965a0eab278 MacAddress:42:16:30:1b:e0:0b Speed:10000 Mtu:8901} {Name:503d3e0b79afafd MacAddress:b6:37:c1:ea:a2:d1 Speed:10000 Mtu:8901} {Name:7f253d41761290d MacAddress:1e:70:6d:28:89:f0 Speed:10000 Mtu:8901} {Name:8efcb5a5b85d207 MacAddress:ea:c4:fa:b7:b6:73 Speed:10000 Mtu:8901} {Name:8f3484d327ea71e MacAddress:9e:45:17:a0:5d:f8 Speed:10000 Mtu:8901} {Name:9ce77a411ccd220 MacAddress:ce:21:b4:00:c0:67 Speed:10000 Mtu:8901} {Name:aaa2c55a85fa19e MacAddress:2a:58:1a:39:d3:80 Speed:10000 Mtu:8901} {Name:afcf5184d93f789 MacAddress:32:66:ad:3f:fc:ce Speed:10000 Mtu:8901} {Name:b9990fc470c4c5e MacAddress:02:e6:74:74:e3:fe Speed:10000 Mtu:8901} {Name:br-ex MacAddress:06:ff:f7:c9:c0:75 Speed:0 Mtu:9001} {Name:br-int MacAddress:0a:02:a9:7c:fc:a3 Speed:0 Mtu:8901} {Name:e736bfab51da96e MacAddress:72:5b:cc:07:9a:c6 Speed:10000 Mtu:8901} {Name:ea04eff886357b1 MacAddress:92:bf:a0:29:3e:f7 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:06:ff:f7:c9:c0:75 Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:66:13:ce:bd:56:d7 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:86:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:b6:ac:0e:a3:37:bd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164337152 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 02 08:06:50.300787 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.300364    6210 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 02 08:06:50.300787 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.300405    6210 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 02 08:06:50.300787 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.300641    6210 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 02 08:06:50.300787 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.300657    6210 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-235.us-west-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 02 08:06:50.300787 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.300777    6210 topology_manager.go:143] "Creating topology manager with none policy"
Nov 02 08:06:50.300787 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.300785    6210 container_manager_linux.go:311] "Creating device plugin manager"
Nov 02 08:06:50.301145 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.300796    6210 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 02 08:06:50.301145 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.300815    6210 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 02 08:06:50.301145 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.300908    6210 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 02 08:06:50.301145 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.301066    6210 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 02 08:06:50.302426 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.301392    6210 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 02 08:06:50.302426 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.301473    6210 kubelet.go:493] "Attempting to sync node with API server"
Nov 02 08:06:50.302426 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.301495    6210 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 02 08:06:50.302426 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.301518    6210 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 02 08:06:50.302426 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.301536    6210 kubelet.go:405] "Adding apiserver pod source"
Nov 02 08:06:50.302426 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.301563    6210 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 02 08:06:50.302896 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.302863    6210 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 02 08:06:50.302937 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.302901    6210 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 02 08:06:50.303356 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.303334    6210 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 02 08:06:50.305955 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.305940    6210 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 02 08:06:50.305955 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.305953    6210 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 02 08:06:50.306076 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.306048    6210 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Nov 02 08:06:50.306229 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.306218    6210 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 02 08:06:50.306260 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.306246    6210 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 02 08:06:50.306335 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.306327    6210 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 02 08:06:50.306369 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.306341    6210 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 02 08:06:50.306369 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.306348    6210 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 02 08:06:50.306369 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.306353    6210 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 02 08:06:50.306369 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.306358    6210 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 02 08:06:50.306369 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.306365    6210 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 02 08:06:50.306499 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.306371    6210 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 02 08:06:50.306499 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.306377    6210 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 02 08:06:50.306499 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.306383    6210 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 02 08:06:50.306499 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.306389    6210 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 02 08:06:50.306499 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.306397    6210 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 02 08:06:50.306499 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.306406    6210 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 02 08:06:50.306499 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.306429    6210 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 02 08:06:50.306499 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.306435    6210 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 02 08:06:50.309724 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.309712    6210 server.go:1263] "Started kubelet"
Nov 02 08:06:50.310098 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.309802    6210 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 02 08:06:50.310098 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.309814    6210 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 02 08:06:50.310098 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.309921    6210 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 02 08:06:50.310292 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.310263    6210 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 02 08:06:50.310315 ip-10-0-135-235 systemd[1]: Started Kubernetes Kubelet.
Nov 02 08:06:50.311324 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.311308    6210 server.go:317] "Adding debug handlers to kubelet server"
Nov 02 08:06:50.314931 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.314719    6210 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 02 08:06:50.316003 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:06:50.315970    6210 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-235.us-west-2.compute.internal\" not found"
Nov 02 08:06:50.316003 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.315994    6210 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 02 08:06:50.317724 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.317209    6210 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 02 08:06:50.317724 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.317221    6210 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 02 08:06:50.317724 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.317198    6210 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-01 08:00:39 +0000 UTC" deadline="2028-06-07 11:24:50.88100941 +0000 UTC"
Nov 02 08:06:50.317724 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.317249    6210 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13995h18m0.563764565s"
Nov 02 08:06:50.317724 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.317278    6210 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 02 08:06:50.318777 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.318690    6210 factory.go:55] Registering systemd factory
Nov 02 08:06:50.318777 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.318712    6210 factory.go:223] Registration of the systemd container factory successfully
Nov 02 08:06:50.319747 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.319001    6210 factory.go:153] Registering CRI-O factory
Nov 02 08:06:50.319747 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.319022    6210 factory.go:223] Registration of the crio container factory successfully
Nov 02 08:06:50.319747 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.319070    6210 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 02 08:06:50.319747 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.319089    6210 factory.go:103] Registering Raw factory
Nov 02 08:06:50.319747 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.319114    6210 manager.go:1199] Started watching for new ooms in manager
Nov 02 08:06:50.319747 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.319471    6210 manager.go:319] Starting recovery of all containers
Nov 02 08:06:50.320535 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.320485    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="05f90c13-3432-4e94-b368-66226fa6ff26" volumeName="kubernetes.io/projected/05f90c13-3432-4e94-b368-66226fa6ff26-kube-api-access-djxm4" seLinuxMountContext=""
Nov 02 08:06:50.320641 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.320539    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1aff1f9f-94a9-486f-a807-76b15fb88cfa" volumeName="kubernetes.io/configmap/1aff1f9f-94a9-486f-a807-76b15fb88cfa-metrics-client-ca" seLinuxMountContext=""
Nov 02 08:06:50.320641 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.320554    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2ed28bb0-f551-4b15-8d8e-04da752a23ec" volumeName="kubernetes.io/configmap/2ed28bb0-f551-4b15-8d8e-04da752a23ec-configmap-kubelet-serving-ca-bundle" seLinuxMountContext=""
Nov 02 08:06:50.320641 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.320569    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="437fc0dd-7f5a-4e18-8252-810aab07ff3c" volumeName="kubernetes.io/configmap/437fc0dd-7f5a-4e18-8252-810aab07ff3c-metrics-client-ca" seLinuxMountContext=""
Nov 02 08:06:50.320641 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.320580    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c03021d1-d458-46a8-af56-bfba0cc4b4b4" volumeName="kubernetes.io/projected/c03021d1-d458-46a8-af56-bfba0cc4b4b4-kube-api-access-rpq4r" seLinuxMountContext=""
Nov 02 08:06:50.320641 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.320593    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f8e6a0b5-f8b9-4d1b-848b-d3517004d495" volumeName="kubernetes.io/empty-dir/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-node-exporter-textfile" seLinuxMountContext=""
Nov 02 08:06:50.320641 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.320603    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f8e6a0b5-f8b9-4d1b-848b-d3517004d495" volumeName="kubernetes.io/secret/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-node-exporter-kube-rbac-proxy-config" seLinuxMountContext=""
Nov 02 08:06:50.320641 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.320614    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ff05c739-4a53-4cfe-942f-df41f812d742" volumeName="kubernetes.io/secret/ff05c739-4a53-4cfe-942f-df41f812d742-metrics-certs" seLinuxMountContext=""
Nov 02 08:06:50.320641 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.320630    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0027996b-31d7-474a-88e9-efc0b6032300" volumeName="kubernetes.io/configmap/0027996b-31d7-474a-88e9-efc0b6032300-konnectivity-ca" seLinuxMountContext=""
Nov 02 08:06:50.320641 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.320641    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="05f90c13-3432-4e94-b368-66226fa6ff26" volumeName="kubernetes.io/configmap/05f90c13-3432-4e94-b368-66226fa6ff26-cni-binary-copy" seLinuxMountContext=""
Nov 02 08:06:50.321047 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.320655    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e7ae74c-fcd8-4820-a8b7-769a5fff9f15" volumeName="kubernetes.io/secret/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-ovn-node-metrics-cert" seLinuxMountContext=""
Nov 02 08:06:50.321047 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.320667    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8b58f599-6735-4461-8657-ef5abab78403" volumeName="kubernetes.io/configmap/8b58f599-6735-4461-8657-ef5abab78403-metrics-client-ca" seLinuxMountContext=""
Nov 02 08:06:50.321047 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.320698    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d276266f-fed6-4266-89b3-c57743cc7179" volumeName="kubernetes.io/empty-dir/d276266f-fed6-4266-89b3-c57743cc7179-tmp" seLinuxMountContext=""
Nov 02 08:06:50.321047 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.320709    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0027996b-31d7-474a-88e9-efc0b6032300" volumeName="kubernetes.io/secret/0027996b-31d7-474a-88e9-efc0b6032300-agent-certs" seLinuxMountContext=""
Nov 02 08:06:50.321047 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.320725    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1aff1f9f-94a9-486f-a807-76b15fb88cfa" volumeName="kubernetes.io/configmap/1aff1f9f-94a9-486f-a807-76b15fb88cfa-serving-certs-ca-bundle" seLinuxMountContext=""
Nov 02 08:06:50.321047 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.320736    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1aff1f9f-94a9-486f-a807-76b15fb88cfa" volumeName="kubernetes.io/configmap/1aff1f9f-94a9-486f-a807-76b15fb88cfa-telemeter-trusted-ca-bundle" seLinuxMountContext=""
Nov 02 08:06:50.321047 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.320747    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8b58f599-6735-4461-8657-ef5abab78403" volumeName="kubernetes.io/projected/8b58f599-6735-4461-8657-ef5abab78403-kube-api-access-hcp9h" seLinuxMountContext=""
Nov 02 08:06:50.321047 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.320759    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8b58f599-6735-4461-8657-ef5abab78403" volumeName="kubernetes.io/secret/8b58f599-6735-4461-8657-ef5abab78403-openshift-state-metrics-kube-rbac-proxy-config" seLinuxMountContext=""
Nov 02 08:06:50.321047 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.320791    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="05f90c13-3432-4e94-b368-66226fa6ff26" volumeName="kubernetes.io/configmap/05f90c13-3432-4e94-b368-66226fa6ff26-whereabouts-flatfile-configmap" seLinuxMountContext=""
Nov 02 08:06:50.321047 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.320805    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2ed28bb0-f551-4b15-8d8e-04da752a23ec" volumeName="kubernetes.io/empty-dir/2ed28bb0-f551-4b15-8d8e-04da752a23ec-audit-log" seLinuxMountContext=""
Nov 02 08:06:50.321047 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.320818    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="437fc0dd-7f5a-4e18-8252-810aab07ff3c" volumeName="kubernetes.io/projected/437fc0dd-7f5a-4e18-8252-810aab07ff3c-kube-api-access-kbn9c" seLinuxMountContext=""
Nov 02 08:06:50.321047 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.320831    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bff203a8-2155-4ef1-9efd-b1a6d7e1eabe" volumeName="kubernetes.io/secret/bff203a8-2155-4ef1-9efd-b1a6d7e1eabe-monitoring-plugin-cert" seLinuxMountContext=""
Nov 02 08:06:50.321047 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.320843    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d276266f-fed6-4266-89b3-c57743cc7179" volumeName="kubernetes.io/secret/d276266f-fed6-4266-89b3-c57743cc7179-secret-thanos-querier-kube-rbac-proxy" seLinuxMountContext=""
Nov 02 08:06:50.321047 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.320856    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2a263223-99a0-43f4-9e93-f9b990f7c57d" volumeName="kubernetes.io/projected/2a263223-99a0-43f4-9e93-f9b990f7c57d-kube-api-access-4bbc2" seLinuxMountContext=""
Nov 02 08:06:50.321047 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.320869    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="437fc0dd-7f5a-4e18-8252-810aab07ff3c" volumeName="kubernetes.io/secret/437fc0dd-7f5a-4e18-8252-810aab07ff3c-kube-state-metrics-kube-rbac-proxy-config" seLinuxMountContext=""
Nov 02 08:06:50.321047 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.320896    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="558cdaf8-03cf-4d61-9c28-94a5da9c886d" volumeName="kubernetes.io/projected/558cdaf8-03cf-4d61-9c28-94a5da9c886d-kube-api-access-djtkk" seLinuxMountContext=""
Nov 02 08:06:50.321047 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.320908    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5b54f688-470c-4797-b685-8b9826e361a8" volumeName="kubernetes.io/projected/5b54f688-470c-4797-b685-8b9826e361a8-kube-api-access-rc2kl" seLinuxMountContext=""
Nov 02 08:06:50.321047 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.320921    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="79843809-80ac-4069-b436-ba1a26348505" volumeName="kubernetes.io/projected/79843809-80ac-4069-b436-ba1a26348505-kube-api-access-lwd27" seLinuxMountContext=""
Nov 02 08:06:50.321047 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.320951    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bff203a8-2155-4ef1-9efd-b1a6d7e1eabe" volumeName="kubernetes.io/projected/bff203a8-2155-4ef1-9efd-b1a6d7e1eabe-kube-api-access-6h6hj" seLinuxMountContext=""
Nov 02 08:06:50.321047 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.320962    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c705cd89-a6cf-4dcf-88b5-5ff2da580f07" volumeName="kubernetes.io/configmap/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-multus-daemon-config" seLinuxMountContext=""
Nov 02 08:06:50.321047 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.320973    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8" volumeName="kubernetes.io/projected/cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8-kube-api-access-dcq5p" seLinuxMountContext=""
Nov 02 08:06:50.321047 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.320984    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2ed28bb0-f551-4b15-8d8e-04da752a23ec" volumeName="kubernetes.io/configmap/2ed28bb0-f551-4b15-8d8e-04da752a23ec-metrics-server-audit-profiles" seLinuxMountContext=""
Nov 02 08:06:50.321047 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321005    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2ed28bb0-f551-4b15-8d8e-04da752a23ec" volumeName="kubernetes.io/secret/2ed28bb0-f551-4b15-8d8e-04da752a23ec-client-ca-bundle" seLinuxMountContext=""
Nov 02 08:06:50.321047 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321016    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="437fc0dd-7f5a-4e18-8252-810aab07ff3c" volumeName="kubernetes.io/empty-dir/437fc0dd-7f5a-4e18-8252-810aab07ff3c-volume-directive-shadow" seLinuxMountContext=""
Nov 02 08:06:50.321047 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321027    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="731f7925-494b-4442-b5c4-8d2df9379896" volumeName="kubernetes.io/projected/731f7925-494b-4442-b5c4-8d2df9379896-kube-api-access-q7pwz" seLinuxMountContext=""
Nov 02 08:06:50.321047 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321039    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9dbb1434-9e62-4d55-86a3-b7e4b469fb42" volumeName="kubernetes.io/empty-dir/9dbb1434-9e62-4d55-86a3-b7e4b469fb42-tmp-dir" seLinuxMountContext=""
Nov 02 08:06:50.321047 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321049    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d276266f-fed6-4266-89b3-c57743cc7179" volumeName="kubernetes.io/projected/d276266f-fed6-4266-89b3-c57743cc7179-kube-api-access-xvz67" seLinuxMountContext=""
Nov 02 08:06:50.321047 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321061    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d276266f-fed6-4266-89b3-c57743cc7179" volumeName="kubernetes.io/secret/d276266f-fed6-4266-89b3-c57743cc7179-secret-grpc-tls" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321074    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d276266f-fed6-4266-89b3-c57743cc7179" volumeName="kubernetes.io/secret/d276266f-fed6-4266-89b3-c57743cc7179-secret-thanos-querier-kube-rbac-proxy-metrics" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321086    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1aff1f9f-94a9-486f-a807-76b15fb88cfa" volumeName="kubernetes.io/secret/1aff1f9f-94a9-486f-a807-76b15fb88cfa-telemeter-client-tls" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321097    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1aff1f9f-94a9-486f-a807-76b15fb88cfa" volumeName="kubernetes.io/secret/1aff1f9f-94a9-486f-a807-76b15fb88cfa-federate-client-tls" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321109    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="437fc0dd-7f5a-4e18-8252-810aab07ff3c" volumeName="kubernetes.io/secret/437fc0dd-7f5a-4e18-8252-810aab07ff3c-kube-state-metrics-tls" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321120    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c705cd89-a6cf-4dcf-88b5-5ff2da580f07" volumeName="kubernetes.io/configmap/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-cni-binary-copy" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321132    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8" volumeName="kubernetes.io/secret/cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8-insights-runtime-extractor-tls" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321144    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d276266f-fed6-4266-89b3-c57743cc7179" volumeName="kubernetes.io/secret/d276266f-fed6-4266-89b3-c57743cc7179-secret-thanos-querier-kube-rbac-proxy-rules" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321155    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f8e6a0b5-f8b9-4d1b-848b-d3517004d495" volumeName="kubernetes.io/projected/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-kube-api-access-sc7fm" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321166    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f8e6a0b5-f8b9-4d1b-848b-d3517004d495" volumeName="kubernetes.io/secret/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-node-exporter-tls" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321177    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1aff1f9f-94a9-486f-a807-76b15fb88cfa" volumeName="kubernetes.io/projected/1aff1f9f-94a9-486f-a807-76b15fb88cfa-kube-api-access-94rml" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321191    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2a263223-99a0-43f4-9e93-f9b990f7c57d" volumeName="kubernetes.io/secret/2a263223-99a0-43f4-9e93-f9b990f7c57d-cert" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321206    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5b54f688-470c-4797-b685-8b9826e361a8" volumeName="kubernetes.io/empty-dir/5b54f688-470c-4797-b685-8b9826e361a8-tmp-dir" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321219    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c705cd89-a6cf-4dcf-88b5-5ff2da580f07" volumeName="kubernetes.io/projected/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-kube-api-access-hk9zl" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321232    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d276266f-fed6-4266-89b3-c57743cc7179" volumeName="kubernetes.io/configmap/d276266f-fed6-4266-89b3-c57743cc7179-metrics-client-ca" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321244    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d276266f-fed6-4266-89b3-c57743cc7179" volumeName="kubernetes.io/secret/d276266f-fed6-4266-89b3-c57743cc7179-secret-thanos-querier-tls" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321267    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2ed28bb0-f551-4b15-8d8e-04da752a23ec" volumeName="kubernetes.io/secret/2ed28bb0-f551-4b15-8d8e-04da752a23ec-secret-metrics-server-client-certs" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321278    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e7ae74c-fcd8-4820-a8b7-769a5fff9f15" volumeName="kubernetes.io/configmap/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-ovnkube-config" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321289    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="558cdaf8-03cf-4d61-9c28-94a5da9c886d" volumeName="kubernetes.io/empty-dir/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-tuned" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321310    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d220536b-9c7c-4e34-8ac0-3c25ab4975f7" volumeName="kubernetes.io/projected/d220536b-9c7c-4e34-8ac0-3c25ab4975f7-kube-api-access-pgzlc" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321322    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="79843809-80ac-4069-b436-ba1a26348505" volumeName="kubernetes.io/configmap/79843809-80ac-4069-b436-ba1a26348505-iptables-alerter-script" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321333    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8b58f599-6735-4461-8657-ef5abab78403" volumeName="kubernetes.io/secret/8b58f599-6735-4461-8657-ef5abab78403-openshift-state-metrics-tls" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321343    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9dbb1434-9e62-4d55-86a3-b7e4b469fb42" volumeName="kubernetes.io/secret/9dbb1434-9e62-4d55-86a3-b7e4b469fb42-metrics-tls" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321355    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8" volumeName="kubernetes.io/configmap/cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8-kube-rbac-proxy-cm" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321365    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d276266f-fed6-4266-89b3-c57743cc7179" volumeName="kubernetes.io/secret/d276266f-fed6-4266-89b3-c57743cc7179-secret-thanos-querier-kube-rbac-proxy-web" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321379    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f8e6a0b5-f8b9-4d1b-848b-d3517004d495" volumeName="kubernetes.io/configmap/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-metrics-client-ca" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321391    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2ed28bb0-f551-4b15-8d8e-04da752a23ec" volumeName="kubernetes.io/secret/2ed28bb0-f551-4b15-8d8e-04da752a23ec-secret-metrics-server-tls" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321404    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e7ae74c-fcd8-4820-a8b7-769a5fff9f15" volumeName="kubernetes.io/configmap/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-env-overrides" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321415    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e7ae74c-fcd8-4820-a8b7-769a5fff9f15" volumeName="kubernetes.io/projected/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-kube-api-access-l4c4m" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321426    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9dbb1434-9e62-4d55-86a3-b7e4b469fb42" volumeName="kubernetes.io/projected/9dbb1434-9e62-4d55-86a3-b7e4b469fb42-kube-api-access-7q98x" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321437    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8" volumeName="kubernetes.io/empty-dir/cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8-data-volume" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321449    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f8e6a0b5-f8b9-4d1b-848b-d3517004d495" volumeName="kubernetes.io/configmap/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-node-exporter-accelerators-collector-config" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321462    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1aff1f9f-94a9-486f-a807-76b15fb88cfa" volumeName="kubernetes.io/secret/1aff1f9f-94a9-486f-a807-76b15fb88cfa-secret-telemeter-client" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321475    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ff05c739-4a53-4cfe-942f-df41f812d742" volumeName="kubernetes.io/projected/ff05c739-4a53-4cfe-942f-df41f812d742-kube-api-access-px425" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321488    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="05f90c13-3432-4e94-b368-66226fa6ff26" volumeName="kubernetes.io/configmap/05f90c13-3432-4e94-b368-66226fa6ff26-cni-sysctl-allowlist" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321500    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1aff1f9f-94a9-486f-a807-76b15fb88cfa" volumeName="kubernetes.io/secret/1aff1f9f-94a9-486f-a807-76b15fb88cfa-secret-telemeter-client-kube-rbac-proxy-config" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321511    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="558cdaf8-03cf-4d61-9c28-94a5da9c886d" volumeName="kubernetes.io/empty-dir/558cdaf8-03cf-4d61-9c28-94a5da9c886d-tmp" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321524    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9dbb1434-9e62-4d55-86a3-b7e4b469fb42" volumeName="kubernetes.io/configmap/9dbb1434-9e62-4d55-86a3-b7e4b469fb42-config-volume" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321537    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d220536b-9c7c-4e34-8ac0-3c25ab4975f7" volumeName="kubernetes.io/configmap/d220536b-9c7c-4e34-8ac0-3c25ab4975f7-serviceca" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321549    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2ed28bb0-f551-4b15-8d8e-04da752a23ec" volumeName="kubernetes.io/projected/2ed28bb0-f551-4b15-8d8e-04da752a23ec-kube-api-access-5twnn" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321560    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e7ae74c-fcd8-4820-a8b7-769a5fff9f15" volumeName="kubernetes.io/configmap/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-ovnkube-script-lib" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321570    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="437fc0dd-7f5a-4e18-8252-810aab07ff3c" volumeName="kubernetes.io/configmap/437fc0dd-7f5a-4e18-8252-810aab07ff3c-kube-state-metrics-custom-resource-state-configmap" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321582    6210 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9a77497b-33c1-4ac2-bfba-58b6edcf871e" volumeName="kubernetes.io/secret/9a77497b-33c1-4ac2-bfba-58b6edcf871e-original-pull-secret" seLinuxMountContext=""
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321606    6210 reconstruct.go:97] "Volume reconstruction finished"
Nov 02 08:06:50.321865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.321613    6210 reconciler.go:29] "Reconciler: start to sync state"
Nov 02 08:06:50.343306 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.343273    6210 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 02 08:06:50.344639 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.344617    6210 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 02 08:06:50.344756 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.344645    6210 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 02 08:06:50.344756 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.344666    6210 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 02 08:06:50.344756 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:06:50.344727    6210 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Nov 02 08:06:50.345964 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.345941    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb77f_3e7ae74c-fcd8-4820-a8b7-769a5fff9f15/ovn-acl-logging/0.log"
Nov 02 08:06:50.348835 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.348809    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb77f_3e7ae74c-fcd8-4820-a8b7-769a5fff9f15/ovn-acl-logging/0.log"
Nov 02 08:06:50.353740 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.353721    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb77f_3e7ae74c-fcd8-4820-a8b7-769a5fff9f15/ovn-acl-logging/0.log"
Nov 02 08:06:50.354155 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.354128    6210 generic.go:356] "Generic (PLEG): container finished" podID="3e7ae74c-fcd8-4820-a8b7-769a5fff9f15" containerID="64e9f0396d8fd3a93e130bb9540f9a52b2f6009eecad42bd40bb370eff0f9e74" exitCode=1
Nov 02 08:06:50.366918 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.366868    6210 generic.go:356] "Generic (PLEG): container finished" podID="05f90c13-3432-4e94-b368-66226fa6ff26" containerID="df153442f34cf136d04ea692024f71fb8e469d7fcb7eb31a3abb23bf4bbb9c24" exitCode=0
Nov 02 08:06:50.366918 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.366915    6210 generic.go:356] "Generic (PLEG): container finished" podID="05f90c13-3432-4e94-b368-66226fa6ff26" containerID="b4f10e6dcc44bc1114e28f7460bf83844bb26ad5279b02a1b2e4462a6f6e34f7" exitCode=0
Nov 02 08:06:50.367049 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.366925    6210 generic.go:356] "Generic (PLEG): container finished" podID="05f90c13-3432-4e94-b368-66226fa6ff26" containerID="29be0744f4609c45a46121dc3795edcd3978e977f6533a742add759aa6b9bfd7" exitCode=0
Nov 02 08:06:50.367049 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.366934    6210 generic.go:356] "Generic (PLEG): container finished" podID="05f90c13-3432-4e94-b368-66226fa6ff26" containerID="7a606672ef16b1abf66973bd8d1469e67af0d77ee6155e81b73bbe49cf49d477" exitCode=0
Nov 02 08:06:50.367049 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.366942    6210 generic.go:356] "Generic (PLEG): container finished" podID="05f90c13-3432-4e94-b368-66226fa6ff26" containerID="1dd371729015a9625ef16911ec923e192b09d8b26c24cee2e956c5be89040665" exitCode=0
Nov 02 08:06:50.367049 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.366948    6210 generic.go:356] "Generic (PLEG): container finished" podID="05f90c13-3432-4e94-b368-66226fa6ff26" containerID="4325d77f3622b6cffc8d2ae0798c015f1876d9c6db3751142c8fcbb86ae248a7" exitCode=0
Nov 02 08:06:50.370967 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.370941    6210 generic.go:356] "Generic (PLEG): container finished" podID="8a70872874f68c480b6b252a06401797" containerID="e8c1e351c48cb912e17501c29531601a7158ce63a2dae3d206bf6592f2213636" exitCode=0
Nov 02 08:06:50.373181 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.373157    6210 generic.go:356] "Generic (PLEG): container finished" podID="f8e6a0b5-f8b9-4d1b-848b-d3517004d495" containerID="e7c7d6b4cee5098d3348008fd4fe4f188fbb9eb4ca33600caf43b886e88aeb96" exitCode=0
Nov 02 08:06:50.416065 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:06:50.416042    6210 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-235.us-west-2.compute.internal\" not found"
Nov 02 08:06:50.426685 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.426665    6210 manager.go:324] Recovery completed
Nov 02 08:06:50.445222 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:06:50.445152    6210 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Nov 02 08:06:50.447497 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.447477    6210 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 08:06:50.449571 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.449548    6210 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-235.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 08:06:50.449649 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.449581    6210 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-235.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 08:06:50.449649 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.449595    6210 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-235.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 08:06:50.452439 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.452414    6210 cpu_manager.go:226] "Starting" policy="none"
Nov 02 08:06:50.452439 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.452437    6210 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 02 08:06:50.452539 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.452454    6210 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 02 08:06:50.452539 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.452425    6210 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 08:06:50.452607 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.452563    6210 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Nov 02 08:06:50.452607 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.452574    6210 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Nov 02 08:06:50.452607 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.452591    6210 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Nov 02 08:06:50.452607 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.452599    6210 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Nov 02 08:06:50.452607 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.452606    6210 policy_none.go:50] "Start"
Nov 02 08:06:50.452742 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.452615    6210 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 02 08:06:50.452742 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.452625    6210 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 02 08:06:50.452798 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.452789    6210 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Nov 02 08:06:50.452798 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.452796    6210 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Nov 02 08:06:50.452855 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.452802    6210 policy_none.go:44] "Start"
Nov 02 08:06:50.453325 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.453309    6210 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-235.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 08:06:50.453380 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.453338    6210 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-235.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 08:06:50.453380 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.453349    6210 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-235.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 08:06:50.457387 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.457365    6210 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 02 08:06:50.459971 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.459957    6210 manager.go:341] "Starting Device Plugin manager"
Nov 02 08:06:50.460043 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:06:50.459980    6210 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 02 08:06:50.460043 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.459989    6210 server.go:87] "Starting device plugin registration server"
Nov 02 08:06:50.460235 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.460224    6210 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 02 08:06:50.460268 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.460235    6210 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 02 08:06:50.460338 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.460320    6210 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 02 08:06:50.460455 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.460422    6210 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 02 08:06:50.460514 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.460467    6210 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 02 08:06:50.460514 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.460473    6210 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 02 08:06:50.460598 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.460526    6210 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-02T08:06:50.46045561Z","UUID":"684e1802-8954-41f8-811b-da128c3c5898","Handler":null,"Name":"","Endpoint":""}
Nov 02 08:06:50.462391 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:06:50.462373    6210 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 02 08:06:50.462507 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:06:50.462412    6210 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-235.us-west-2.compute.internal\" not found"
Nov 02 08:06:50.463191 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.463170    6210 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 02 08:06:50.463266 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.463202    6210 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 02 08:06:50.499114 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.499084    6210 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 08:06:50.499114 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.499085    6210 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 08:06:50.499291 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.499172    6210 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Nov 02 08:06:50.500068 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.500054    6210 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 08:06:50.560898 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.560844    6210 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 08:06:50.561920 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.561904    6210 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-235.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 08:06:50.561992 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.561934    6210 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-235.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 08:06:50.561992 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.561944    6210 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-235.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 08:06:50.561992 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.561987    6210 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:06:50.591970 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.591949    6210 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 08:06:50.645841 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.645797    6210 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-235.us-west-2.compute.internal"]
Nov 02 08:06:50.648629 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.646948    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal" event={"ID":"8a70872874f68c480b6b252a06401797","Type":"ContainerStarted","Data":"3ec24be3851c8f88eeacb344f71df57396299a64644c1451f16019f57c63b2f8"}
Nov 02 08:06:50.648629 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.647019    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal" event={"ID":"8a70872874f68c480b6b252a06401797","Type":"ContainerDied","Data":"e8c1e351c48cb912e17501c29531601a7158ce63a2dae3d206bf6592f2213636"}
Nov 02 08:06:50.648629 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.647049    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal" event={"ID":"8a70872874f68c480b6b252a06401797","Type":"ContainerStarted","Data":"61443f19b06c5174067ac167c131cad07f3b1838b1262c254275ef6de87a36a3"}
Nov 02 08:06:50.648629 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.647093    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.us-west-2.compute.internal" event={"ID":"5efd6818a2d6de09c2e33ba0444837d8","Type":"ContainerStarted","Data":"5401020d53e52925f8e344a09e9479afbbf4d3264484fe3891c77e98c3338172"}
Nov 02 08:06:50.648629 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.647141    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.us-west-2.compute.internal" event={"ID":"5efd6818a2d6de09c2e33ba0444837d8","Type":"ContainerStarted","Data":"6e090e4165f5fd0997d74c74596c5e0c2232b822f8935dd2dbc3a0909b3848a7"}
Nov 02 08:06:50.648629 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.647160    6210 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:06:50.648629 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.647348    6210 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:06:50.691940 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.691908    6210 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:06:50.692061 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.691978    6210 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:06:50.703521 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.703463    6210 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 02 08:06:50.703521 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:06:50.703502    6210 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-135-235.us-west-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:06:50.703996 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.703980    6210 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 02 08:06:50.704033 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:06:50.704015    6210 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:06:50.800742 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.800709    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a70872874f68c480b6b252a06401797-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal\" (UID: \"8a70872874f68c480b6b252a06401797\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:06:50.800742 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.800741    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a70872874f68c480b6b252a06401797-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal\" (UID: \"8a70872874f68c480b6b252a06401797\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:06:50.801051 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.800765    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5efd6818a2d6de09c2e33ba0444837d8-config\") pod \"kube-apiserver-proxy-ip-10-0-135-235.us-west-2.compute.internal\" (UID: \"5efd6818a2d6de09c2e33ba0444837d8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:06:50.901667 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.901630    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a70872874f68c480b6b252a06401797-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal\" (UID: \"8a70872874f68c480b6b252a06401797\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:06:50.901667 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.901666    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a70872874f68c480b6b252a06401797-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal\" (UID: \"8a70872874f68c480b6b252a06401797\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:06:50.901840 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.901683    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5efd6818a2d6de09c2e33ba0444837d8-config\") pod \"kube-apiserver-proxy-ip-10-0-135-235.us-west-2.compute.internal\" (UID: \"5efd6818a2d6de09c2e33ba0444837d8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:06:50.901840 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.901725    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5efd6818a2d6de09c2e33ba0444837d8-config\") pod \"kube-apiserver-proxy-ip-10-0-135-235.us-west-2.compute.internal\" (UID: \"5efd6818a2d6de09c2e33ba0444837d8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:06:50.901840 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.901727    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a70872874f68c480b6b252a06401797-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal\" (UID: \"8a70872874f68c480b6b252a06401797\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:06:50.901840 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:50.901727    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a70872874f68c480b6b252a06401797-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal\" (UID: \"8a70872874f68c480b6b252a06401797\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:06:51.302896 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.302856    6210 apiserver.go:52] "Watching apiserver"
Nov 02 08:06:51.398902 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.398853    6210 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 02 08:06:51.399517 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.399485    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-rh5vc","openshift-multus/multus-gqv8f","openshift-ovn-kubernetes/ovnkube-node-jb77f","openshift-monitoring/metrics-server-669ff9f66c-ch5df","openshift-monitoring/monitoring-plugin-77f4f76594-tnr2r","openshift-monitoring/openshift-state-metrics-7bd7489957-sz4kk","openshift-image-registry/node-ca-zfknz","openshift-network-operator/iptables-alerter-zt85z","kube-system/konnectivity-agent-zdsw7","openshift-dns/node-resolver-dfp7b","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal","openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c","kube-system/global-pull-secret-syncer-w2swh","kube-system/kube-apiserver-proxy-ip-10-0-135-235.us-west-2.compute.internal","openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn","openshift-dns/dns-default-p2f6f","openshift-ingress-canary/ingress-canary-6rcb9","openshift-insights/insights-runtime-extractor-9b8f9","openshift-monitoring/node-exporter-z4kx5","openshift-multus/multus-additional-cni-plugins-9qsmp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv","openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5","openshift-cluster-node-tuning-operator/tuned-jggtz","openshift-network-diagnostics/network-check-target-5qkvj"]
Nov 02 08:06:51.405846 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.405822    6210 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:06:51.406075 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.406044    6210 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:06:51.419676 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.419653    6210 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 02 08:06:51.449433 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.449407    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 02 08:06:51.449619 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.449601    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 02 08:06:51.449915 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.449892    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 02 08:06:51.450024 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.449928    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6rwld\""
Nov 02 08:06:51.450024 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.449934    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-ghx8m\""
Nov 02 08:06:51.450024 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.449942    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-c87zx\""
Nov 02 08:06:51.450024 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.449971    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 02 08:06:51.450252 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.450238    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-4v7vr\""
Nov 02 08:06:51.450339 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.450328    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 02 08:06:51.450339 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.450332    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 02 08:06:51.450432 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.450327    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 02 08:06:51.450432 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.450399    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 02 08:06:51.450432 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.450407    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-t2bt7\""
Nov 02 08:06:51.450432 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.450411    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 02 08:06:51.450550 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.450434    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 02 08:06:51.450673 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.450660    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qmmzq\""
Nov 02 08:06:51.450796 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.450780    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 02 08:06:51.450847 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.450806    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 02 08:06:51.450984 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.450971    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 02 08:06:51.451043 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.451028    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 02 08:06:51.451255 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.451238    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 02 08:06:51.451330 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.451266    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 02 08:06:51.451330 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.451259    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 02 08:06:51.451330 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.451278    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 02 08:06:51.451430 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.451329    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zgn8x\""
Nov 02 08:06:51.451430 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.451388    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 02 08:06:51.451527 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.451442    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 02 08:06:51.451527 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.451496    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 02 08:06:51.451625 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.451603    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-zrnf9\""
Nov 02 08:06:51.451709 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.451655    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 02 08:06:51.451785 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.451773    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 02 08:06:51.451960 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.451936    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 02 08:06:51.452076 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.452056    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 02 08:06:51.452159 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.452094    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 02 08:06:51.452159 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.452107    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 02 08:06:51.452159 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.452149    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mwch9\""
Nov 02 08:06:51.452278 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.452256    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bgzdd\""
Nov 02 08:06:51.452313 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.452296    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 02 08:06:51.452347 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.452328    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 02 08:06:51.452376 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.452362    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 02 08:06:51.452420 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.452377    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-shlrq\""
Nov 02 08:06:51.452564 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.452548    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 02 08:06:51.452597 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.452551    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j6nct\""
Nov 02 08:06:51.452857 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.452844    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Nov 02 08:06:51.452914 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.452861    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9ztjt\""
Nov 02 08:06:51.452947 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.452910    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Nov 02 08:06:51.452999 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.452987    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Nov 02 08:06:51.453271 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.453260    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Nov 02 08:06:51.493515 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.493496    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Nov 02 08:06:51.494022 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.494008    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Nov 02 08:06:51.494069 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.494012    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Nov 02 08:06:51.494257 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.494243    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Nov 02 08:06:51.494569 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.494555    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Nov 02 08:06:51.494617 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.494577    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Nov 02 08:06:51.494645 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.494624    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Nov 02 08:06:51.494788 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.494777    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Nov 02 08:06:51.494849 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.494838    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Nov 02 08:06:51.494906 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.494893    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Nov 02 08:06:51.494950 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.494924    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Nov 02 08:06:51.494995 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.494956    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Nov 02 08:06:51.494995 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.494961    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Nov 02 08:06:51.494995 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.494977    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Nov 02 08:06:51.495089 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.495053    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Nov 02 08:06:51.495214 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.495203    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Nov 02 08:06:51.496643 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.496621    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\""
Nov 02 08:06:51.496643 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.496639    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-sp2hs\""
Nov 02 08:06:51.496643 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.496645    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Nov 02 08:06:51.496844 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.496767    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Nov 02 08:06:51.496844 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.496767    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Nov 02 08:06:51.496844 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.496795    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cg3935crgf1l5\""
Nov 02 08:06:51.496844 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.496832    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Nov 02 08:06:51.497061 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.496863    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Nov 02 08:06:51.497061 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.496915    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Nov 02 08:06:51.497061 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.496954    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Nov 02 08:06:51.497061 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.497046    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-9xpw6\""
Nov 02 08:06:51.497061 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.497051    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Nov 02 08:06:51.497257 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.497063    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9tsd7\""
Nov 02 08:06:51.497257 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.497101    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Nov 02 08:06:51.497257 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.497132    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-t9rxp\""
Nov 02 08:06:51.497257 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.497160    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-lgch7\""
Nov 02 08:06:51.497257 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.497189    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2mp4bbie57vjb\""
Nov 02 08:06:51.497257 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.497244    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Nov 02 08:06:51.497578 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.497297    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Nov 02 08:06:51.497578 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.497362    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lbg2j\""
Nov 02 08:06:51.497578 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.497388    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Nov 02 08:06:51.497578 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.497419    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-tkgw4\""
Nov 02 08:06:51.497830 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.497581    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Nov 02 08:06:51.497830 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.497594    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Nov 02 08:06:51.497830 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.497604    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-2z55d\""
Nov 02 08:06:51.497830 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.497631    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Nov 02 08:06:51.497830 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.497642    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-9l54h\""
Nov 02 08:06:51.501553 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.501537    6210 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 02 08:06:51.501612 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:06:51.501596    6210 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-135-235.us-west-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:06:51.502040 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.502025    6210 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 02 08:06:51.502114 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:06:51.502070    6210 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.us-west-2.compute.internal"
Nov 02 08:06:51.505242 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.505225    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-multus-conf-dir\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.505304 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.505248    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9a77497b-33c1-4ac2-bfba-58b6edcf871e-dbus\") pod \"global-pull-secret-syncer-w2swh\" (UID: \"9a77497b-33c1-4ac2-bfba-58b6edcf871e\") " pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:06:51.505304 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.505265    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-etc-openvswitch\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.505379 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.505311    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9b8f9\" (UID: \"cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8\") " pod="openshift-insights/insights-runtime-extractor-9b8f9"
Nov 02 08:06:51.505379 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.505336    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7pwz\" (UniqueName: \"kubernetes.io/projected/731f7925-494b-4442-b5c4-8d2df9379896-kube-api-access-q7pwz\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:06:51.505454 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.505390    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1aff1f9f-94a9-486f-a807-76b15fb88cfa-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:51.505454 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.505420    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/437fc0dd-7f5a-4e18-8252-810aab07ff3c-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-w7d6c\" (UID: \"437fc0dd-7f5a-4e18-8252-810aab07ff3c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c"
Nov 02 08:06:51.505571 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.505552    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-root\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:51.505624 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.505606    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-multus-daemon-config\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.505624 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.505607    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9b8f9\" (UID: \"cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8\") " pod="openshift-insights/insights-runtime-extractor-9b8f9"
Nov 02 08:06:51.505722 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.505612    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1aff1f9f-94a9-486f-a807-76b15fb88cfa-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:51.505722 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.505642    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-ovnkube-script-lib\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.505722 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.505686    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/437fc0dd-7f5a-4e18-8252-810aab07ff3c-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-w7d6c\" (UID: \"437fc0dd-7f5a-4e18-8252-810aab07ff3c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c"
Nov 02 08:06:51.505722 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.505689    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-sysctl-conf\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.505867 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.505730    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-systemd\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.505867 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.505754    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-host\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.505867 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.505799    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-multus-daemon-config\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.505867 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.505807    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-ovnkube-script-lib\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.505867 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.505805    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-tuned\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.505867 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.505858    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/437fc0dd-7f5a-4e18-8252-810aab07ff3c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-w7d6c\" (UID: \"437fc0dd-7f5a-4e18-8252-810aab07ff3c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c"
Nov 02 08:06:51.505867 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.505866    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-tuned\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.506205 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.505901    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.506205 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.505923    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-modprobe-d\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.506205 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.505942    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-lib-modules\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.506205 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.505983    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwd27\" (UniqueName: \"kubernetes.io/projected/79843809-80ac-4069-b436-ba1a26348505-kube-api-access-lwd27\") pod \"iptables-alerter-zt85z\" (UID: \"79843809-80ac-4069-b436-ba1a26348505\") " pod="openshift-network-operator/iptables-alerter-zt85z"
Nov 02 08:06:51.506205 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.506001    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1aff1f9f-94a9-486f-a807-76b15fb88cfa-metrics-client-ca\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:51.506205 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.506020    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ed28bb0-f551-4b15-8d8e-04da752a23ec-client-ca-bundle\") pod \"metrics-server-669ff9f66c-ch5df\" (UID: \"2ed28bb0-f551-4b15-8d8e-04da752a23ec\") " pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:51.506205 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.506067    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc2kl\" (UniqueName: \"kubernetes.io/projected/5b54f688-470c-4797-b685-8b9826e361a8-kube-api-access-rc2kl\") pod \"node-resolver-dfp7b\" (UID: \"5b54f688-470c-4797-b685-8b9826e361a8\") " pod="openshift-dns/node-resolver-dfp7b"
Nov 02 08:06:51.506205 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.506084    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/437fc0dd-7f5a-4e18-8252-810aab07ff3c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-w7d6c\" (UID: \"437fc0dd-7f5a-4e18-8252-810aab07ff3c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c"
Nov 02 08:06:51.506205 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.506094    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h6hj\" (UniqueName: \"kubernetes.io/projected/bff203a8-2155-4ef1-9efd-b1a6d7e1eabe-kube-api-access-6h6hj\") pod \"monitoring-plugin-77f4f76594-tnr2r\" (UID: \"bff203a8-2155-4ef1-9efd-b1a6d7e1eabe\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-tnr2r"
Nov 02 08:06:51.506205 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.506156    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d220536b-9c7c-4e34-8ac0-3c25ab4975f7-serviceca\") pod \"node-ca-zfknz\" (UID: \"d220536b-9c7c-4e34-8ac0-3c25ab4975f7\") " pod="openshift-image-registry/node-ca-zfknz"
Nov 02 08:06:51.506205 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.506183    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-run-systemd\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.506205 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.506193    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1aff1f9f-94a9-486f-a807-76b15fb88cfa-metrics-client-ca\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:51.506205 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.506209    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-node-log\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.506730 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.506222    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ed28bb0-f551-4b15-8d8e-04da752a23ec-client-ca-bundle\") pod \"metrics-server-669ff9f66c-ch5df\" (UID: \"2ed28bb0-f551-4b15-8d8e-04da752a23ec\") " pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:51.506730 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.506231    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d220536b-9c7c-4e34-8ac0-3c25ab4975f7-host\") pod \"node-ca-zfknz\" (UID: \"d220536b-9c7c-4e34-8ac0-3c25ab4975f7\") " pod="openshift-image-registry/node-ca-zfknz"
Nov 02 08:06:51.506730 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.506259    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk9zl\" (UniqueName: \"kubernetes.io/projected/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-kube-api-access-hk9zl\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.506730 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.506320    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1aff1f9f-94a9-486f-a807-76b15fb88cfa-telemeter-trusted-ca-bundle\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:51.506730 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.506421    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-node-exporter-textfile\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:51.506730 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.506448    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-system-cni-dir\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.506730 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.506498    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q98x\" (UniqueName: \"kubernetes.io/projected/9dbb1434-9e62-4d55-86a3-b7e4b469fb42-kube-api-access-7q98x\") pod \"dns-default-p2f6f\" (UID: \"9dbb1434-9e62-4d55-86a3-b7e4b469fb42\") " pod="openshift-dns/dns-default-p2f6f"
Nov 02 08:06:51.506730 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.506500    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-node-exporter-textfile\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:51.506730 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.506601    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/731f7925-494b-4442-b5c4-8d2df9379896-sys-fs\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:06:51.506730 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.506641    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1aff1f9f-94a9-486f-a807-76b15fb88cfa-secret-telemeter-client\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:51.506730 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.506710    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2ed28bb0-f551-4b15-8d8e-04da752a23ec-audit-log\") pod \"metrics-server-669ff9f66c-ch5df\" (UID: \"2ed28bb0-f551-4b15-8d8e-04da752a23ec\") " pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:51.507178 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.506749    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2ed28bb0-f551-4b15-8d8e-04da752a23ec-metrics-server-audit-profiles\") pod \"metrics-server-669ff9f66c-ch5df\" (UID: \"2ed28bb0-f551-4b15-8d8e-04da752a23ec\") " pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:51.507178 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.506784    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a263223-99a0-43f4-9e93-f9b990f7c57d-cert\") pod \"ingress-canary-6rcb9\" (UID: \"2a263223-99a0-43f4-9e93-f9b990f7c57d\") " pod="openshift-ingress-canary/ingress-canary-6rcb9"
Nov 02 08:06:51.507178 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.506802    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2ed28bb0-f551-4b15-8d8e-04da752a23ec-audit-log\") pod \"metrics-server-669ff9f66c-ch5df\" (UID: \"2ed28bb0-f551-4b15-8d8e-04da752a23ec\") " pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:51.507178 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.506815    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2ed28bb0-f551-4b15-8d8e-04da752a23ec-secret-metrics-server-tls\") pod \"metrics-server-669ff9f66c-ch5df\" (UID: \"2ed28bb0-f551-4b15-8d8e-04da752a23ec\") " pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:51.507178 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.506861    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d220536b-9c7c-4e34-8ac0-3c25ab4975f7-serviceca\") pod \"node-ca-zfknz\" (UID: \"d220536b-9c7c-4e34-8ac0-3c25ab4975f7\") " pod="openshift-image-registry/node-ca-zfknz"
Nov 02 08:06:51.507178 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.506913    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1aff1f9f-94a9-486f-a807-76b15fb88cfa-secret-telemeter-client\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:51.507178 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.506929    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-cni-binary-copy\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.507178 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.506996    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-host-var-lib-cni-multus\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.507178 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.507029    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-host-var-lib-kubelet\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.507178 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.507060    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-cni-bin\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.507178 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.507103    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2ed28bb0-f551-4b15-8d8e-04da752a23ec-secret-metrics-server-tls\") pod \"metrics-server-669ff9f66c-ch5df\" (UID: \"2ed28bb0-f551-4b15-8d8e-04da752a23ec\") " pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:51.507178 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.507097    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a263223-99a0-43f4-9e93-f9b990f7c57d-cert\") pod \"ingress-canary-6rcb9\" (UID: \"2a263223-99a0-43f4-9e93-f9b990f7c57d\") " pod="openshift-ingress-canary/ingress-canary-6rcb9"
Nov 02 08:06:51.507178 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.507129    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9b8f9\" (UID: \"cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8\") " pod="openshift-insights/insights-runtime-extractor-9b8f9"
Nov 02 08:06:51.507178 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.507161    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2ed28bb0-f551-4b15-8d8e-04da752a23ec-metrics-server-audit-profiles\") pod \"metrics-server-669ff9f66c-ch5df\" (UID: \"2ed28bb0-f551-4b15-8d8e-04da752a23ec\") " pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:51.507861 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.507185    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/731f7925-494b-4442-b5c4-8d2df9379896-device-dir\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:06:51.507861 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.507188    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-cni-binary-copy\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.507861 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.507223    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff05c739-4a53-4cfe-942f-df41f812d742-metrics-certs\") pod \"network-metrics-daemon-rh5vc\" (UID: \"ff05c739-4a53-4cfe-942f-df41f812d742\") " pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:06:51.507861 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.507236    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1aff1f9f-94a9-486f-a807-76b15fb88cfa-telemeter-trusted-ca-bundle\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:51.507861 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.507243    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8-data-volume\") pod \"insights-runtime-extractor-9b8f9\" (UID: \"cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8\") " pod="openshift-insights/insights-runtime-extractor-9b8f9"
Nov 02 08:06:51.507861 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.507284    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8-data-volume\") pod \"insights-runtime-extractor-9b8f9\" (UID: \"cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8\") " pod="openshift-insights/insights-runtime-extractor-9b8f9"
Nov 02 08:06:51.507861 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.507283    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/05f90c13-3432-4e94-b368-66226fa6ff26-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:06:51.507861 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.507313    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djtkk\" (UniqueName: \"kubernetes.io/projected/558cdaf8-03cf-4d61-9c28-94a5da9c886d-kube-api-access-djtkk\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.507861 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.507328    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-multus-cni-dir\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.507861 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.507331    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9b8f9\" (UID: \"cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8\") " pod="openshift-insights/insights-runtime-extractor-9b8f9"
Nov 02 08:06:51.507861 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.507351    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0027996b-31d7-474a-88e9-efc0b6032300-agent-certs\") pod \"konnectivity-agent-zdsw7\" (UID: \"0027996b-31d7-474a-88e9-efc0b6032300\") " pod="kube-system/konnectivity-agent-zdsw7"
Nov 02 08:06:51.507861 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.507386    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff05c739-4a53-4cfe-942f-df41f812d742-metrics-certs\") pod \"network-metrics-daemon-rh5vc\" (UID: \"ff05c739-4a53-4cfe-942f-df41f812d742\") " pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:06:51.507861 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.507388    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ed28bb0-f551-4b15-8d8e-04da752a23ec-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-669ff9f66c-ch5df\" (UID: \"2ed28bb0-f551-4b15-8d8e-04da752a23ec\") " pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:51.507861 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.507418    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a77497b-33c1-4ac2-bfba-58b6edcf871e-original-pull-secret\") pod \"global-pull-secret-syncer-w2swh\" (UID: \"9a77497b-33c1-4ac2-bfba-58b6edcf871e\") " pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:06:51.507861 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.507447    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79843809-80ac-4069-b436-ba1a26348505-host-slash\") pod \"iptables-alerter-zt85z\" (UID: \"79843809-80ac-4069-b436-ba1a26348505\") " pod="openshift-network-operator/iptables-alerter-zt85z"
Nov 02 08:06:51.507861 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.507447    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/05f90c13-3432-4e94-b368-66226fa6ff26-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:06:51.507861 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.507483    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2ed28bb0-f551-4b15-8d8e-04da752a23ec-secret-metrics-server-client-certs\") pod \"metrics-server-669ff9f66c-ch5df\" (UID: \"2ed28bb0-f551-4b15-8d8e-04da752a23ec\") " pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:51.507861 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.507564    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ed28bb0-f551-4b15-8d8e-04da752a23ec-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-669ff9f66c-ch5df\" (UID: \"2ed28bb0-f551-4b15-8d8e-04da752a23ec\") " pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:51.507861 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.507575    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-kubernetes\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.507861 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.507568    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0027996b-31d7-474a-88e9-efc0b6032300-agent-certs\") pod \"konnectivity-agent-zdsw7\" (UID: \"0027996b-31d7-474a-88e9-efc0b6032300\") " pod="kube-system/konnectivity-agent-zdsw7"
Nov 02 08:06:51.507861 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.507607    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/731f7925-494b-4442-b5c4-8d2df9379896-registration-dir\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:06:51.507861 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.507692    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-sys\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:51.507861 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.507720    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5twnn\" (UniqueName: \"kubernetes.io/projected/2ed28bb0-f551-4b15-8d8e-04da752a23ec-kube-api-access-5twnn\") pod \"metrics-server-669ff9f66c-ch5df\" (UID: \"2ed28bb0-f551-4b15-8d8e-04da752a23ec\") " pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:51.507861 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.507744    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a77497b-33c1-4ac2-bfba-58b6edcf871e-original-pull-secret\") pod \"global-pull-secret-syncer-w2swh\" (UID: \"9a77497b-33c1-4ac2-bfba-58b6edcf871e\") " pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:06:51.507861 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.507793    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-env-overrides\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.507861 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.507814    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9dbb1434-9e62-4d55-86a3-b7e4b469fb42-metrics-tls\") pod \"dns-default-p2f6f\" (UID: \"9dbb1434-9e62-4d55-86a3-b7e4b469fb42\") " pod="openshift-dns/dns-default-p2f6f"
Nov 02 08:06:51.507861 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.507807    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2ed28bb0-f551-4b15-8d8e-04da752a23ec-secret-metrics-server-client-certs\") pod \"metrics-server-669ff9f66c-ch5df\" (UID: \"2ed28bb0-f551-4b15-8d8e-04da752a23ec\") " pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:51.509078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.507948    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-env-overrides\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.509078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.507971    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/05f90c13-3432-4e94-b368-66226fa6ff26-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:06:51.509078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.508004    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/437fc0dd-7f5a-4e18-8252-810aab07ff3c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-w7d6c\" (UID: \"437fc0dd-7f5a-4e18-8252-810aab07ff3c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c"
Nov 02 08:06:51.509078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.508027    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvz67\" (UniqueName: \"kubernetes.io/projected/d276266f-fed6-4266-89b3-c57743cc7179-kube-api-access-xvz67\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:51.509078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.508069    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-slash\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.509078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.508072    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9dbb1434-9e62-4d55-86a3-b7e4b469fb42-metrics-tls\") pod \"dns-default-p2f6f\" (UID: \"9dbb1434-9e62-4d55-86a3-b7e4b469fb42\") " pod="openshift-dns/dns-default-p2f6f"
Nov 02 08:06:51.509078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.508114    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05f90c13-3432-4e94-b368-66226fa6ff26-system-cni-dir\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:06:51.509078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.508168    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px425\" (UniqueName: \"kubernetes.io/projected/ff05c739-4a53-4cfe-942f-df41f812d742-kube-api-access-px425\") pod \"network-metrics-daemon-rh5vc\" (UID: \"ff05c739-4a53-4cfe-942f-df41f812d742\") " pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:06:51.509078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.508238    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-host-var-lib-cni-bin\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.509078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.508265    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-sysconfig\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.509078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.508290    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-sysctl-d\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.509078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.508292    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/437fc0dd-7f5a-4e18-8252-810aab07ff3c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-w7d6c\" (UID: \"437fc0dd-7f5a-4e18-8252-810aab07ff3c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c"
Nov 02 08:06:51.509078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.508339    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d276266f-fed6-4266-89b3-c57743cc7179-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:51.509078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.508372    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1aff1f9f-94a9-486f-a807-76b15fb88cfa-telemeter-client-tls\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:51.509078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.508425    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-metrics-client-ca\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:51.509078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.508522    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d276266f-fed6-4266-89b3-c57743cc7179-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:51.509078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.508510    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9a77497b-33c1-4ac2-bfba-58b6edcf871e-kubelet-config\") pod \"global-pull-secret-syncer-w2swh\" (UID: \"9a77497b-33c1-4ac2-bfba-58b6edcf871e\") " pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:06:51.509078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.508556    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1aff1f9f-94a9-486f-a807-76b15fb88cfa-telemeter-client-tls\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:51.509078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.508558    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9dbb1434-9e62-4d55-86a3-b7e4b469fb42-config-volume\") pod \"dns-default-p2f6f\" (UID: \"9dbb1434-9e62-4d55-86a3-b7e4b469fb42\") " pod="openshift-dns/dns-default-p2f6f"
Nov 02 08:06:51.509078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.508681    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-metrics-client-ca\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:51.509078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.508712    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dbb1434-9e62-4d55-86a3-b7e4b469fb42-tmp-dir\") pod \"dns-default-p2f6f\" (UID: \"9dbb1434-9e62-4d55-86a3-b7e4b469fb42\") " pod="openshift-dns/dns-default-p2f6f"
Nov 02 08:06:51.509078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.508735    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9dbb1434-9e62-4d55-86a3-b7e4b469fb42-config-volume\") pod \"dns-default-p2f6f\" (UID: \"9dbb1434-9e62-4d55-86a3-b7e4b469fb42\") " pod="openshift-dns/dns-default-p2f6f"
Nov 02 08:06:51.509078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.508741    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/437fc0dd-7f5a-4e18-8252-810aab07ff3c-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-w7d6c\" (UID: \"437fc0dd-7f5a-4e18-8252-810aab07ff3c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c"
Nov 02 08:06:51.509078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.508756    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bff203a8-2155-4ef1-9efd-b1a6d7e1eabe-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-tnr2r\" (UID: \"bff203a8-2155-4ef1-9efd-b1a6d7e1eabe\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-tnr2r"
Nov 02 08:06:51.509078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.508791    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b58f599-6735-4461-8657-ef5abab78403-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-sz4kk\" (UID: \"8b58f599-6735-4461-8657-ef5abab78403\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sz4kk"
Nov 02 08:06:51.509078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.508805    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dbb1434-9e62-4d55-86a3-b7e4b469fb42-tmp-dir\") pod \"dns-default-p2f6f\" (UID: \"9dbb1434-9e62-4d55-86a3-b7e4b469fb42\") " pod="openshift-dns/dns-default-p2f6f"
Nov 02 08:06:51.509078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.508855    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-host-run-netns\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.509078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.508888    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-systemd-units\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.509078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.508924    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8-crio-socket\") pod \"insights-runtime-extractor-9b8f9\" (UID: \"cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8\") " pod="openshift-insights/insights-runtime-extractor-9b8f9"
Nov 02 08:06:51.509078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.508973    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/731f7925-494b-4442-b5c4-8d2df9379896-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:06:51.509078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.508998    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bff203a8-2155-4ef1-9efd-b1a6d7e1eabe-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-tnr2r\" (UID: \"bff203a8-2155-4ef1-9efd-b1a6d7e1eabe\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-tnr2r"
Nov 02 08:06:51.509078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509003    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/05f90c13-3432-4e94-b368-66226fa6ff26-cni-binary-copy\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:06:51.509078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509022    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/437fc0dd-7f5a-4e18-8252-810aab07ff3c-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-w7d6c\" (UID: \"437fc0dd-7f5a-4e18-8252-810aab07ff3c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c"
Nov 02 08:06:51.509078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509036    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-sys\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.509078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509064    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b58f599-6735-4461-8657-ef5abab78403-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-sz4kk\" (UID: \"8b58f599-6735-4461-8657-ef5abab78403\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sz4kk"
Nov 02 08:06:51.509078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509104    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/05f90c13-3432-4e94-b368-66226fa6ff26-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509134    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbn9c\" (UniqueName: \"kubernetes.io/projected/437fc0dd-7f5a-4e18-8252-810aab07ff3c-kube-api-access-kbn9c\") pod \"kube-state-metrics-5dc8d7d89b-w7d6c\" (UID: \"437fc0dd-7f5a-4e18-8252-810aab07ff3c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509164    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d276266f-fed6-4266-89b3-c57743cc7179-tmp\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509185    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/05f90c13-3432-4e94-b368-66226fa6ff26-cni-binary-copy\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509266    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d276266f-fed6-4266-89b3-c57743cc7179-tmp\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509273    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-node-exporter-wtmp\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509305    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-log-socket\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509314    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/05f90c13-3432-4e94-b368-66226fa6ff26-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509334    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b58f599-6735-4461-8657-ef5abab78403-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-sz4kk\" (UID: \"8b58f599-6735-4461-8657-ef5abab78403\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sz4kk"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509353    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b58f599-6735-4461-8657-ef5abab78403-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-sz4kk\" (UID: \"8b58f599-6735-4461-8657-ef5abab78403\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sz4kk"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509381    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-run-ovn\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509405    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4c4m\" (UniqueName: \"kubernetes.io/projected/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-kube-api-access-l4c4m\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509448    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/437fc0dd-7f5a-4e18-8252-810aab07ff3c-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-w7d6c\" (UID: \"437fc0dd-7f5a-4e18-8252-810aab07ff3c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509496    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/437fc0dd-7f5a-4e18-8252-810aab07ff3c-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-w7d6c\" (UID: \"437fc0dd-7f5a-4e18-8252-810aab07ff3c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509530    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b58f599-6735-4461-8657-ef5abab78403-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-sz4kk\" (UID: \"8b58f599-6735-4461-8657-ef5abab78403\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sz4kk"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509529    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d276266f-fed6-4266-89b3-c57743cc7179-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509556    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1aff1f9f-94a9-486f-a807-76b15fb88cfa-serving-certs-ca-bundle\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509579    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b58f599-6735-4461-8657-ef5abab78403-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-sz4kk\" (UID: \"8b58f599-6735-4461-8657-ef5abab78403\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sz4kk"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509584    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509631    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-etc-kubernetes\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509666    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-var-lib-openvswitch\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509700    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-ovnkube-config\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509727    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d276266f-fed6-4266-89b3-c57743cc7179-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509763    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509762    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d276266f-fed6-4266-89b3-c57743cc7179-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509790    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc7fm\" (UniqueName: \"kubernetes.io/projected/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-kube-api-access-sc7fm\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509796    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1aff1f9f-94a9-486f-a807-76b15fb88cfa-serving-certs-ca-bundle\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509821    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcp9h\" (UniqueName: \"kubernetes.io/projected/8b58f599-6735-4461-8657-ef5abab78403-kube-api-access-hcp9h\") pod \"openshift-state-metrics-7bd7489957-sz4kk\" (UID: \"8b58f599-6735-4461-8657-ef5abab78403\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sz4kk"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509855    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-host-run-k8s-cni-cncf-io\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509902    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5b54f688-470c-4797-b685-8b9826e361a8-hosts-file\") pod \"node-resolver-dfp7b\" (UID: \"5b54f688-470c-4797-b685-8b9826e361a8\") " pod="openshift-dns/node-resolver-dfp7b"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509932    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcq5p\" (UniqueName: \"kubernetes.io/projected/cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8-kube-api-access-dcq5p\") pod \"insights-runtime-extractor-9b8f9\" (UID: \"cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8\") " pod="openshift-insights/insights-runtime-extractor-9b8f9"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509962    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d276266f-fed6-4266-89b3-c57743cc7179-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509972    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d276266f-fed6-4266-89b3-c57743cc7179-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509972    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-ovnkube-config\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.509999    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94rml\" (UniqueName: \"kubernetes.io/projected/1aff1f9f-94a9-486f-a807-76b15fb88cfa-kube-api-access-94rml\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.510036    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-run-openvswitch\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.510129    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d276266f-fed6-4266-89b3-c57743cc7179-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.510164    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-ovn-node-metrics-cert\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.510185    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/05f90c13-3432-4e94-b368-66226fa6ff26-cnibin\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.510203    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/79843809-80ac-4069-b436-ba1a26348505-iptables-alerter-script\") pod \"iptables-alerter-zt85z\" (UID: \"79843809-80ac-4069-b436-ba1a26348505\") " pod="openshift-network-operator/iptables-alerter-zt85z"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.510239    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d276266f-fed6-4266-89b3-c57743cc7179-secret-thanos-querier-tls\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.510263    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-node-exporter-accelerators-collector-config\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.510280    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-cni-netd\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.510298    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgzlc\" (UniqueName: \"kubernetes.io/projected/d220536b-9c7c-4e34-8ac0-3c25ab4975f7-kube-api-access-pgzlc\") pod \"node-ca-zfknz\" (UID: \"d220536b-9c7c-4e34-8ac0-3c25ab4975f7\") " pod="openshift-image-registry/node-ca-zfknz"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.510313    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bbc2\" (UniqueName: \"kubernetes.io/projected/2a263223-99a0-43f4-9e93-f9b990f7c57d-kube-api-access-4bbc2\") pod \"ingress-canary-6rcb9\" (UID: \"2a263223-99a0-43f4-9e93-f9b990f7c57d\") " pod="openshift-ingress-canary/ingress-canary-6rcb9"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.510327    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-run\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.510400    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-ovn-node-metrics-cert\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.510440    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-cnibin\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.510501    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-hostroot\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.510525    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-node-exporter-accelerators-collector-config\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.510535    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b54f688-470c-4797-b685-8b9826e361a8-tmp-dir\") pod \"node-resolver-dfp7b\" (UID: \"5b54f688-470c-4797-b685-8b9826e361a8\") " pod="openshift-dns/node-resolver-dfp7b"
Nov 02 08:06:51.510525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.510544    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/79843809-80ac-4069-b436-ba1a26348505-iptables-alerter-script\") pod \"iptables-alerter-zt85z\" (UID: \"79843809-80ac-4069-b436-ba1a26348505\") " pod="openshift-network-operator/iptables-alerter-zt85z"
Nov 02 08:06:51.512163 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.510575    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-var-lib-kubelet\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.512163 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.510615    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpq4r\" (UniqueName: \"kubernetes.io/projected/c03021d1-d458-46a8-af56-bfba0cc4b4b4-kube-api-access-rpq4r\") pod \"network-check-target-5qkvj\" (UID: \"c03021d1-d458-46a8-af56-bfba0cc4b4b4\") " pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:06:51.512163 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.510630    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d276266f-fed6-4266-89b3-c57743cc7179-secret-thanos-querier-tls\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:51.512163 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.510651    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/731f7925-494b-4442-b5c4-8d2df9379896-etc-selinux\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:06:51.512163 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.510689    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d276266f-fed6-4266-89b3-c57743cc7179-metrics-client-ca\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:51.512163 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.510633    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b54f688-470c-4797-b685-8b9826e361a8-tmp-dir\") pod \"node-resolver-dfp7b\" (UID: \"5b54f688-470c-4797-b685-8b9826e361a8\") " pod="openshift-dns/node-resolver-dfp7b"
Nov 02 08:06:51.512163 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.510721    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djxm4\" (UniqueName: \"kubernetes.io/projected/05f90c13-3432-4e94-b368-66226fa6ff26-kube-api-access-djxm4\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:06:51.512163 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.510750    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0027996b-31d7-474a-88e9-efc0b6032300-konnectivity-ca\") pod \"konnectivity-agent-zdsw7\" (UID: \"0027996b-31d7-474a-88e9-efc0b6032300\") " pod="kube-system/konnectivity-agent-zdsw7"
Nov 02 08:06:51.512163 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.510778    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-run-netns\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.512163 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.510803    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-run-ovn-kubernetes\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.512163 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.510827    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/731f7925-494b-4442-b5c4-8d2df9379896-socket-dir\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:06:51.512163 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.510854    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d276266f-fed6-4266-89b3-c57743cc7179-metrics-client-ca\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:51.512163 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.510858    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d276266f-fed6-4266-89b3-c57743cc7179-secret-grpc-tls\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:51.512163 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.510963    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-kubelet\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.512163 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.510984    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0027996b-31d7-474a-88e9-efc0b6032300-konnectivity-ca\") pod \"konnectivity-agent-zdsw7\" (UID: \"0027996b-31d7-474a-88e9-efc0b6032300\") " pod="kube-system/konnectivity-agent-zdsw7"
Nov 02 08:06:51.512163 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.510998    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/558cdaf8-03cf-4d61-9c28-94a5da9c886d-tmp\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.512163 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.511027    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1aff1f9f-94a9-486f-a807-76b15fb88cfa-federate-client-tls\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:51.512163 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.511044    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-node-exporter-tls\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:51.512163 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.511062    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-multus-socket-dir-parent\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.512163 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.511085    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-host-run-multus-certs\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.512163 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.511093    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/558cdaf8-03cf-4d61-9c28-94a5da9c886d-tmp\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.512163 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.511133    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d276266f-fed6-4266-89b3-c57743cc7179-secret-grpc-tls\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:51.512163 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.511218    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1aff1f9f-94a9-486f-a807-76b15fb88cfa-federate-client-tls\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:51.512163 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.511260    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-node-exporter-tls\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:51.557762 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.557706    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwd27\" (UniqueName: \"kubernetes.io/projected/79843809-80ac-4069-b436-ba1a26348505-kube-api-access-lwd27\") pod \"iptables-alerter-zt85z\" (UID: \"79843809-80ac-4069-b436-ba1a26348505\") " pod="openshift-network-operator/iptables-alerter-zt85z"
Nov 02 08:06:51.557762 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.557747    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7pwz\" (UniqueName: \"kubernetes.io/projected/731f7925-494b-4442-b5c4-8d2df9379896-kube-api-access-q7pwz\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:06:51.557964 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.557932    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk9zl\" (UniqueName: \"kubernetes.io/projected/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-kube-api-access-hk9zl\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.558045 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.558034    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h6hj\" (UniqueName: \"kubernetes.io/projected/bff203a8-2155-4ef1-9efd-b1a6d7e1eabe-kube-api-access-6h6hj\") pod \"monitoring-plugin-77f4f76594-tnr2r\" (UID: \"bff203a8-2155-4ef1-9efd-b1a6d7e1eabe\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-tnr2r"
Nov 02 08:06:51.558103 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.558071    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc2kl\" (UniqueName: \"kubernetes.io/projected/5b54f688-470c-4797-b685-8b9826e361a8-kube-api-access-rc2kl\") pod \"node-resolver-dfp7b\" (UID: \"5b54f688-470c-4797-b685-8b9826e361a8\") " pod="openshift-dns/node-resolver-dfp7b"
Nov 02 08:06:51.558337 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.558318    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q98x\" (UniqueName: \"kubernetes.io/projected/9dbb1434-9e62-4d55-86a3-b7e4b469fb42-kube-api-access-7q98x\") pod \"dns-default-p2f6f\" (UID: \"9dbb1434-9e62-4d55-86a3-b7e4b469fb42\") " pod="openshift-dns/dns-default-p2f6f"
Nov 02 08:06:51.558337 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.558326    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djtkk\" (UniqueName: \"kubernetes.io/projected/558cdaf8-03cf-4d61-9c28-94a5da9c886d-kube-api-access-djtkk\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.559072 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.559052    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5twnn\" (UniqueName: \"kubernetes.io/projected/2ed28bb0-f551-4b15-8d8e-04da752a23ec-kube-api-access-5twnn\") pod \"metrics-server-669ff9f66c-ch5df\" (UID: \"2ed28bb0-f551-4b15-8d8e-04da752a23ec\") " pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:06:51.559271 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.559252    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-px425\" (UniqueName: \"kubernetes.io/projected/ff05c739-4a53-4cfe-942f-df41f812d742-kube-api-access-px425\") pod \"network-metrics-daemon-rh5vc\" (UID: \"ff05c739-4a53-4cfe-942f-df41f812d742\") " pod="openshift-multus/network-metrics-daemon-rh5vc"
Nov 02 08:06:51.559456 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.559437    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvz67\" (UniqueName: \"kubernetes.io/projected/d276266f-fed6-4266-89b3-c57743cc7179-kube-api-access-xvz67\") pod \"thanos-querier-66fd4b7df4-7h5pn\" (UID: \"d276266f-fed6-4266-89b3-c57743cc7179\") " pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:51.560031 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.560016    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbn9c\" (UniqueName: \"kubernetes.io/projected/437fc0dd-7f5a-4e18-8252-810aab07ff3c-kube-api-access-kbn9c\") pod \"kube-state-metrics-5dc8d7d89b-w7d6c\" (UID: \"437fc0dd-7f5a-4e18-8252-810aab07ff3c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w7d6c"
Nov 02 08:06:51.560717 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.560697    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4c4m\" (UniqueName: \"kubernetes.io/projected/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-kube-api-access-l4c4m\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.561587 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.561566    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgzlc\" (UniqueName: \"kubernetes.io/projected/d220536b-9c7c-4e34-8ac0-3c25ab4975f7-kube-api-access-pgzlc\") pod \"node-ca-zfknz\" (UID: \"d220536b-9c7c-4e34-8ac0-3c25ab4975f7\") " pod="openshift-image-registry/node-ca-zfknz"
Nov 02 08:06:51.561658 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.561617    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcq5p\" (UniqueName: \"kubernetes.io/projected/cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8-kube-api-access-dcq5p\") pod \"insights-runtime-extractor-9b8f9\" (UID: \"cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8\") " pod="openshift-insights/insights-runtime-extractor-9b8f9"
Nov 02 08:06:51.562259 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.562238    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcp9h\" (UniqueName: \"kubernetes.io/projected/8b58f599-6735-4461-8657-ef5abab78403-kube-api-access-hcp9h\") pod \"openshift-state-metrics-7bd7489957-sz4kk\" (UID: \"8b58f599-6735-4461-8657-ef5abab78403\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sz4kk"
Nov 02 08:06:51.562568 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.562551    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpq4r\" (UniqueName: \"kubernetes.io/projected/c03021d1-d458-46a8-af56-bfba0cc4b4b4-kube-api-access-rpq4r\") pod \"network-check-target-5qkvj\" (UID: \"c03021d1-d458-46a8-af56-bfba0cc4b4b4\") " pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:06:51.562715 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.562697    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94rml\" (UniqueName: \"kubernetes.io/projected/1aff1f9f-94a9-486f-a807-76b15fb88cfa-kube-api-access-94rml\") pod \"telemeter-client-745f5fc9c7-7z6h5\" (UID: \"1aff1f9f-94a9-486f-a807-76b15fb88cfa\") " pod="openshift-monitoring/telemeter-client-745f5fc9c7-7z6h5"
Nov 02 08:06:51.562771 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.562704    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bbc2\" (UniqueName: \"kubernetes.io/projected/2a263223-99a0-43f4-9e93-f9b990f7c57d-kube-api-access-4bbc2\") pod \"ingress-canary-6rcb9\" (UID: \"2a263223-99a0-43f4-9e93-f9b990f7c57d\") " pod="openshift-ingress-canary/ingress-canary-6rcb9"
Nov 02 08:06:51.562805 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.562795    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djxm4\" (UniqueName: \"kubernetes.io/projected/05f90c13-3432-4e94-b368-66226fa6ff26-kube-api-access-djxm4\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:06:51.563021 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.563004    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc7fm\" (UniqueName: \"kubernetes.io/projected/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-kube-api-access-sc7fm\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:51.612120 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612095    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-run-ovn\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.612218 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612125    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-etc-kubernetes\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.612218 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612141    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-var-lib-openvswitch\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.612218 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612159    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-host-run-k8s-cni-cncf-io\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.612218 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612174    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5b54f688-470c-4797-b685-8b9826e361a8-hosts-file\") pod \"node-resolver-dfp7b\" (UID: \"5b54f688-470c-4797-b685-8b9826e361a8\") " pod="openshift-dns/node-resolver-dfp7b"
Nov 02 08:06:51.612218 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612190    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-run-openvswitch\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.612218 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612200    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-run-ovn\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.612423 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612221    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/05f90c13-3432-4e94-b368-66226fa6ff26-cnibin\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:06:51.612423 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612235    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-var-lib-openvswitch\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.612423 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612240    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-host-run-k8s-cni-cncf-io\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.612423 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612266    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5b54f688-470c-4797-b685-8b9826e361a8-hosts-file\") pod \"node-resolver-dfp7b\" (UID: \"5b54f688-470c-4797-b685-8b9826e361a8\") " pod="openshift-dns/node-resolver-dfp7b"
Nov 02 08:06:51.612423 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612282    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-cni-netd\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.612423 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612245    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-run-openvswitch\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.612423 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612261    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-cni-netd\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.612423 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612260    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/05f90c13-3432-4e94-b368-66226fa6ff26-cnibin\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:06:51.612423 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612311    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-run\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.612423 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612328    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-cnibin\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.612423 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612343    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-hostroot\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.612423 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612207    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-etc-kubernetes\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.612423 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612357    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-var-lib-kubelet\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.612423 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612387    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-hostroot\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.612423 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612389    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-var-lib-kubelet\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.612423 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612359    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-run\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.612423 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612410    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/731f7925-494b-4442-b5c4-8d2df9379896-etc-selinux\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:06:51.612952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612434    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-cnibin\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.612952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612447    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-run-netns\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.612952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612478    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-run-netns\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.612952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612484    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/731f7925-494b-4442-b5c4-8d2df9379896-etc-selinux\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:06:51.612952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612486    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-run-ovn-kubernetes\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.612952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612516    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/731f7925-494b-4442-b5c4-8d2df9379896-socket-dir\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:06:51.612952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612522    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-run-ovn-kubernetes\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.612952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612532    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-kubelet\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.612952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612549    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-multus-socket-dir-parent\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.612952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612569    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-host-run-multus-certs\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.612952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612583    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/731f7925-494b-4442-b5c4-8d2df9379896-socket-dir\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:06:51.612952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612593    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-multus-conf-dir\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.612952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612595    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-kubelet\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.612952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612617    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-multus-socket-dir-parent\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.612952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612623    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9a77497b-33c1-4ac2-bfba-58b6edcf871e-dbus\") pod \"global-pull-secret-syncer-w2swh\" (UID: \"9a77497b-33c1-4ac2-bfba-58b6edcf871e\") " pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:06:51.612952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612635    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-host-run-multus-certs\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.612952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612625    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-multus-conf-dir\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.612952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612645    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-etc-openvswitch\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.612952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612686    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9a77497b-33c1-4ac2-bfba-58b6edcf871e-dbus\") pod \"global-pull-secret-syncer-w2swh\" (UID: \"9a77497b-33c1-4ac2-bfba-58b6edcf871e\") " pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:06:51.612952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612687    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-root\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:51.612952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612730    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-root\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:51.612952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612730    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-etc-openvswitch\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.612952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612730    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-sysctl-conf\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.612952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612765    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-systemd\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.612952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612782    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-host\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.612952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612800    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.612952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612823    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-modprobe-d\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.612952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612829    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-systemd\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.612952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612849    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-host\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.612952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612849    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-lib-modules\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.612952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612851    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.612952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612860    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-sysctl-conf\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.612952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612933    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-run-systemd\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.612952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612936    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-modprobe-d\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.612952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612906    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-run-systemd\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.612952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612967    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-lib-modules\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612977    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-node-log\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.612997    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d220536b-9c7c-4e34-8ac0-3c25ab4975f7-host\") pod \"node-ca-zfknz\" (UID: \"d220536b-9c7c-4e34-8ac0-3c25ab4975f7\") " pod="openshift-image-registry/node-ca-zfknz"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613015    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-system-cni-dir\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613021    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d220536b-9c7c-4e34-8ac0-3c25ab4975f7-host\") pod \"node-ca-zfknz\" (UID: \"d220536b-9c7c-4e34-8ac0-3c25ab4975f7\") " pod="openshift-image-registry/node-ca-zfknz"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613022    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-node-log\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613034    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/731f7925-494b-4442-b5c4-8d2df9379896-sys-fs\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613059    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-host-var-lib-cni-multus\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613064    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/731f7925-494b-4442-b5c4-8d2df9379896-sys-fs\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613074    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-host-var-lib-kubelet\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613075    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-system-cni-dir\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613087    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-host-var-lib-cni-multus\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613089    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-cni-bin\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613106    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-cni-bin\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613113    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/731f7925-494b-4442-b5c4-8d2df9379896-device-dir\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613132    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-multus-cni-dir\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613140    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/731f7925-494b-4442-b5c4-8d2df9379896-device-dir\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613148    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79843809-80ac-4069-b436-ba1a26348505-host-slash\") pod \"iptables-alerter-zt85z\" (UID: \"79843809-80ac-4069-b436-ba1a26348505\") " pod="openshift-network-operator/iptables-alerter-zt85z"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613114    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-host-var-lib-kubelet\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613167    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-kubernetes\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613189    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/731f7925-494b-4442-b5c4-8d2df9379896-registration-dir\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613203    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79843809-80ac-4069-b436-ba1a26348505-host-slash\") pod \"iptables-alerter-zt85z\" (UID: \"79843809-80ac-4069-b436-ba1a26348505\") " pod="openshift-network-operator/iptables-alerter-zt85z"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613213    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-sys\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613223    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-kubernetes\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613214    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-multus-cni-dir\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613237    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/731f7925-494b-4442-b5c4-8d2df9379896-registration-dir\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613243    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/05f90c13-3432-4e94-b368-66226fa6ff26-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613248    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-sys\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613266    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-slash\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613292    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05f90c13-3432-4e94-b368-66226fa6ff26-system-cni-dir\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613269    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/05f90c13-3432-4e94-b368-66226fa6ff26-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613318    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-host-var-lib-cni-bin\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613332    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-host-slash\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613343    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05f90c13-3432-4e94-b368-66226fa6ff26-system-cni-dir\") pod \"multus-additional-cni-plugins-9qsmp\" (UID: \"05f90c13-3432-4e94-b368-66226fa6ff26\") " pod="openshift-multus/multus-additional-cni-plugins-9qsmp"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613343    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-sysconfig\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613363    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-host-var-lib-cni-bin\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613365    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-sysctl-d\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613380    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-sysconfig\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613387    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9a77497b-33c1-4ac2-bfba-58b6edcf871e-kubelet-config\") pod \"global-pull-secret-syncer-w2swh\" (UID: \"9a77497b-33c1-4ac2-bfba-58b6edcf871e\") " pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613427    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-host-run-netns\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613434    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-etc-sysctl-d\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613442    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-systemd-units\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613445    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c705cd89-a6cf-4dcf-88b5-5ff2da580f07-host-run-netns\") pod \"multus-gqv8f\" (UID: \"c705cd89-a6cf-4dcf-88b5-5ff2da580f07\") " pod="openshift-multus/multus-gqv8f"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613428    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9a77497b-33c1-4ac2-bfba-58b6edcf871e-kubelet-config\") pod \"global-pull-secret-syncer-w2swh\" (UID: \"9a77497b-33c1-4ac2-bfba-58b6edcf871e\") " pod="kube-system/global-pull-secret-syncer-w2swh"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613459    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8-crio-socket\") pod \"insights-runtime-extractor-9b8f9\" (UID: \"cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8\") " pod="openshift-insights/insights-runtime-extractor-9b8f9"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613483    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/731f7925-494b-4442-b5c4-8d2df9379896-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613498    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-sys\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613500    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8-crio-socket\") pod \"insights-runtime-extractor-9b8f9\" (UID: \"cfa1be69-6ed1-4bcd-b32d-f45b30b91ca8\") " pod="openshift-insights/insights-runtime-extractor-9b8f9"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613514    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-node-exporter-wtmp\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613536    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-log-socket\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613460    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-systemd-units\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613543    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/731f7925-494b-4442-b5c4-8d2df9379896-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4xwkv\" (UID: \"731f7925-494b-4442-b5c4-8d2df9379896\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4xwkv"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613566    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/558cdaf8-03cf-4d61-9c28-94a5da9c886d-sys\") pod \"tuned-jggtz\" (UID: \"558cdaf8-03cf-4d61-9c28-94a5da9c886d\") " pod="openshift-cluster-node-tuning-operator/tuned-jggtz"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613608    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3e7ae74c-fcd8-4820-a8b7-769a5fff9f15-log-socket\") pod \"ovnkube-node-jb77f\" (UID: \"3e7ae74c-fcd8-4820-a8b7-769a5fff9f15\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:51.614065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:51.613615    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f8e6a0b5-f8b9-4d1b-848b-d3517004d495-node-exporter-wtmp\") pod \"node-exporter-z4kx5\" (UID: \"f8e6a0b5-f8b9-4d1b-848b-d3517004d495\") " pod="openshift-monitoring/node-exporter-z4kx5"
Nov 02 08:06:53.264128 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:53.264093    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-66fd4b7df4-7h5pn"
Nov 02 08:06:53.402413 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:53.402387    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-p2f6f"
Nov 02 08:06:54.225954 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:54.225924    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-tnr2r"
Nov 02 08:06:54.296789 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:54.296761    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:59.409282 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:59.409252    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:06:59.409650 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:06:59.409457    6210 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 02 08:07:00.702383 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:00.702351    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-669ff9f66c-ch5df"
Nov 02 08:07:00.823161 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:07:00.823123    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:07:00.874291 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:00.874263    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:07:01.257301 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:01.257228    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jb77f"
Nov 02 08:07:04.143801 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:04.143773    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zdsw7"
Nov 02 08:07:11.098289 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.098249    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 02 08:07:11.102692 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.102675    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.144463 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.144433    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 02 08:07:11.151247 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.151208    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f29973c2-deb1-457e-b560-2f104b000888-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.151367 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.151321    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f29973c2-deb1-457e-b560-2f104b000888-config-volume\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.151367 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.151346    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f29973c2-deb1-457e-b560-2f104b000888-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.151433 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.151381    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f29973c2-deb1-457e-b560-2f104b000888-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.151537 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.151512    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f29973c2-deb1-457e-b560-2f104b000888-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.151572 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.151547    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f29973c2-deb1-457e-b560-2f104b000888-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.151615 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.151603    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f29973c2-deb1-457e-b560-2f104b000888-web-config\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.151648 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.151625    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f29973c2-deb1-457e-b560-2f104b000888-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.151696 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.151684    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f29973c2-deb1-457e-b560-2f104b000888-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.151731 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.151708    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f29973c2-deb1-457e-b560-2f104b000888-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.151764 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.151751    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f29973c2-deb1-457e-b560-2f104b000888-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.151796 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.151788    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hsn8\" (UniqueName: \"kubernetes.io/projected/f29973c2-deb1-457e-b560-2f104b000888-kube-api-access-8hsn8\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.151834 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.151823    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f29973c2-deb1-457e-b560-2f104b000888-config-out\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.181416 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.181390    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Nov 02 08:07:11.181529 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.181463    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Nov 02 08:07:11.181529 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.181485    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Nov 02 08:07:11.181529 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.181496    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Nov 02 08:07:11.181529 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.181516    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Nov 02 08:07:11.181529 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.181518    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Nov 02 08:07:11.181710 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.181529    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cxtc9\""
Nov 02 08:07:11.246369 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.246335    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Nov 02 08:07:11.252160 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.252133    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f29973c2-deb1-457e-b560-2f104b000888-config-volume\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.252302 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.252166    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f29973c2-deb1-457e-b560-2f104b000888-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.252302 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.252183    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f29973c2-deb1-457e-b560-2f104b000888-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.252302 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.252206    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f29973c2-deb1-457e-b560-2f104b000888-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.252302 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.252222    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f29973c2-deb1-457e-b560-2f104b000888-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.252302 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.252250    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f29973c2-deb1-457e-b560-2f104b000888-web-config\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.252539 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.252367    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f29973c2-deb1-457e-b560-2f104b000888-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.252539 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.252400    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f29973c2-deb1-457e-b560-2f104b000888-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.252539 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.252425    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f29973c2-deb1-457e-b560-2f104b000888-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.252539 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.252460    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f29973c2-deb1-457e-b560-2f104b000888-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.252539 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.252484    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hsn8\" (UniqueName: \"kubernetes.io/projected/f29973c2-deb1-457e-b560-2f104b000888-kube-api-access-8hsn8\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.252539 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.252516    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f29973c2-deb1-457e-b560-2f104b000888-config-out\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.252848 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.252553    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f29973c2-deb1-457e-b560-2f104b000888-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.252848 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.252595    6210 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 02 08:07:11.252848 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.252663    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f29973c2-deb1-457e-b560-2f104b000888-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.253477 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.253451    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f29973c2-deb1-457e-b560-2f104b000888-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.253737 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.253709    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f29973c2-deb1-457e-b560-2f104b000888-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.255347 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.255324    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f29973c2-deb1-457e-b560-2f104b000888-config-out\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.255638 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.255613    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f29973c2-deb1-457e-b560-2f104b000888-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.255712 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.255651    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f29973c2-deb1-457e-b560-2f104b000888-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.255712 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.255685    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f29973c2-deb1-457e-b560-2f104b000888-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.255784 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.255718    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f29973c2-deb1-457e-b560-2f104b000888-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.255814 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.255779    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f29973c2-deb1-457e-b560-2f104b000888-config-volume\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.256354 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.256337    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f29973c2-deb1-457e-b560-2f104b000888-web-config\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.274790 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.274773    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Nov 02 08:07:11.274864 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.274830    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Nov 02 08:07:11.284532 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.284512    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f29973c2-deb1-457e-b560-2f104b000888-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.284695 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.284668    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f29973c2-deb1-457e-b560-2f104b000888-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.315887 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.315856    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hsn8\" (UniqueName: \"kubernetes.io/projected/f29973c2-deb1-457e-b560-2f104b000888-kube-api-access-8hsn8\") pod \"alertmanager-main-0\" (UID: \"f29973c2-deb1-457e-b560-2f104b000888\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.419062 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.418988    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Nov 02 08:07:11.833352 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:11.833322    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 02 08:07:11.836627 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:07:11.836598    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf29973c2_deb1_457e_b560_2f104b000888.slice/crio-8d0756d5552bac82d55c1f136d2478482be83a8922f2c6392e9c671ec34c1b80 WatchSource:0}: Error finding container 8d0756d5552bac82d55c1f136d2478482be83a8922f2c6392e9c671ec34c1b80: Status 404 returned error can't find the container with id 8d0756d5552bac82d55c1f136d2478482be83a8922f2c6392e9c671ec34c1b80
Nov 02 08:07:12.480304 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:12.480268    6210 generic.go:356] "Generic (PLEG): container finished" podID="f29973c2-deb1-457e-b560-2f104b000888" containerID="1023dd8aa3f564d721db7b50d5d70c275a9674b2d91e25e83eb29f31b66ea8ba" exitCode=0
Nov 02 08:07:12.480677 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:12.480343    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f29973c2-deb1-457e-b560-2f104b000888","Type":"ContainerDied","Data":"1023dd8aa3f564d721db7b50d5d70c275a9674b2d91e25e83eb29f31b66ea8ba"}
Nov 02 08:07:12.480677 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:12.480411    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f29973c2-deb1-457e-b560-2f104b000888","Type":"ContainerStarted","Data":"8d0756d5552bac82d55c1f136d2478482be83a8922f2c6392e9c671ec34c1b80"}
Nov 02 08:07:12.481524 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:12.481508    6210 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 02 08:07:14.493568 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:14.493525    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f29973c2-deb1-457e-b560-2f104b000888","Type":"ContainerStarted","Data":"86b43bcb1f09f0f4080dff6b98e3e7a5bf57fbdb3e4c3b435175b5167e7ea865"}
Nov 02 08:07:14.493944 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:14.493649    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f29973c2-deb1-457e-b560-2f104b000888","Type":"ContainerStarted","Data":"1cc7d014707a50ea64ec14e81464bcb712b95df4ffa698ab1100b5e4a64401a5"}
Nov 02 08:07:15.500111 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:15.500077    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f29973c2-deb1-457e-b560-2f104b000888","Type":"ContainerStarted","Data":"85b9e4df5b9f438975b791e07682e2e3cf4bafdbcb4d0ef9f73403f2baf7aabf"}
Nov 02 08:07:15.500587 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:15.500142    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f29973c2-deb1-457e-b560-2f104b000888","Type":"ContainerStarted","Data":"64d52bab82d40fd249060d712c6279d102a0d05759f2a0b65e9ef6be37022049"}
Nov 02 08:07:15.500587 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:15.500170    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f29973c2-deb1-457e-b560-2f104b000888","Type":"ContainerStarted","Data":"df30fea7c75031de05e3431f3e26ebd9b1ebf5ab75c65ef6db817dd879d3a4e3"}
Nov 02 08:07:15.500587 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:15.500193    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f29973c2-deb1-457e-b560-2f104b000888","Type":"ContainerStarted","Data":"7a9cd0891ef4948acdd0ae30fbd700d1f748900d5c63a0f8003b8e03fcdae60c"}
Nov 02 08:07:15.751637 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:15.751541    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.856747047 podStartE2EDuration="4.751524854s" totalImagesPullingTime="1.88299296s" totalInitContainerRuntime="11.784847ms" isStatefulPod=false podCreationTimestamp="2026-11-02 08:07:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:07:15.705466084 +0000 UTC m=+25.463894814" watchObservedRunningTime="2026-11-02 08:07:15.751524854 +0000 UTC m=+25.509953583"
Nov 02 08:07:20.877042 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:07:20.877008    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5qkvj"
Nov 02 08:07:30.819774 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:07:30.819734    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:08:00.820871 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:08:00.820832    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:08:30.819378 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:08:30.819342    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:09:00.819750 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:09:00.819716    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:09:30.820235 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:09:30.820197    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:09:40.360571 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.360537    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q"]
Nov 02 08:09:40.363889 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.363866    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q"
Nov 02 08:09:40.413290 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.413259    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Nov 02 08:09:40.413290 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.413282    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Nov 02 08:09:40.431870 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.431844    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q\" (UID: \"f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q"
Nov 02 08:09:40.431998 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.431910    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q\" (UID: \"f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q"
Nov 02 08:09:40.432064 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.432030    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmqlg\" (UniqueName: \"kubernetes.io/projected/f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae-kube-api-access-jmqlg\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q\" (UID: \"f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q"
Nov 02 08:09:40.459955 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.459928    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e644421527c169d876fdb59235c927986d6bd2-9d2815fc-dockercfg-ndh4j\""
Nov 02 08:09:40.460469 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.460450    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q"]
Nov 02 08:09:40.533232 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.533199    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmqlg\" (UniqueName: \"kubernetes.io/projected/f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae-kube-api-access-jmqlg\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q\" (UID: \"f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q"
Nov 02 08:09:40.533393 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.533251    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q\" (UID: \"f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q"
Nov 02 08:09:40.533393 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.533290    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q\" (UID: \"f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q"
Nov 02 08:09:40.533626 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.533611    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q\" (UID: \"f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q"
Nov 02 08:09:40.533677 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.533644    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q\" (UID: \"f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q"
Nov 02 08:09:40.598477 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.598446    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmqlg\" (UniqueName: \"kubernetes.io/projected/f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae-kube-api-access-jmqlg\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q\" (UID: \"f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q"
Nov 02 08:09:40.679722 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.679641    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q"
Nov 02 08:09:40.775204 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.775171    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j"]
Nov 02 08:09:40.778716 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.778699    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j"
Nov 02 08:09:40.829599 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.829540    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Nov 02 08:09:40.829599 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.829599    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Nov 02 08:09:40.829835 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.829646    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Nov 02 08:09:40.829835 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.829709    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Nov 02 08:09:40.829835 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.829715    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Nov 02 08:09:40.829835 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.829741    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Nov 02 08:09:40.829835 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.829813    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-p8mvq\""
Nov 02 08:09:40.836214 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.836191    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d6f480a-b512-470e-b287-dcb7afcc9e90-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-zhc8j\" (UID: \"4d6f480a-b512-470e-b287-dcb7afcc9e90\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j"
Nov 02 08:09:40.836324 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.836228    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4d6f480a-b512-470e-b287-dcb7afcc9e90-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-zhc8j\" (UID: \"4d6f480a-b512-470e-b287-dcb7afcc9e90\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j"
Nov 02 08:09:40.836366 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.836325    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpqjc\" (UniqueName: \"kubernetes.io/projected/4d6f480a-b512-470e-b287-dcb7afcc9e90-kube-api-access-dpqjc\") pod \"istiod-openshift-gateway-7876bfcb74-zhc8j\" (UID: \"4d6f480a-b512-470e-b287-dcb7afcc9e90\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j"
Nov 02 08:09:40.836366 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.836360    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d6f480a-b512-470e-b287-dcb7afcc9e90-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-zhc8j\" (UID: \"4d6f480a-b512-470e-b287-dcb7afcc9e90\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j"
Nov 02 08:09:40.836504 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.836388    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4d6f480a-b512-470e-b287-dcb7afcc9e90-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-zhc8j\" (UID: \"4d6f480a-b512-470e-b287-dcb7afcc9e90\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j"
Nov 02 08:09:40.836504 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.836419    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4d6f480a-b512-470e-b287-dcb7afcc9e90-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-zhc8j\" (UID: \"4d6f480a-b512-470e-b287-dcb7afcc9e90\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j"
Nov 02 08:09:40.836504 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.836472    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4d6f480a-b512-470e-b287-dcb7afcc9e90-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-zhc8j\" (UID: \"4d6f480a-b512-470e-b287-dcb7afcc9e90\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j"
Nov 02 08:09:40.876333 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.876301    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j"]
Nov 02 08:09:40.936912 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.936815    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d6f480a-b512-470e-b287-dcb7afcc9e90-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-zhc8j\" (UID: \"4d6f480a-b512-470e-b287-dcb7afcc9e90\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j"
Nov 02 08:09:40.936912 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.936870    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4d6f480a-b512-470e-b287-dcb7afcc9e90-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-zhc8j\" (UID: \"4d6f480a-b512-470e-b287-dcb7afcc9e90\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j"
Nov 02 08:09:40.937139 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.936932    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpqjc\" (UniqueName: \"kubernetes.io/projected/4d6f480a-b512-470e-b287-dcb7afcc9e90-kube-api-access-dpqjc\") pod \"istiod-openshift-gateway-7876bfcb74-zhc8j\" (UID: \"4d6f480a-b512-470e-b287-dcb7afcc9e90\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j"
Nov 02 08:09:40.937139 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.936953    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d6f480a-b512-470e-b287-dcb7afcc9e90-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-zhc8j\" (UID: \"4d6f480a-b512-470e-b287-dcb7afcc9e90\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j"
Nov 02 08:09:40.937139 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.936989    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4d6f480a-b512-470e-b287-dcb7afcc9e90-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-zhc8j\" (UID: \"4d6f480a-b512-470e-b287-dcb7afcc9e90\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j"
Nov 02 08:09:40.937139 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.937015    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4d6f480a-b512-470e-b287-dcb7afcc9e90-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-zhc8j\" (UID: \"4d6f480a-b512-470e-b287-dcb7afcc9e90\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j"
Nov 02 08:09:40.937139 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.937042    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4d6f480a-b512-470e-b287-dcb7afcc9e90-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-zhc8j\" (UID: \"4d6f480a-b512-470e-b287-dcb7afcc9e90\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j"
Nov 02 08:09:40.937710 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.937684    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4d6f480a-b512-470e-b287-dcb7afcc9e90-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-zhc8j\" (UID: \"4d6f480a-b512-470e-b287-dcb7afcc9e90\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j"
Nov 02 08:09:40.939304 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.939280    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4d6f480a-b512-470e-b287-dcb7afcc9e90-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-zhc8j\" (UID: \"4d6f480a-b512-470e-b287-dcb7afcc9e90\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j"
Nov 02 08:09:40.939464 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.939442    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d6f480a-b512-470e-b287-dcb7afcc9e90-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-zhc8j\" (UID: \"4d6f480a-b512-470e-b287-dcb7afcc9e90\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j"
Nov 02 08:09:40.939531 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.939467    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4d6f480a-b512-470e-b287-dcb7afcc9e90-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-zhc8j\" (UID: \"4d6f480a-b512-470e-b287-dcb7afcc9e90\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j"
Nov 02 08:09:40.939764 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.939746    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4d6f480a-b512-470e-b287-dcb7afcc9e90-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-zhc8j\" (UID: \"4d6f480a-b512-470e-b287-dcb7afcc9e90\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j"
Nov 02 08:09:40.989864 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.989829    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpqjc\" (UniqueName: \"kubernetes.io/projected/4d6f480a-b512-470e-b287-dcb7afcc9e90-kube-api-access-dpqjc\") pod \"istiod-openshift-gateway-7876bfcb74-zhc8j\" (UID: \"4d6f480a-b512-470e-b287-dcb7afcc9e90\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j"
Nov 02 08:09:40.990131 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:40.990109    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d6f480a-b512-470e-b287-dcb7afcc9e90-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-zhc8j\" (UID: \"4d6f480a-b512-470e-b287-dcb7afcc9e90\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j"
Nov 02 08:09:41.039017 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:41.038986    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q"]
Nov 02 08:09:41.042417 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:09:41.042387    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3cb8c6f_b7b8_48c0_ae4c_d8d3123bf2ae.slice/crio-fc2fd0935bc8c5b11ce00939da91f69dbef64f6b8e5ea1ffe158f1a9538ba7bc WatchSource:0}: Error finding container fc2fd0935bc8c5b11ce00939da91f69dbef64f6b8e5ea1ffe158f1a9538ba7bc: Status 404 returned error can't find the container with id fc2fd0935bc8c5b11ce00939da91f69dbef64f6b8e5ea1ffe158f1a9538ba7bc
Nov 02 08:09:41.090017 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:41.089992    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j"
Nov 02 08:09:41.504894 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:41.501927    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j"]
Nov 02 08:09:41.508558 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:09:41.508527    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d6f480a_b512_470e_b287_dcb7afcc9e90.slice/crio-67d1026cedaa140671b7bccacea847c223cfcf08f49d5281987c54d86173eda4 WatchSource:0}: Error finding container 67d1026cedaa140671b7bccacea847c223cfcf08f49d5281987c54d86173eda4: Status 404 returned error can't find the container with id 67d1026cedaa140671b7bccacea847c223cfcf08f49d5281987c54d86173eda4
Nov 02 08:09:41.993940 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:41.993908    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j" event={"ID":"4d6f480a-b512-470e-b287-dcb7afcc9e90","Type":"ContainerStarted","Data":"67d1026cedaa140671b7bccacea847c223cfcf08f49d5281987c54d86173eda4"}
Nov 02 08:09:41.994955 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:41.994929    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q" event={"ID":"f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae","Type":"ContainerStarted","Data":"fc2fd0935bc8c5b11ce00939da91f69dbef64f6b8e5ea1ffe158f1a9538ba7bc"}
Nov 02 08:09:45.873521 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:45.873484    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:09:45.873953 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:45.873558    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:09:46.016264 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:46.016223    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j" event={"ID":"4d6f480a-b512-470e-b287-dcb7afcc9e90","Type":"ContainerStarted","Data":"04dac11577eb37045b2b494ac27032393387e18da6293f0b1e128ef2f9fadb82"}
Nov 02 08:09:46.017267 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:46.017204    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j"
Nov 02 08:09:46.019324 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:46.019298    6210 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7876bfcb74-zhc8j container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 08:09:46.019447 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:46.019345    6210 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j" podUID="4d6f480a-b512-470e-b287-dcb7afcc9e90" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 08:09:46.146350 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:46.146239    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j" podStartSLOduration=1.784079002 podStartE2EDuration="6.146218896s" totalImagesPullingTime="4.362139894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:09:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:09:46.145601159 +0000 UTC m=+175.904029892" watchObservedRunningTime="2026-11-02 08:09:46.146218896 +0000 UTC m=+175.904647628"
Nov 02 08:09:47.021220 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:47.021187    6210 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7876bfcb74-zhc8j container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 08:09:47.021643 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:47.021242    6210 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j" podUID="4d6f480a-b512-470e-b287-dcb7afcc9e90" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 08:09:48.026736 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:48.026701    6210 generic.go:356] "Generic (PLEG): container finished" podID="f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae" containerID="947c47c7319a8d19bb05c0bf35ae33328bea782e6546f2f7e52baa631c411598" exitCode=0
Nov 02 08:09:48.027367 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:48.026799    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q" event={"ID":"f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae","Type":"ContainerDied","Data":"947c47c7319a8d19bb05c0bf35ae33328bea782e6546f2f7e52baa631c411598"}
Nov 02 08:09:48.028488 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:48.028470    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j"
Nov 02 08:09:50.035756 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:50.035715    6210 generic.go:356] "Generic (PLEG): container finished" podID="f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae" containerID="6f92cd6464e72a067e7f81ce51b3674d0bdd2723d883ca59d8ad0241e35320bd" exitCode=0
Nov 02 08:09:50.036177 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:50.035800    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q" event={"ID":"f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae","Type":"ContainerDied","Data":"6f92cd6464e72a067e7f81ce51b3674d0bdd2723d883ca59d8ad0241e35320bd"}
Nov 02 08:09:57.068843 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:57.068810    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q" event={"ID":"f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae","Type":"ContainerStarted","Data":"12cdb73a06d1c3aa18a40d397cd12a00421519f9753759069ad2f5410eeb3a23"}
Nov 02 08:09:57.177970 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:09:57.177925    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q" podStartSLOduration=3.070873165 podStartE2EDuration="17.177909923s" totalImagesPullingTime="14.107036758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:09:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:09:57.176898619 +0000 UTC m=+186.935327347" watchObservedRunningTime="2026-11-02 08:09:57.177909923 +0000 UTC m=+186.936338654"
Nov 02 08:10:00.820042 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:10:00.820000    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:10:07.104537 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:07.104463    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q_f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae/extract/0.log"
Nov 02 08:10:07.105185 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:07.105162    6210 generic.go:356] "Generic (PLEG): container finished" podID="f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae" containerID="12cdb73a06d1c3aa18a40d397cd12a00421519f9753759069ad2f5410eeb3a23" exitCode=1
Nov 02 08:10:07.105242 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:07.105200    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q" event={"ID":"f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae","Type":"ContainerDied","Data":"12cdb73a06d1c3aa18a40d397cd12a00421519f9753759069ad2f5410eeb3a23"}
Nov 02 08:10:08.230445 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:08.230422    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q_f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae/extract/0.log"
Nov 02 08:10:08.247902 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:08.247858    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q"
Nov 02 08:10:08.373241 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:08.373168    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae-bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae-bundle\") pod \"f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae\" (UID: \"f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae\") "
Nov 02 08:10:08.373414 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:08.373256    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae-kube-api-access-jmqlg\" (UniqueName: \"kubernetes.io/projected/f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae-kube-api-access-jmqlg\") pod \"f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae\" (UID: \"f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae\") "
Nov 02 08:10:08.373414 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:08.373287    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae-util\" (UniqueName: \"kubernetes.io/empty-dir/f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae-util\") pod \"f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae\" (UID: \"f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae\") "
Nov 02 08:10:08.373894 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:08.373842    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae-bundle" pod "f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae" (UID: "f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:10:08.375459 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:08.375433    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae-kube-api-access-jmqlg" pod "f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae" (UID: "f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae"). InnerVolumeSpecName "kube-api-access-jmqlg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:10:08.378403 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:08.378376    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae-util" pod "f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae" (UID: "f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:10:08.473901 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:08.473851    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmqlg\" (UniqueName: \"kubernetes.io/projected/f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae-kube-api-access-jmqlg\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:10:08.473901 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:08.473890    6210 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae-util\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:10:08.473901 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:08.473900    6210 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae-bundle\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:10:09.112969 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:09.112942    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q_f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae/extract/0.log"
Nov 02 08:10:09.113667 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:09.113647    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q"
Nov 02 08:10:09.113769 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:09.113664    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q" event={"ID":"f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae","Type":"ContainerDied","Data":"fc2fd0935bc8c5b11ce00939da91f69dbef64f6b8e5ea1ffe158f1a9538ba7bc"}
Nov 02 08:10:09.113769 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:09.113715    6210 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fc2fd0935bc8c5b11ce00939da91f69dbef64f6b8e5ea1ffe158f1a9538ba7bc"
Nov 02 08:10:30.820014 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:10:30.819976    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:10:34.831559 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:34.831528    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-b679c64f6-sscc5"]
Nov 02 08:10:34.831963 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:34.831850    6210 cpu_manager.go:414] "containerMap: removing container" podUID="f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae" containerName="util"
Nov 02 08:10:34.831963 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:34.831861    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae" containerName="util"
Nov 02 08:10:34.831963 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:34.831871    6210 cpu_manager.go:414] "containerMap: removing container" podUID="f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae" containerName="pull"
Nov 02 08:10:34.831963 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:34.831889    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae" containerName="pull"
Nov 02 08:10:34.831963 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:34.831917    6210 cpu_manager.go:414] "containerMap: removing container" podUID="f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae" containerName="extract"
Nov 02 08:10:34.831963 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:34.831924    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae" containerName="extract"
Nov 02 08:10:34.832146 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:34.832001    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae" containerName="extract"
Nov 02 08:10:34.833981 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:34.833963    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b679c64f6-sscc5"
Nov 02 08:10:34.890053 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:34.890020    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b11c78ff-5898-4162-ac02-a49b495b5910-webhook-cert\") pod \"opendatahub-operator-controller-manager-b679c64f6-sscc5\" (UID: \"b11c78ff-5898-4162-ac02-a49b495b5910\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b679c64f6-sscc5"
Nov 02 08:10:34.890053 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:34.890061    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b11c78ff-5898-4162-ac02-a49b495b5910-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b679c64f6-sscc5\" (UID: \"b11c78ff-5898-4162-ac02-a49b495b5910\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b679c64f6-sscc5"
Nov 02 08:10:34.890264 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:34.890091    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b11c78ff-5898-4162-ac02-a49b495b5910-manifests\") pod \"opendatahub-operator-controller-manager-b679c64f6-sscc5\" (UID: \"b11c78ff-5898-4162-ac02-a49b495b5910\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b679c64f6-sscc5"
Nov 02 08:10:34.890264 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:34.890200    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b11c78ff-5898-4162-ac02-a49b495b5910-tmp\") pod \"opendatahub-operator-controller-manager-b679c64f6-sscc5\" (UID: \"b11c78ff-5898-4162-ac02-a49b495b5910\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b679c64f6-sscc5"
Nov 02 08:10:34.890264 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:34.890231    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq45t\" (UniqueName: \"kubernetes.io/projected/b11c78ff-5898-4162-ac02-a49b495b5910-kube-api-access-mq45t\") pod \"opendatahub-operator-controller-manager-b679c64f6-sscc5\" (UID: \"b11c78ff-5898-4162-ac02-a49b495b5910\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b679c64f6-sscc5"
Nov 02 08:10:34.890264 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:34.890261    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b11c78ff-5898-4162-ac02-a49b495b5910-metrics-cert\") pod \"opendatahub-operator-controller-manager-b679c64f6-sscc5\" (UID: \"b11c78ff-5898-4162-ac02-a49b495b5910\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b679c64f6-sscc5"
Nov 02 08:10:34.901329 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:34.901301    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Nov 02 08:10:34.930945 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:34.930912    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Nov 02 08:10:34.930945 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:34.930924    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Nov 02 08:10:34.931133 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:34.930961    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Nov 02 08:10:34.931133 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:34.930974    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Nov 02 08:10:34.931133 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:34.930980    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-x42xc\""
Nov 02 08:10:34.990584 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:34.990547    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b11c78ff-5898-4162-ac02-a49b495b5910-tmp\") pod \"opendatahub-operator-controller-manager-b679c64f6-sscc5\" (UID: \"b11c78ff-5898-4162-ac02-a49b495b5910\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b679c64f6-sscc5"
Nov 02 08:10:34.990584 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:34.990587    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq45t\" (UniqueName: \"kubernetes.io/projected/b11c78ff-5898-4162-ac02-a49b495b5910-kube-api-access-mq45t\") pod \"opendatahub-operator-controller-manager-b679c64f6-sscc5\" (UID: \"b11c78ff-5898-4162-ac02-a49b495b5910\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b679c64f6-sscc5"
Nov 02 08:10:34.990823 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:34.990709    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b11c78ff-5898-4162-ac02-a49b495b5910-metrics-cert\") pod \"opendatahub-operator-controller-manager-b679c64f6-sscc5\" (UID: \"b11c78ff-5898-4162-ac02-a49b495b5910\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b679c64f6-sscc5"
Nov 02 08:10:34.990823 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:34.990743    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b11c78ff-5898-4162-ac02-a49b495b5910-webhook-cert\") pod \"opendatahub-operator-controller-manager-b679c64f6-sscc5\" (UID: \"b11c78ff-5898-4162-ac02-a49b495b5910\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b679c64f6-sscc5"
Nov 02 08:10:34.990823 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:34.990789    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b11c78ff-5898-4162-ac02-a49b495b5910-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b679c64f6-sscc5\" (UID: \"b11c78ff-5898-4162-ac02-a49b495b5910\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b679c64f6-sscc5"
Nov 02 08:10:34.991010 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:34.990838    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b11c78ff-5898-4162-ac02-a49b495b5910-manifests\") pod \"opendatahub-operator-controller-manager-b679c64f6-sscc5\" (UID: \"b11c78ff-5898-4162-ac02-a49b495b5910\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b679c64f6-sscc5"
Nov 02 08:10:34.991275 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:34.991237    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b11c78ff-5898-4162-ac02-a49b495b5910-manifests\") pod \"opendatahub-operator-controller-manager-b679c64f6-sscc5\" (UID: \"b11c78ff-5898-4162-ac02-a49b495b5910\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b679c64f6-sscc5"
Nov 02 08:10:34.992840 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:34.992809    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b11c78ff-5898-4162-ac02-a49b495b5910-tmp\") pod \"opendatahub-operator-controller-manager-b679c64f6-sscc5\" (UID: \"b11c78ff-5898-4162-ac02-a49b495b5910\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b679c64f6-sscc5"
Nov 02 08:10:34.993268 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:34.993239    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b11c78ff-5898-4162-ac02-a49b495b5910-metrics-cert\") pod \"opendatahub-operator-controller-manager-b679c64f6-sscc5\" (UID: \"b11c78ff-5898-4162-ac02-a49b495b5910\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b679c64f6-sscc5"
Nov 02 08:10:34.993370 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:34.993240    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b11c78ff-5898-4162-ac02-a49b495b5910-webhook-cert\") pod \"opendatahub-operator-controller-manager-b679c64f6-sscc5\" (UID: \"b11c78ff-5898-4162-ac02-a49b495b5910\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b679c64f6-sscc5"
Nov 02 08:10:34.993370 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:34.993299    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b11c78ff-5898-4162-ac02-a49b495b5910-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b679c64f6-sscc5\" (UID: \"b11c78ff-5898-4162-ac02-a49b495b5910\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b679c64f6-sscc5"
Nov 02 08:10:35.046933 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:35.046905    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq45t\" (UniqueName: \"kubernetes.io/projected/b11c78ff-5898-4162-ac02-a49b495b5910-kube-api-access-mq45t\") pod \"opendatahub-operator-controller-manager-b679c64f6-sscc5\" (UID: \"b11c78ff-5898-4162-ac02-a49b495b5910\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b679c64f6-sscc5"
Nov 02 08:10:35.146658 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:35.146576    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b679c64f6-sscc5"
Nov 02 08:10:35.184699 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:35.184666    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-b679c64f6-sscc5"]
Nov 02 08:10:35.863331 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:35.863301    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-b679c64f6-sscc5"]
Nov 02 08:10:35.866312 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:10:35.866272    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb11c78ff_5898_4162_ac02_a49b495b5910.slice/crio-4ace99e37ac7ecae2a567e9589e2d64e89877eff1db0b0a6377f68874ca54a8f WatchSource:0}: Error finding container 4ace99e37ac7ecae2a567e9589e2d64e89877eff1db0b0a6377f68874ca54a8f: Status 404 returned error can't find the container with id 4ace99e37ac7ecae2a567e9589e2d64e89877eff1db0b0a6377f68874ca54a8f
Nov 02 08:10:36.209050 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:36.209017    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b679c64f6-sscc5" event={"ID":"b11c78ff-5898-4162-ac02-a49b495b5910","Type":"ContainerStarted","Data":"4ace99e37ac7ecae2a567e9589e2d64e89877eff1db0b0a6377f68874ca54a8f"}
Nov 02 08:10:40.227627 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:40.227593    6210 generic.go:356] "Generic (PLEG): container finished" podID="b11c78ff-5898-4162-ac02-a49b495b5910" containerID="f2e82f7a520c7d6dbdee6b3976a7a7624b1a6fb66cd9902a90412bac32f86fb2" exitCode=0
Nov 02 08:10:40.228104 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:40.227676    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b679c64f6-sscc5" event={"ID":"b11c78ff-5898-4162-ac02-a49b495b5910","Type":"ContainerDied","Data":"f2e82f7a520c7d6dbdee6b3976a7a7624b1a6fb66cd9902a90412bac32f86fb2"}
Nov 02 08:10:41.233117 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:41.233083    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b679c64f6-sscc5" event={"ID":"b11c78ff-5898-4162-ac02-a49b495b5910","Type":"ContainerStarted","Data":"13941636376a027c1b7386f9c411cbb1bf849bea20fa69a847dcdadbb244fc02"}
Nov 02 08:10:41.233498 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:41.233227    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b679c64f6-sscc5"
Nov 02 08:10:41.471524 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:41.471467    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b679c64f6-sscc5" podStartSLOduration=2.792053776 podStartE2EDuration="7.471454426s" totalImagesPullingTime="4.201677707s" totalInitContainerRuntime="477.722943ms" isStatefulPod=false podCreationTimestamp="2026-11-02 08:10:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:10:41.424868124 +0000 UTC m=+231.183296847" watchObservedRunningTime="2026-11-02 08:10:41.471454426 +0000 UTC m=+231.229883147"
Nov 02 08:10:52.239132 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:10:52.239098    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b679c64f6-sscc5"
Nov 02 08:11:00.819622 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:11:00.819577    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:11:26.183092 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:26.183051    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7ddcd68ff8-rjfdr"]
Nov 02 08:11:26.186525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:26.186503    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7ddcd68ff8-rjfdr"
Nov 02 08:11:26.236659 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:26.236626    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7q8s\" (UniqueName: \"kubernetes.io/projected/e6dfdfa3-d7b8-4a15-b2d8-2563c3361756-kube-api-access-h7q8s\") pod \"kube-auth-proxy-7ddcd68ff8-rjfdr\" (UID: \"e6dfdfa3-d7b8-4a15-b2d8-2563c3361756\") " pod="openshift-ingress/kube-auth-proxy-7ddcd68ff8-rjfdr"
Nov 02 08:11:26.236659 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:26.236662    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6dfdfa3-d7b8-4a15-b2d8-2563c3361756-tmp\") pod \"kube-auth-proxy-7ddcd68ff8-rjfdr\" (UID: \"e6dfdfa3-d7b8-4a15-b2d8-2563c3361756\") " pod="openshift-ingress/kube-auth-proxy-7ddcd68ff8-rjfdr"
Nov 02 08:11:26.236847 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:26.236760    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6dfdfa3-d7b8-4a15-b2d8-2563c3361756-tls-certs\") pod \"kube-auth-proxy-7ddcd68ff8-rjfdr\" (UID: \"e6dfdfa3-d7b8-4a15-b2d8-2563c3361756\") " pod="openshift-ingress/kube-auth-proxy-7ddcd68ff8-rjfdr"
Nov 02 08:11:26.243191 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:26.243160    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7ddcd68ff8-rjfdr"]
Nov 02 08:11:26.273923 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:26.273888    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Nov 02 08:11:26.285824 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:26.285798    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-qkpvv\""
Nov 02 08:11:26.285959 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:26.285846    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Nov 02 08:11:26.337246 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:26.337218    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7q8s\" (UniqueName: \"kubernetes.io/projected/e6dfdfa3-d7b8-4a15-b2d8-2563c3361756-kube-api-access-h7q8s\") pod \"kube-auth-proxy-7ddcd68ff8-rjfdr\" (UID: \"e6dfdfa3-d7b8-4a15-b2d8-2563c3361756\") " pod="openshift-ingress/kube-auth-proxy-7ddcd68ff8-rjfdr"
Nov 02 08:11:26.337401 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:26.337252    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6dfdfa3-d7b8-4a15-b2d8-2563c3361756-tmp\") pod \"kube-auth-proxy-7ddcd68ff8-rjfdr\" (UID: \"e6dfdfa3-d7b8-4a15-b2d8-2563c3361756\") " pod="openshift-ingress/kube-auth-proxy-7ddcd68ff8-rjfdr"
Nov 02 08:11:26.337401 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:26.337287    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6dfdfa3-d7b8-4a15-b2d8-2563c3361756-tls-certs\") pod \"kube-auth-proxy-7ddcd68ff8-rjfdr\" (UID: \"e6dfdfa3-d7b8-4a15-b2d8-2563c3361756\") " pod="openshift-ingress/kube-auth-proxy-7ddcd68ff8-rjfdr"
Nov 02 08:11:26.339471 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:26.339442    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6dfdfa3-d7b8-4a15-b2d8-2563c3361756-tmp\") pod \"kube-auth-proxy-7ddcd68ff8-rjfdr\" (UID: \"e6dfdfa3-d7b8-4a15-b2d8-2563c3361756\") " pod="openshift-ingress/kube-auth-proxy-7ddcd68ff8-rjfdr"
Nov 02 08:11:26.339679 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:26.339659    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6dfdfa3-d7b8-4a15-b2d8-2563c3361756-tls-certs\") pod \"kube-auth-proxy-7ddcd68ff8-rjfdr\" (UID: \"e6dfdfa3-d7b8-4a15-b2d8-2563c3361756\") " pod="openshift-ingress/kube-auth-proxy-7ddcd68ff8-rjfdr"
Nov 02 08:11:26.390595 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:26.390567    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7q8s\" (UniqueName: \"kubernetes.io/projected/e6dfdfa3-d7b8-4a15-b2d8-2563c3361756-kube-api-access-h7q8s\") pod \"kube-auth-proxy-7ddcd68ff8-rjfdr\" (UID: \"e6dfdfa3-d7b8-4a15-b2d8-2563c3361756\") " pod="openshift-ingress/kube-auth-proxy-7ddcd68ff8-rjfdr"
Nov 02 08:11:26.498111 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:26.498083    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7ddcd68ff8-rjfdr"
Nov 02 08:11:26.856726 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:26.856653    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7ddcd68ff8-rjfdr"]
Nov 02 08:11:26.860132 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:11:26.860105    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6dfdfa3_d7b8_4a15_b2d8_2563c3361756.slice/crio-a44b340771b6dd00597c165a8807735126dc7d8a42e7b39422ae243267a52557 WatchSource:0}: Error finding container a44b340771b6dd00597c165a8807735126dc7d8a42e7b39422ae243267a52557: Status 404 returned error can't find the container with id a44b340771b6dd00597c165a8807735126dc7d8a42e7b39422ae243267a52557
Nov 02 08:11:27.409864 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:27.409830    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7ddcd68ff8-rjfdr" event={"ID":"e6dfdfa3-d7b8-4a15-b2d8-2563c3361756","Type":"ContainerStarted","Data":"a44b340771b6dd00597c165a8807735126dc7d8a42e7b39422ae243267a52557"}
Nov 02 08:11:28.863521 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:28.863401    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-2hmg8"]
Nov 02 08:11:28.867375 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:28.867354    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-2hmg8"
Nov 02 08:11:28.919915 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:28.919869    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-2hmg8"]
Nov 02 08:11:28.958363 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:28.958332    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2d34429e-a310-4c89-aa75-cb0a590ed09b-config-file\") pod \"limitador-limitador-74dfcfb894-2hmg8\" (UID: \"2d34429e-a310-4c89-aa75-cb0a590ed09b\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-2hmg8"
Nov 02 08:11:28.958534 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:28.958379    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knvv6\" (UniqueName: \"kubernetes.io/projected/2d34429e-a310-4c89-aa75-cb0a590ed09b-kube-api-access-knvv6\") pod \"limitador-limitador-74dfcfb894-2hmg8\" (UID: \"2d34429e-a310-4c89-aa75-cb0a590ed09b\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-2hmg8"
Nov 02 08:11:28.965317 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:28.965291    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Nov 02 08:11:28.965449 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:28.965291    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Nov 02 08:11:28.965449 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:28.965360    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-p96n8\""
Nov 02 08:11:28.965449 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:28.965421    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Nov 02 08:11:29.059464 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:29.059420    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knvv6\" (UniqueName: \"kubernetes.io/projected/2d34429e-a310-4c89-aa75-cb0a590ed09b-kube-api-access-knvv6\") pod \"limitador-limitador-74dfcfb894-2hmg8\" (UID: \"2d34429e-a310-4c89-aa75-cb0a590ed09b\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-2hmg8"
Nov 02 08:11:29.059663 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:29.059564    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2d34429e-a310-4c89-aa75-cb0a590ed09b-config-file\") pod \"limitador-limitador-74dfcfb894-2hmg8\" (UID: \"2d34429e-a310-4c89-aa75-cb0a590ed09b\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-2hmg8"
Nov 02 08:11:29.060358 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:29.060331    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2d34429e-a310-4c89-aa75-cb0a590ed09b-config-file\") pod \"limitador-limitador-74dfcfb894-2hmg8\" (UID: \"2d34429e-a310-4c89-aa75-cb0a590ed09b\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-2hmg8"
Nov 02 08:11:29.099167 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:29.099136    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-2hmg8"]
Nov 02 08:11:29.112835 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:29.112809    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knvv6\" (UniqueName: \"kubernetes.io/projected/2d34429e-a310-4c89-aa75-cb0a590ed09b-kube-api-access-knvv6\") pod \"limitador-limitador-74dfcfb894-2hmg8\" (UID: \"2d34429e-a310-4c89-aa75-cb0a590ed09b\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-2hmg8"
Nov 02 08:11:29.184176 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:29.184102    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-2hmg8"
Nov 02 08:11:29.567847 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:29.567808    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-2hmg8"]
Nov 02 08:11:29.572241 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:11:29.572212    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d34429e_a310_4c89_aa75_cb0a590ed09b.slice/crio-c7567bb1089cd20a49b8fdd4b2bd46f19fcadc75ad76e9a0574687cd9a3f0d35 WatchSource:0}: Error finding container c7567bb1089cd20a49b8fdd4b2bd46f19fcadc75ad76e9a0574687cd9a3f0d35: Status 404 returned error can't find the container with id c7567bb1089cd20a49b8fdd4b2bd46f19fcadc75ad76e9a0574687cd9a3f0d35
Nov 02 08:11:30.424739 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:30.424697    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-2hmg8" event={"ID":"2d34429e-a310-4c89-aa75-cb0a590ed09b","Type":"ContainerStarted","Data":"c7567bb1089cd20a49b8fdd4b2bd46f19fcadc75ad76e9a0574687cd9a3f0d35"}
Nov 02 08:11:30.426132 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:30.426104    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7ddcd68ff8-rjfdr" event={"ID":"e6dfdfa3-d7b8-4a15-b2d8-2563c3361756","Type":"ContainerStarted","Data":"a1b43ddc31facc0d2b7b415c1f404152bc34dc02b0def07b749b112c3ff7b07b"}
Nov 02 08:11:30.534924 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:30.534855    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7ddcd68ff8-rjfdr" podStartSLOduration=1.193820317 podStartE2EDuration="4.5348374s" totalImagesPullingTime="3.341017083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:11:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:11:30.534015845 +0000 UTC m=+280.292444580" watchObservedRunningTime="2026-11-02 08:11:30.5348374 +0000 UTC m=+280.293266132"
Nov 02 08:11:30.819462 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:11:30.819383    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:11:33.283677 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:33.283642    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-nj5xz"]
Nov 02 08:11:33.292663 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:33.292633    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-nj5xz"
Nov 02 08:11:33.339517 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:33.339482    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-nj5xz"]
Nov 02 08:11:33.384987 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:33.384949    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5grrd\""
Nov 02 08:11:33.396765 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:33.396732    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzthm\" (UniqueName: \"kubernetes.io/projected/0d54bd00-93d3-41a2-a8b4-44dffee143fd-kube-api-access-gzthm\") pod \"authorino-56c6c9ddd5-nj5xz\" (UID: \"0d54bd00-93d3-41a2-a8b4-44dffee143fd\") " pod="kuadrant-system/authorino-56c6c9ddd5-nj5xz"
Nov 02 08:11:33.498764 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:33.498722    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzthm\" (UniqueName: \"kubernetes.io/projected/0d54bd00-93d3-41a2-a8b4-44dffee143fd-kube-api-access-gzthm\") pod \"authorino-56c6c9ddd5-nj5xz\" (UID: \"0d54bd00-93d3-41a2-a8b4-44dffee143fd\") " pod="kuadrant-system/authorino-56c6c9ddd5-nj5xz"
Nov 02 08:11:33.552450 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:33.552377    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzthm\" (UniqueName: \"kubernetes.io/projected/0d54bd00-93d3-41a2-a8b4-44dffee143fd-kube-api-access-gzthm\") pod \"authorino-56c6c9ddd5-nj5xz\" (UID: \"0d54bd00-93d3-41a2-a8b4-44dffee143fd\") " pod="kuadrant-system/authorino-56c6c9ddd5-nj5xz"
Nov 02 08:11:33.620188 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:33.620150    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-nj5xz"
Nov 02 08:11:33.981588 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:33.981558    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-nj5xz"]
Nov 02 08:11:33.984730 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:11:33.984707    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d54bd00_93d3_41a2_a8b4_44dffee143fd.slice/crio-76160e2002dcb83bbe6334f665ffac51e594760e71b151fafbadfa7ab62e65bc WatchSource:0}: Error finding container 76160e2002dcb83bbe6334f665ffac51e594760e71b151fafbadfa7ab62e65bc: Status 404 returned error can't find the container with id 76160e2002dcb83bbe6334f665ffac51e594760e71b151fafbadfa7ab62e65bc
Nov 02 08:11:34.444065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:34.444029    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-nj5xz" event={"ID":"0d54bd00-93d3-41a2-a8b4-44dffee143fd","Type":"ContainerStarted","Data":"76160e2002dcb83bbe6334f665ffac51e594760e71b151fafbadfa7ab62e65bc"}
Nov 02 08:11:34.445436 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:34.445415    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-2hmg8" event={"ID":"2d34429e-a310-4c89-aa75-cb0a590ed09b","Type":"ContainerStarted","Data":"93bbe8d37888215167bb404c63648adf4913dcbab504eb87713fc6bce086e666"}
Nov 02 08:11:34.445574 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:34.445538    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-2hmg8"
Nov 02 08:11:34.555329 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:34.555275    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-74dfcfb894-2hmg8" podStartSLOduration=2.263888998 podStartE2EDuration="6.555260028s" totalImagesPullingTime="4.29137103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:11:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:11:34.554470477 +0000 UTC m=+284.312899214" watchObservedRunningTime="2026-11-02 08:11:34.555260028 +0000 UTC m=+284.313688760"
Nov 02 08:11:37.458955 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:37.458911    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-nj5xz" event={"ID":"0d54bd00-93d3-41a2-a8b4-44dffee143fd","Type":"ContainerStarted","Data":"49dd799aa81532f7b2526783e0124df1050789fad450fb873fb40a374a83238e"}
Nov 02 08:11:37.563499 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:37.563438    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-nj5xz" podStartSLOduration=2.065727084 podStartE2EDuration="4.563421699s" totalImagesPullingTime="2.497694615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:11:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:11:37.56273362 +0000 UTC m=+287.321162352" watchObservedRunningTime="2026-11-02 08:11:37.563421699 +0000 UTC m=+287.321850432"
Nov 02 08:11:38.948296 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:38.948265    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-ndgmq"]
Nov 02 08:11:38.951742 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:38.951723    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ndgmq"
Nov 02 08:11:39.000092 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:39.000062    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Nov 02 08:11:39.046561 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:39.046536    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-module-controller-manager-dockercfg-qfw9v\""
Nov 02 08:11:39.046561 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:39.046549    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Nov 02 08:11:39.051700 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:39.051669    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22fp9\" (UniqueName: \"kubernetes.io/projected/9336d0b3-ec43-4f01-a843-416f689bcc26-kube-api-access-22fp9\") pod \"kserve-module-controller-manager-7566cf5fc8-ndgmq\" (UID: \"9336d0b3-ec43-4f01-a843-416f689bcc26\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ndgmq"
Nov 02 08:11:39.051818 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:39.051780    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9336d0b3-ec43-4f01-a843-416f689bcc26-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-ndgmq\" (UID: \"9336d0b3-ec43-4f01-a843-416f689bcc26\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ndgmq"
Nov 02 08:11:39.051818 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:39.051808    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9336d0b3-ec43-4f01-a843-416f689bcc26-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-ndgmq\" (UID: \"9336d0b3-ec43-4f01-a843-416f689bcc26\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ndgmq"
Nov 02 08:11:39.051957 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:39.051851    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9336d0b3-ec43-4f01-a843-416f689bcc26-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-ndgmq\" (UID: \"9336d0b3-ec43-4f01-a843-416f689bcc26\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ndgmq"
Nov 02 08:11:39.140075 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:39.140039    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"odh-trusted-ca-bundle\""
Nov 02 08:11:39.140833 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:39.140814    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-ndgmq"]
Nov 02 08:11:39.152583 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:39.152560    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9336d0b3-ec43-4f01-a843-416f689bcc26-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-ndgmq\" (UID: \"9336d0b3-ec43-4f01-a843-416f689bcc26\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ndgmq"
Nov 02 08:11:39.152656 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:39.152588    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9336d0b3-ec43-4f01-a843-416f689bcc26-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-ndgmq\" (UID: \"9336d0b3-ec43-4f01-a843-416f689bcc26\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ndgmq"
Nov 02 08:11:39.152656 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:39.152621    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9336d0b3-ec43-4f01-a843-416f689bcc26-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-ndgmq\" (UID: \"9336d0b3-ec43-4f01-a843-416f689bcc26\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ndgmq"
Nov 02 08:11:39.152766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:39.152745    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22fp9\" (UniqueName: \"kubernetes.io/projected/9336d0b3-ec43-4f01-a843-416f689bcc26-kube-api-access-22fp9\") pod \"kserve-module-controller-manager-7566cf5fc8-ndgmq\" (UID: \"9336d0b3-ec43-4f01-a843-416f689bcc26\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ndgmq"
Nov 02 08:11:39.152978 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:39.152959    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9336d0b3-ec43-4f01-a843-416f689bcc26-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-ndgmq\" (UID: \"9336d0b3-ec43-4f01-a843-416f689bcc26\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ndgmq"
Nov 02 08:11:39.153024 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:39.153010    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9336d0b3-ec43-4f01-a843-416f689bcc26-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-ndgmq\" (UID: \"9336d0b3-ec43-4f01-a843-416f689bcc26\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ndgmq"
Nov 02 08:11:39.153588 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:39.153570    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9336d0b3-ec43-4f01-a843-416f689bcc26-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-ndgmq\" (UID: \"9336d0b3-ec43-4f01-a843-416f689bcc26\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ndgmq"
Nov 02 08:11:39.206415 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:39.206360    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22fp9\" (UniqueName: \"kubernetes.io/projected/9336d0b3-ec43-4f01-a843-416f689bcc26-kube-api-access-22fp9\") pod \"kserve-module-controller-manager-7566cf5fc8-ndgmq\" (UID: \"9336d0b3-ec43-4f01-a843-416f689bcc26\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ndgmq"
Nov 02 08:11:39.263381 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:39.263360    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ndgmq"
Nov 02 08:11:39.669672 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:39.669646    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-ndgmq"]
Nov 02 08:11:39.672187 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:11:39.672155    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9336d0b3_ec43_4f01_a843_416f689bcc26.slice/crio-df9b6057ea629652b8c0db5edd633f810ff44bacfa85c43856a82dbc0611115c WatchSource:0}: Error finding container df9b6057ea629652b8c0db5edd633f810ff44bacfa85c43856a82dbc0611115c: Status 404 returned error can't find the container with id df9b6057ea629652b8c0db5edd633f810ff44bacfa85c43856a82dbc0611115c
Nov 02 08:11:40.474711 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:40.474675    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ndgmq" event={"ID":"9336d0b3-ec43-4f01-a843-416f689bcc26","Type":"ContainerStarted","Data":"df9b6057ea629652b8c0db5edd633f810ff44bacfa85c43856a82dbc0611115c"}
Nov 02 08:11:42.484271 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:42.484238    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ndgmq" event={"ID":"9336d0b3-ec43-4f01-a843-416f689bcc26","Type":"ContainerStarted","Data":"4f0061b9b101d8f74d8c48196707446aa36b5fba7ea76a5a31a926ee620401fb"}
Nov 02 08:11:42.484639 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:42.484373    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ndgmq"
Nov 02 08:11:42.679054 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:42.679006    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ndgmq" podStartSLOduration=2.342109929 podStartE2EDuration="4.678991672s" totalImagesPullingTime="2.336881743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:11:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:11:42.641328413 +0000 UTC m=+292.399757144" watchObservedRunningTime="2026-11-02 08:11:42.678991672 +0000 UTC m=+292.437420403"
Nov 02 08:11:45.450922 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:45.450872    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-2hmg8"
Nov 02 08:11:47.965268 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:47.965202    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-2hmg8"]
Nov 02 08:11:47.965745 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:47.965655    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-74dfcfb894-2hmg8" podUID="2d34429e-a310-4c89-aa75-cb0a590ed09b" containerName="limitador" containerID="cri-o://93bbe8d37888215167bb404c63648adf4913dcbab504eb87713fc6bce086e666" gracePeriod=30
Nov 02 08:11:48.508361 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:48.508337    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-2hmg8"
Nov 02 08:11:48.509685 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:48.509659    6210 generic.go:356] "Generic (PLEG): container finished" podID="2d34429e-a310-4c89-aa75-cb0a590ed09b" containerID="93bbe8d37888215167bb404c63648adf4913dcbab504eb87713fc6bce086e666" exitCode=0
Nov 02 08:11:48.509784 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:48.509700    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-2hmg8"
Nov 02 08:11:48.509784 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:48.509713    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-2hmg8" event={"ID":"2d34429e-a310-4c89-aa75-cb0a590ed09b","Type":"ContainerDied","Data":"93bbe8d37888215167bb404c63648adf4913dcbab504eb87713fc6bce086e666"}
Nov 02 08:11:48.509856 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:48.509785    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-2hmg8" event={"ID":"2d34429e-a310-4c89-aa75-cb0a590ed09b","Type":"ContainerDied","Data":"c7567bb1089cd20a49b8fdd4b2bd46f19fcadc75ad76e9a0574687cd9a3f0d35"}
Nov 02 08:11:48.509856 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:48.509807    6210 scope.go:122] "RemoveContainer" containerID="93bbe8d37888215167bb404c63648adf4913dcbab504eb87713fc6bce086e666"
Nov 02 08:11:48.517492 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:48.517472    6210 scope.go:122] "RemoveContainer" containerID="93bbe8d37888215167bb404c63648adf4913dcbab504eb87713fc6bce086e666"
Nov 02 08:11:48.517749 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:11:48.517730    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93bbe8d37888215167bb404c63648adf4913dcbab504eb87713fc6bce086e666\": container with ID starting with 93bbe8d37888215167bb404c63648adf4913dcbab504eb87713fc6bce086e666 not found: ID does not exist" containerID="93bbe8d37888215167bb404c63648adf4913dcbab504eb87713fc6bce086e666"
Nov 02 08:11:48.517829 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:48.517755    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93bbe8d37888215167bb404c63648adf4913dcbab504eb87713fc6bce086e666"} err="failed to get container status \"93bbe8d37888215167bb404c63648adf4913dcbab504eb87713fc6bce086e666\": rpc error: code = NotFound desc = could not find container \"93bbe8d37888215167bb404c63648adf4913dcbab504eb87713fc6bce086e666\": container with ID starting with 93bbe8d37888215167bb404c63648adf4913dcbab504eb87713fc6bce086e666 not found: ID does not exist"
Nov 02 08:11:48.633475 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:48.633406    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2d34429e-a310-4c89-aa75-cb0a590ed09b-kube-api-access-knvv6\" (UniqueName: \"kubernetes.io/projected/2d34429e-a310-4c89-aa75-cb0a590ed09b-kube-api-access-knvv6\") pod \"2d34429e-a310-4c89-aa75-cb0a590ed09b\" (UID: \"2d34429e-a310-4c89-aa75-cb0a590ed09b\") "
Nov 02 08:11:48.633637 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:48.633539    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2d34429e-a310-4c89-aa75-cb0a590ed09b-config-file\" (UniqueName: \"kubernetes.io/configmap/2d34429e-a310-4c89-aa75-cb0a590ed09b-config-file\") pod \"2d34429e-a310-4c89-aa75-cb0a590ed09b\" (UID: \"2d34429e-a310-4c89-aa75-cb0a590ed09b\") "
Nov 02 08:11:48.634127 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:48.634100    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d34429e-a310-4c89-aa75-cb0a590ed09b-config-file" pod "2d34429e-a310-4c89-aa75-cb0a590ed09b" (UID: "2d34429e-a310-4c89-aa75-cb0a590ed09b"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:11:48.635634 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:48.635605    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d34429e-a310-4c89-aa75-cb0a590ed09b-kube-api-access-knvv6" pod "2d34429e-a310-4c89-aa75-cb0a590ed09b" (UID: "2d34429e-a310-4c89-aa75-cb0a590ed09b"). InnerVolumeSpecName "kube-api-access-knvv6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:11:48.734538 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:48.734509    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knvv6\" (UniqueName: \"kubernetes.io/projected/2d34429e-a310-4c89-aa75-cb0a590ed09b-kube-api-access-knvv6\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:11:48.734538 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:48.734535    6210 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2d34429e-a310-4c89-aa75-cb0a590ed09b-config-file\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:11:48.920520 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:48.920442    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-2hmg8"]
Nov 02 08:11:48.924354 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:48.924333    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-2hmg8"]
Nov 02 08:11:50.351599 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:50.351568    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2d34429e-a310-4c89-aa75-cb0a590ed09b" path="/var/lib/kubelet/pods/2d34429e-a310-4c89-aa75-cb0a590ed09b/volumes"
Nov 02 08:11:50.368624 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:50.368603    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q_f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae/extract/0.log"
Nov 02 08:11:50.369316 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:50.369293    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q_f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae/extract/0.log"
Nov 02 08:11:50.381998 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:50.381977    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb77f_3e7ae74c-fcd8-4820-a8b7-769a5fff9f15/ovn-acl-logging/0.log"
Nov 02 08:11:50.382251 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:50.382237    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb77f_3e7ae74c-fcd8-4820-a8b7-769a5fff9f15/ovn-acl-logging/0.log"
Nov 02 08:11:57.174988 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:57.174954    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-rg4nq"]
Nov 02 08:11:57.175467 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:57.175289    6210 cpu_manager.go:414] "containerMap: removing container" podUID="2d34429e-a310-4c89-aa75-cb0a590ed09b" containerName="limitador"
Nov 02 08:11:57.175467 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:57.175300    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d34429e-a310-4c89-aa75-cb0a590ed09b" containerName="limitador"
Nov 02 08:11:57.175467 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:57.175365    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d34429e-a310-4c89-aa75-cb0a590ed09b" containerName="limitador"
Nov 02 08:11:57.179567 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:57.179546    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-rg4nq"
Nov 02 08:11:57.229954 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:57.229927    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 02 08:11:57.230775 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:57.230745    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-rg4nq"]
Nov 02 08:11:57.275984 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:57.275947    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 02 08:11:57.276166 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:57.276012    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Nov 02 08:11:57.276166 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:57.276041    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-4s6zh\""
Nov 02 08:11:57.308520 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:57.308490    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmnph\" (UniqueName: \"kubernetes.io/projected/4c1a7e60-dd04-4fd7-a3bf-f7fc7caa3217-kube-api-access-kmnph\") pod \"postgres-7cdbf6dc44-rg4nq\" (UID: \"4c1a7e60-dd04-4fd7-a3bf-f7fc7caa3217\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-rg4nq"
Nov 02 08:11:57.308679 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:57.308555    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4c1a7e60-dd04-4fd7-a3bf-f7fc7caa3217-data\") pod \"postgres-7cdbf6dc44-rg4nq\" (UID: \"4c1a7e60-dd04-4fd7-a3bf-f7fc7caa3217\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-rg4nq"
Nov 02 08:11:57.410005 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:57.409968    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmnph\" (UniqueName: \"kubernetes.io/projected/4c1a7e60-dd04-4fd7-a3bf-f7fc7caa3217-kube-api-access-kmnph\") pod \"postgres-7cdbf6dc44-rg4nq\" (UID: \"4c1a7e60-dd04-4fd7-a3bf-f7fc7caa3217\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-rg4nq"
Nov 02 08:11:57.410177 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:57.410018    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4c1a7e60-dd04-4fd7-a3bf-f7fc7caa3217-data\") pod \"postgres-7cdbf6dc44-rg4nq\" (UID: \"4c1a7e60-dd04-4fd7-a3bf-f7fc7caa3217\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-rg4nq"
Nov 02 08:11:57.410398 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:57.410381    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4c1a7e60-dd04-4fd7-a3bf-f7fc7caa3217-data\") pod \"postgres-7cdbf6dc44-rg4nq\" (UID: \"4c1a7e60-dd04-4fd7-a3bf-f7fc7caa3217\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-rg4nq"
Nov 02 08:11:57.463781 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:57.463751    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmnph\" (UniqueName: \"kubernetes.io/projected/4c1a7e60-dd04-4fd7-a3bf-f7fc7caa3217-kube-api-access-kmnph\") pod \"postgres-7cdbf6dc44-rg4nq\" (UID: \"4c1a7e60-dd04-4fd7-a3bf-f7fc7caa3217\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-rg4nq"
Nov 02 08:11:57.491640 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:57.491608    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-rg4nq"
Nov 02 08:11:57.853241 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:57.853165    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-rg4nq"]
Nov 02 08:11:57.856760 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:11:57.856727    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c1a7e60_dd04_4fd7_a3bf_f7fc7caa3217.slice/crio-53006acc7c9d9f8167c936b610a271649f16400c4765e022c4874435a27ffaae WatchSource:0}: Error finding container 53006acc7c9d9f8167c936b610a271649f16400c4765e022c4874435a27ffaae: Status 404 returned error can't find the container with id 53006acc7c9d9f8167c936b610a271649f16400c4765e022c4874435a27ffaae
Nov 02 08:11:58.558139 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:11:58.558107    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-rg4nq" event={"ID":"4c1a7e60-dd04-4fd7-a3bf-f7fc7caa3217","Type":"ContainerStarted","Data":"53006acc7c9d9f8167c936b610a271649f16400c4765e022c4874435a27ffaae"}
Nov 02 08:12:00.820086 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:12:00.820048    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:12:03.490137 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:03.490098    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ndgmq"
Nov 02 08:12:06.599645 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:06.599605    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-rg4nq" event={"ID":"4c1a7e60-dd04-4fd7-a3bf-f7fc7caa3217","Type":"ContainerStarted","Data":"99b37207012818073b5c8f554e26bef1853427327569f00153393bc5c31f54a5"}
Nov 02 08:12:06.600094 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:06.599753    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-rg4nq"
Nov 02 08:12:06.705786 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:06.705734    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-rg4nq" podStartSLOduration=1.643657475 podStartE2EDuration="9.70571817s" totalImagesPullingTime="8.062060695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:11:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:12:06.705022713 +0000 UTC m=+316.463451448" watchObservedRunningTime="2026-11-02 08:12:06.70571817 +0000 UTC m=+316.464146904"
Nov 02 08:12:12.632447 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:12.632419    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-rg4nq"
Nov 02 08:12:29.511670 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:29.511634    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75695549d4-cp6tv"]
Nov 02 08:12:29.516255 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:29.516232    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75695549d4-cp6tv"
Nov 02 08:12:29.565305 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:29.565269    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8k2kn\""
Nov 02 08:12:29.565305 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:29.565269    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Nov 02 08:12:29.565555 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:29.565316    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Nov 02 08:12:29.589543 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:29.589508    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7d2fde63-168f-42c0-a0e6-fec7d29edb86-webhook-cert\") pod \"maas-controller-75695549d4-cp6tv\" (UID: \"7d2fde63-168f-42c0-a0e6-fec7d29edb86\") " pod="opendatahub/maas-controller-75695549d4-cp6tv"
Nov 02 08:12:29.589747 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:29.589549    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4brdk\" (UniqueName: \"kubernetes.io/projected/7d2fde63-168f-42c0-a0e6-fec7d29edb86-kube-api-access-4brdk\") pod \"maas-controller-75695549d4-cp6tv\" (UID: \"7d2fde63-168f-42c0-a0e6-fec7d29edb86\") " pod="opendatahub/maas-controller-75695549d4-cp6tv"
Nov 02 08:12:29.589747 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:29.589579    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d2fde63-168f-42c0-a0e6-fec7d29edb86-metrics-certs\") pod \"maas-controller-75695549d4-cp6tv\" (UID: \"7d2fde63-168f-42c0-a0e6-fec7d29edb86\") " pod="opendatahub/maas-controller-75695549d4-cp6tv"
Nov 02 08:12:29.611782 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:29.611755    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Nov 02 08:12:29.612697 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:29.612675    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75695549d4-cp6tv"]
Nov 02 08:12:29.690109 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:29.690074    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4brdk\" (UniqueName: \"kubernetes.io/projected/7d2fde63-168f-42c0-a0e6-fec7d29edb86-kube-api-access-4brdk\") pod \"maas-controller-75695549d4-cp6tv\" (UID: \"7d2fde63-168f-42c0-a0e6-fec7d29edb86\") " pod="opendatahub/maas-controller-75695549d4-cp6tv"
Nov 02 08:12:29.690109 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:29.690116    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d2fde63-168f-42c0-a0e6-fec7d29edb86-metrics-certs\") pod \"maas-controller-75695549d4-cp6tv\" (UID: \"7d2fde63-168f-42c0-a0e6-fec7d29edb86\") " pod="opendatahub/maas-controller-75695549d4-cp6tv"
Nov 02 08:12:29.690308 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:29.690181    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7d2fde63-168f-42c0-a0e6-fec7d29edb86-webhook-cert\") pod \"maas-controller-75695549d4-cp6tv\" (UID: \"7d2fde63-168f-42c0-a0e6-fec7d29edb86\") " pod="opendatahub/maas-controller-75695549d4-cp6tv"
Nov 02 08:12:29.692689 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:29.692655    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7d2fde63-168f-42c0-a0e6-fec7d29edb86-webhook-cert\") pod \"maas-controller-75695549d4-cp6tv\" (UID: \"7d2fde63-168f-42c0-a0e6-fec7d29edb86\") " pod="opendatahub/maas-controller-75695549d4-cp6tv"
Nov 02 08:12:29.692837 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:29.692820    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d2fde63-168f-42c0-a0e6-fec7d29edb86-metrics-certs\") pod \"maas-controller-75695549d4-cp6tv\" (UID: \"7d2fde63-168f-42c0-a0e6-fec7d29edb86\") " pod="opendatahub/maas-controller-75695549d4-cp6tv"
Nov 02 08:12:29.744662 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:29.744628    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4brdk\" (UniqueName: \"kubernetes.io/projected/7d2fde63-168f-42c0-a0e6-fec7d29edb86-kube-api-access-4brdk\") pod \"maas-controller-75695549d4-cp6tv\" (UID: \"7d2fde63-168f-42c0-a0e6-fec7d29edb86\") " pod="opendatahub/maas-controller-75695549d4-cp6tv"
Nov 02 08:12:29.828941 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:29.828852    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75695549d4-cp6tv"
Nov 02 08:12:30.133450 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:30.133377    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7bb9976d7-w6btv"]
Nov 02 08:12:30.137874 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:30.137852    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bb9976d7-w6btv"
Nov 02 08:12:30.192632 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:30.192597    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bb9976d7-w6btv"]
Nov 02 08:12:30.194153 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:30.193851    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p49zh\" (UniqueName: \"kubernetes.io/projected/40c94a5f-3012-4420-806e-3d3fb13fe06f-kube-api-access-p49zh\") pod \"maas-controller-7bb9976d7-w6btv\" (UID: \"40c94a5f-3012-4420-806e-3d3fb13fe06f\") " pod="opendatahub/maas-controller-7bb9976d7-w6btv"
Nov 02 08:12:30.194153 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:30.193947    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40c94a5f-3012-4420-806e-3d3fb13fe06f-metrics-certs\") pod \"maas-controller-7bb9976d7-w6btv\" (UID: \"40c94a5f-3012-4420-806e-3d3fb13fe06f\") " pod="opendatahub/maas-controller-7bb9976d7-w6btv"
Nov 02 08:12:30.194153 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:30.193989    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/40c94a5f-3012-4420-806e-3d3fb13fe06f-webhook-cert\") pod \"maas-controller-7bb9976d7-w6btv\" (UID: \"40c94a5f-3012-4420-806e-3d3fb13fe06f\") " pod="opendatahub/maas-controller-7bb9976d7-w6btv"
Nov 02 08:12:30.250216 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:30.250185    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75695549d4-cp6tv"]
Nov 02 08:12:30.254138 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:12:30.254099    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d2fde63_168f_42c0_a0e6_fec7d29edb86.slice/crio-99285c3fa4af5e4f3499d615a72bf57547195133320d6a0289c54fdda5a63c15 WatchSource:0}: Error finding container 99285c3fa4af5e4f3499d615a72bf57547195133320d6a0289c54fdda5a63c15: Status 404 returned error can't find the container with id 99285c3fa4af5e4f3499d615a72bf57547195133320d6a0289c54fdda5a63c15
Nov 02 08:12:30.255768 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:30.255738    6210 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 02 08:12:30.295358 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:30.295324    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p49zh\" (UniqueName: \"kubernetes.io/projected/40c94a5f-3012-4420-806e-3d3fb13fe06f-kube-api-access-p49zh\") pod \"maas-controller-7bb9976d7-w6btv\" (UID: \"40c94a5f-3012-4420-806e-3d3fb13fe06f\") " pod="opendatahub/maas-controller-7bb9976d7-w6btv"
Nov 02 08:12:30.295533 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:30.295384    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40c94a5f-3012-4420-806e-3d3fb13fe06f-metrics-certs\") pod \"maas-controller-7bb9976d7-w6btv\" (UID: \"40c94a5f-3012-4420-806e-3d3fb13fe06f\") " pod="opendatahub/maas-controller-7bb9976d7-w6btv"
Nov 02 08:12:30.295533 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:30.295514    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/40c94a5f-3012-4420-806e-3d3fb13fe06f-webhook-cert\") pod \"maas-controller-7bb9976d7-w6btv\" (UID: \"40c94a5f-3012-4420-806e-3d3fb13fe06f\") " pod="opendatahub/maas-controller-7bb9976d7-w6btv"
Nov 02 08:12:30.297815 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:30.297790    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40c94a5f-3012-4420-806e-3d3fb13fe06f-metrics-certs\") pod \"maas-controller-7bb9976d7-w6btv\" (UID: \"40c94a5f-3012-4420-806e-3d3fb13fe06f\") " pod="opendatahub/maas-controller-7bb9976d7-w6btv"
Nov 02 08:12:30.297942 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:30.297797    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/40c94a5f-3012-4420-806e-3d3fb13fe06f-webhook-cert\") pod \"maas-controller-7bb9976d7-w6btv\" (UID: \"40c94a5f-3012-4420-806e-3d3fb13fe06f\") " pod="opendatahub/maas-controller-7bb9976d7-w6btv"
Nov 02 08:12:30.348759 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:30.348724    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p49zh\" (UniqueName: \"kubernetes.io/projected/40c94a5f-3012-4420-806e-3d3fb13fe06f-kube-api-access-p49zh\") pod \"maas-controller-7bb9976d7-w6btv\" (UID: \"40c94a5f-3012-4420-806e-3d3fb13fe06f\") " pod="opendatahub/maas-controller-7bb9976d7-w6btv"
Nov 02 08:12:30.450533 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:30.450439    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bb9976d7-w6btv"
Nov 02 08:12:30.702938 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:30.702842    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75695549d4-cp6tv" event={"ID":"7d2fde63-168f-42c0-a0e6-fec7d29edb86","Type":"ContainerStarted","Data":"99285c3fa4af5e4f3499d615a72bf57547195133320d6a0289c54fdda5a63c15"}
Nov 02 08:12:30.821268 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:12:30.821232    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:12:30.829686 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:30.829652    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bb9976d7-w6btv"]
Nov 02 08:12:30.830039 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:12:30.830011    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40c94a5f_3012_4420_806e_3d3fb13fe06f.slice/crio-a7af0ffdc973d013194793267876586be67dbc45254a51da1b2737ae9e7d8648 WatchSource:0}: Error finding container a7af0ffdc973d013194793267876586be67dbc45254a51da1b2737ae9e7d8648: Status 404 returned error can't find the container with id a7af0ffdc973d013194793267876586be67dbc45254a51da1b2737ae9e7d8648
Nov 02 08:12:31.709119 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:31.709082    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bb9976d7-w6btv" event={"ID":"40c94a5f-3012-4420-806e-3d3fb13fe06f","Type":"ContainerStarted","Data":"a7af0ffdc973d013194793267876586be67dbc45254a51da1b2737ae9e7d8648"}
Nov 02 08:12:36.735034 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:36.734950    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75695549d4-cp6tv" event={"ID":"7d2fde63-168f-42c0-a0e6-fec7d29edb86","Type":"ContainerStarted","Data":"cee6461dd4da67ae0f02392521d44515a31786a530c3c83182fe70408429a2aa"}
Nov 02 08:12:36.735034 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:36.735022    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75695549d4-cp6tv"
Nov 02 08:12:36.736441 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:36.736419    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bb9976d7-w6btv" event={"ID":"40c94a5f-3012-4420-806e-3d3fb13fe06f","Type":"ContainerStarted","Data":"80eb7f261ff0091af870fe8b009d2cdf57043171344375c590496e154c112b82"}
Nov 02 08:12:36.736568 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:36.736554    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7bb9976d7-w6btv"
Nov 02 08:12:36.889493 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:36.889422    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-75695549d4-cp6tv" podStartSLOduration=1.670889181 podStartE2EDuration="7.889407728s" totalImagesPullingTime="6.218518547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:12:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:12:36.888993784 +0000 UTC m=+346.647422518" watchObservedRunningTime="2026-11-02 08:12:36.889407728 +0000 UTC m=+346.647836459"
Nov 02 08:12:37.017522 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:37.017418    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-7bb9976d7-w6btv" podStartSLOduration=1.365774134 podStartE2EDuration="7.017398892s" totalImagesPullingTime="5.651624758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:12:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:12:37.015995383 +0000 UTC m=+346.774424114" watchObservedRunningTime="2026-11-02 08:12:37.017398892 +0000 UTC m=+346.775827624"
Nov 02 08:12:38.970684 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:38.970643    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hkbfq"]
Nov 02 08:12:38.979488 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:38.979466    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hkbfq"
Nov 02 08:12:39.073455 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:39.073418    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hkbfq"]
Nov 02 08:12:39.084453 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:39.084420    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7af3db74-1298-45d8-a2bb-d86dd2132610-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hkbfq\" (UID: \"7af3db74-1298-45d8-a2bb-d86dd2132610\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hkbfq"
Nov 02 08:12:39.084615 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:39.084466    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7af3db74-1298-45d8-a2bb-d86dd2132610-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hkbfq\" (UID: \"7af3db74-1298-45d8-a2bb-d86dd2132610\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hkbfq"
Nov 02 08:12:39.084615 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:39.084584    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7af3db74-1298-45d8-a2bb-d86dd2132610-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hkbfq\" (UID: \"7af3db74-1298-45d8-a2bb-d86dd2132610\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hkbfq"
Nov 02 08:12:39.084789 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:39.084770    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7af3db74-1298-45d8-a2bb-d86dd2132610-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hkbfq\" (UID: \"7af3db74-1298-45d8-a2bb-d86dd2132610\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hkbfq"
Nov 02 08:12:39.084852 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:39.084803    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7af3db74-1298-45d8-a2bb-d86dd2132610-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hkbfq\" (UID: \"7af3db74-1298-45d8-a2bb-d86dd2132610\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hkbfq"
Nov 02 08:12:39.084973 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:39.084947    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7af3db74-1298-45d8-a2bb-d86dd2132610-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hkbfq\" (UID: \"7af3db74-1298-45d8-a2bb-d86dd2132610\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hkbfq"
Nov 02 08:12:39.085033 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:39.084994    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzqkv\" (UniqueName: \"kubernetes.io/projected/7af3db74-1298-45d8-a2bb-d86dd2132610-kube-api-access-bzqkv\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hkbfq\" (UID: \"7af3db74-1298-45d8-a2bb-d86dd2132610\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hkbfq"
Nov 02 08:12:39.186094 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:39.186063    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7af3db74-1298-45d8-a2bb-d86dd2132610-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hkbfq\" (UID: \"7af3db74-1298-45d8-a2bb-d86dd2132610\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hkbfq"
Nov 02 08:12:39.186289 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:39.186110    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7af3db74-1298-45d8-a2bb-d86dd2132610-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hkbfq\" (UID: \"7af3db74-1298-45d8-a2bb-d86dd2132610\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hkbfq"
Nov 02 08:12:39.186289 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:39.186149    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7af3db74-1298-45d8-a2bb-d86dd2132610-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hkbfq\" (UID: \"7af3db74-1298-45d8-a2bb-d86dd2132610\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hkbfq"
Nov 02 08:12:39.186289 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:39.186224    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7af3db74-1298-45d8-a2bb-d86dd2132610-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hkbfq\" (UID: \"7af3db74-1298-45d8-a2bb-d86dd2132610\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hkbfq"
Nov 02 08:12:39.186289 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:39.186247    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7af3db74-1298-45d8-a2bb-d86dd2132610-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hkbfq\" (UID: \"7af3db74-1298-45d8-a2bb-d86dd2132610\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hkbfq"
Nov 02 08:12:39.186289 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:39.186287    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7af3db74-1298-45d8-a2bb-d86dd2132610-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hkbfq\" (UID: \"7af3db74-1298-45d8-a2bb-d86dd2132610\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hkbfq"
Nov 02 08:12:39.186549 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:39.186319    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzqkv\" (UniqueName: \"kubernetes.io/projected/7af3db74-1298-45d8-a2bb-d86dd2132610-kube-api-access-bzqkv\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hkbfq\" (UID: \"7af3db74-1298-45d8-a2bb-d86dd2132610\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hkbfq"
Nov 02 08:12:39.186964 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:39.186934    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7af3db74-1298-45d8-a2bb-d86dd2132610-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hkbfq\" (UID: \"7af3db74-1298-45d8-a2bb-d86dd2132610\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hkbfq"
Nov 02 08:12:39.188548 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:39.188515    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7af3db74-1298-45d8-a2bb-d86dd2132610-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hkbfq\" (UID: \"7af3db74-1298-45d8-a2bb-d86dd2132610\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hkbfq"
Nov 02 08:12:39.188667 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:39.188646    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7af3db74-1298-45d8-a2bb-d86dd2132610-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hkbfq\" (UID: \"7af3db74-1298-45d8-a2bb-d86dd2132610\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hkbfq"
Nov 02 08:12:39.189040 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:39.189018    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7af3db74-1298-45d8-a2bb-d86dd2132610-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hkbfq\" (UID: \"7af3db74-1298-45d8-a2bb-d86dd2132610\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hkbfq"
Nov 02 08:12:39.189109 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:39.189022    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7af3db74-1298-45d8-a2bb-d86dd2132610-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hkbfq\" (UID: \"7af3db74-1298-45d8-a2bb-d86dd2132610\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hkbfq"
Nov 02 08:12:39.262700 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:39.262636    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzqkv\" (UniqueName: \"kubernetes.io/projected/7af3db74-1298-45d8-a2bb-d86dd2132610-kube-api-access-bzqkv\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hkbfq\" (UID: \"7af3db74-1298-45d8-a2bb-d86dd2132610\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hkbfq"
Nov 02 08:12:39.262986 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:39.262964    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7af3db74-1298-45d8-a2bb-d86dd2132610-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hkbfq\" (UID: \"7af3db74-1298-45d8-a2bb-d86dd2132610\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hkbfq"
Nov 02 08:12:39.289759 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:39.289726    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hkbfq"
Nov 02 08:12:39.698280 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:39.698191    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hkbfq"]
Nov 02 08:12:39.700874 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:12:39.700834    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7af3db74_1298_45d8_a2bb_d86dd2132610.slice/crio-44f48679705563e9dc3f6344e1f5e5815df960c92b460e6c861eae695be3ed00 WatchSource:0}: Error finding container 44f48679705563e9dc3f6344e1f5e5815df960c92b460e6c861eae695be3ed00: Status 404 returned error can't find the container with id 44f48679705563e9dc3f6344e1f5e5815df960c92b460e6c861eae695be3ed00
Nov 02 08:12:39.703122 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:39.703088    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:12:39.703240 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:39.703160    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:12:39.751046 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:39.751011    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hkbfq" event={"ID":"7af3db74-1298-45d8-a2bb-d86dd2132610","Type":"ContainerStarted","Data":"44f48679705563e9dc3f6344e1f5e5815df960c92b460e6c861eae695be3ed00"}
Nov 02 08:12:40.761693 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:40.761650    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hkbfq" event={"ID":"7af3db74-1298-45d8-a2bb-d86dd2132610","Type":"ContainerStarted","Data":"02e11fe0cf6c36a69c4437d31e7aae821fe817b97ba6c74a18ffa44d00a84136"}
Nov 02 08:12:40.762226 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:40.761997    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hkbfq"
Nov 02 08:12:40.763509 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:40.763477    6210 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-hkbfq container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 08:12:40.763661 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:40.763544    6210 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hkbfq" podUID="7af3db74-1298-45d8-a2bb-d86dd2132610" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 08:12:40.956520 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:40.956466    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hkbfq" podStartSLOduration=2.956454618 podStartE2EDuration="2.956454618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:12:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:12:40.921684117 +0000 UTC m=+350.680112859" watchObservedRunningTime="2026-11-02 08:12:40.956454618 +0000 UTC m=+350.714883349"
Nov 02 08:12:41.768018 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:41.767989    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hkbfq"
Nov 02 08:12:41.974241 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:41.974205    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j"]
Nov 02 08:12:41.974495 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:41.974449    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j" podUID="4d6f480a-b512-470e-b287-dcb7afcc9e90" containerName="discovery" containerID="cri-o://04dac11577eb37045b2b494ac27032393387e18da6293f0b1e128ef2f9fadb82" gracePeriod=30
Nov 02 08:12:42.027201 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:42.027135    6210 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7876bfcb74-zhc8j container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.17:8080/ready\": dial tcp 10.134.0.17:8080: connect: connection refused" start-of-body=
Nov 02 08:12:42.027201 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:42.027182    6210 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j" podUID="4d6f480a-b512-470e-b287-dcb7afcc9e90" containerName="discovery" probeResult="failure" output="Get \"http://10.134.0.17:8080/ready\": dial tcp 10.134.0.17:8080: connect: connection refused"
Nov 02 08:12:42.218323 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:42.218296    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j"
Nov 02 08:12:42.317230 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:42.317153    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4d6f480a-b512-470e-b287-dcb7afcc9e90-kube-api-access-dpqjc\" (UniqueName: \"kubernetes.io/projected/4d6f480a-b512-470e-b287-dcb7afcc9e90-kube-api-access-dpqjc\") pod \"4d6f480a-b512-470e-b287-dcb7afcc9e90\" (UID: \"4d6f480a-b512-470e-b287-dcb7afcc9e90\") "
Nov 02 08:12:42.317230 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:42.317191    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4d6f480a-b512-470e-b287-dcb7afcc9e90-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4d6f480a-b512-470e-b287-dcb7afcc9e90-istio-csr-dns-cert\") pod \"4d6f480a-b512-470e-b287-dcb7afcc9e90\" (UID: \"4d6f480a-b512-470e-b287-dcb7afcc9e90\") "
Nov 02 08:12:42.317230 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:42.317211    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4d6f480a-b512-470e-b287-dcb7afcc9e90-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4d6f480a-b512-470e-b287-dcb7afcc9e90-istio-csr-ca-configmap\") pod \"4d6f480a-b512-470e-b287-dcb7afcc9e90\" (UID: \"4d6f480a-b512-470e-b287-dcb7afcc9e90\") "
Nov 02 08:12:42.317507 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:42.317261    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4d6f480a-b512-470e-b287-dcb7afcc9e90-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d6f480a-b512-470e-b287-dcb7afcc9e90-local-certs\") pod \"4d6f480a-b512-470e-b287-dcb7afcc9e90\" (UID: \"4d6f480a-b512-470e-b287-dcb7afcc9e90\") "
Nov 02 08:12:42.317507 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:42.317291    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4d6f480a-b512-470e-b287-dcb7afcc9e90-istio-token\" (UniqueName: \"kubernetes.io/projected/4d6f480a-b512-470e-b287-dcb7afcc9e90-istio-token\") pod \"4d6f480a-b512-470e-b287-dcb7afcc9e90\" (UID: \"4d6f480a-b512-470e-b287-dcb7afcc9e90\") "
Nov 02 08:12:42.317507 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:42.317342    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4d6f480a-b512-470e-b287-dcb7afcc9e90-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4d6f480a-b512-470e-b287-dcb7afcc9e90-istio-kubeconfig\") pod \"4d6f480a-b512-470e-b287-dcb7afcc9e90\" (UID: \"4d6f480a-b512-470e-b287-dcb7afcc9e90\") "
Nov 02 08:12:42.317507 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:42.317403    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4d6f480a-b512-470e-b287-dcb7afcc9e90-cacerts\" (UniqueName: \"kubernetes.io/secret/4d6f480a-b512-470e-b287-dcb7afcc9e90-cacerts\") pod \"4d6f480a-b512-470e-b287-dcb7afcc9e90\" (UID: \"4d6f480a-b512-470e-b287-dcb7afcc9e90\") "
Nov 02 08:12:42.317723 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:42.317657    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d6f480a-b512-470e-b287-dcb7afcc9e90-istio-csr-ca-configmap" pod "4d6f480a-b512-470e-b287-dcb7afcc9e90" (UID: "4d6f480a-b512-470e-b287-dcb7afcc9e90"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:12:42.319671 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:42.319637    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d6f480a-b512-470e-b287-dcb7afcc9e90-istio-kubeconfig" pod "4d6f480a-b512-470e-b287-dcb7afcc9e90" (UID: "4d6f480a-b512-470e-b287-dcb7afcc9e90"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:12:42.319802 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:42.319667    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d6f480a-b512-470e-b287-dcb7afcc9e90-istio-csr-dns-cert" pod "4d6f480a-b512-470e-b287-dcb7afcc9e90" (UID: "4d6f480a-b512-470e-b287-dcb7afcc9e90"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:12:42.319868 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:42.319833    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d6f480a-b512-470e-b287-dcb7afcc9e90-local-certs" pod "4d6f480a-b512-470e-b287-dcb7afcc9e90" (UID: "4d6f480a-b512-470e-b287-dcb7afcc9e90"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:12:42.319971 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:42.319839    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d6f480a-b512-470e-b287-dcb7afcc9e90-istio-token" pod "4d6f480a-b512-470e-b287-dcb7afcc9e90" (UID: "4d6f480a-b512-470e-b287-dcb7afcc9e90"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:12:42.319971 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:42.319927    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d6f480a-b512-470e-b287-dcb7afcc9e90-kube-api-access-dpqjc" pod "4d6f480a-b512-470e-b287-dcb7afcc9e90" (UID: "4d6f480a-b512-470e-b287-dcb7afcc9e90"). InnerVolumeSpecName "kube-api-access-dpqjc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:12:42.320071 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:42.320006    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d6f480a-b512-470e-b287-dcb7afcc9e90-cacerts" pod "4d6f480a-b512-470e-b287-dcb7afcc9e90" (UID: "4d6f480a-b512-470e-b287-dcb7afcc9e90"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:12:42.418372 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:42.418340    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpqjc\" (UniqueName: \"kubernetes.io/projected/4d6f480a-b512-470e-b287-dcb7afcc9e90-kube-api-access-dpqjc\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:12:42.418372 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:42.418367    6210 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4d6f480a-b512-470e-b287-dcb7afcc9e90-istio-csr-dns-cert\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:12:42.418372 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:42.418377    6210 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4d6f480a-b512-470e-b287-dcb7afcc9e90-istio-csr-ca-configmap\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:12:42.418590 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:42.418387    6210 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d6f480a-b512-470e-b287-dcb7afcc9e90-local-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:12:42.418590 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:42.418396    6210 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d6f480a-b512-470e-b287-dcb7afcc9e90-istio-token\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:12:42.418590 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:42.418403    6210 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4d6f480a-b512-470e-b287-dcb7afcc9e90-istio-kubeconfig\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:12:42.418590 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:42.418411    6210 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4d6f480a-b512-470e-b287-dcb7afcc9e90-cacerts\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:12:42.772952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:42.772910    6210 generic.go:356] "Generic (PLEG): container finished" podID="4d6f480a-b512-470e-b287-dcb7afcc9e90" containerID="04dac11577eb37045b2b494ac27032393387e18da6293f0b1e128ef2f9fadb82" exitCode=0
Nov 02 08:12:42.773340 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:42.772962    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j"
Nov 02 08:12:42.773340 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:42.772994    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j" event={"ID":"4d6f480a-b512-470e-b287-dcb7afcc9e90","Type":"ContainerDied","Data":"04dac11577eb37045b2b494ac27032393387e18da6293f0b1e128ef2f9fadb82"}
Nov 02 08:12:42.773340 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:42.773065    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j" event={"ID":"4d6f480a-b512-470e-b287-dcb7afcc9e90","Type":"ContainerDied","Data":"67d1026cedaa140671b7bccacea847c223cfcf08f49d5281987c54d86173eda4"}
Nov 02 08:12:42.773340 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:42.773102    6210 scope.go:122] "RemoveContainer" containerID="04dac11577eb37045b2b494ac27032393387e18da6293f0b1e128ef2f9fadb82"
Nov 02 08:12:42.782004 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:42.781975    6210 scope.go:122] "RemoveContainer" containerID="04dac11577eb37045b2b494ac27032393387e18da6293f0b1e128ef2f9fadb82"
Nov 02 08:12:42.782266 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:12:42.782247    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04dac11577eb37045b2b494ac27032393387e18da6293f0b1e128ef2f9fadb82\": container with ID starting with 04dac11577eb37045b2b494ac27032393387e18da6293f0b1e128ef2f9fadb82 not found: ID does not exist" containerID="04dac11577eb37045b2b494ac27032393387e18da6293f0b1e128ef2f9fadb82"
Nov 02 08:12:42.782310 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:42.782275    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04dac11577eb37045b2b494ac27032393387e18da6293f0b1e128ef2f9fadb82"} err="failed to get container status \"04dac11577eb37045b2b494ac27032393387e18da6293f0b1e128ef2f9fadb82\": rpc error: code = NotFound desc = could not find container \"04dac11577eb37045b2b494ac27032393387e18da6293f0b1e128ef2f9fadb82\": container with ID starting with 04dac11577eb37045b2b494ac27032393387e18da6293f0b1e128ef2f9fadb82 not found: ID does not exist"
Nov 02 08:12:42.925285 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:42.925246    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j"]
Nov 02 08:12:42.929508 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:42.929481    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j"]
Nov 02 08:12:44.350294 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:44.350261    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4d6f480a-b512-470e-b287-dcb7afcc9e90" path="/var/lib/kubelet/pods/4d6f480a-b512-470e-b287-dcb7afcc9e90/volumes"
Nov 02 08:12:44.631387 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:44.631303    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-kwv2h"]
Nov 02 08:12:44.631842 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:44.631818    6210 cpu_manager.go:414] "containerMap: removing container" podUID="4d6f480a-b512-470e-b287-dcb7afcc9e90" containerName="discovery"
Nov 02 08:12:44.631842 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:44.631840    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4d6f480a-b512-470e-b287-dcb7afcc9e90" containerName="discovery"
Nov 02 08:12:44.632100 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:44.631973    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="4d6f480a-b512-470e-b287-dcb7afcc9e90" containerName="discovery"
Nov 02 08:12:44.636404 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:44.636379    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-kwv2h"
Nov 02 08:12:44.688424 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:44.688396    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-kwv2h"]
Nov 02 08:12:44.733452 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:44.733427    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Nov 02 08:12:44.733605 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:44.733529    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-txltl\""
Nov 02 08:12:44.740621 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:44.740598    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2ca511f-24cb-4e9c-9452-0859666a8430-cert\") pod \"kserve-controller-manager-776cc66d47-kwv2h\" (UID: \"f2ca511f-24cb-4e9c-9452-0859666a8430\") " pod="opendatahub/kserve-controller-manager-776cc66d47-kwv2h"
Nov 02 08:12:44.740721 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:44.740661    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvjl2\" (UniqueName: \"kubernetes.io/projected/f2ca511f-24cb-4e9c-9452-0859666a8430-kube-api-access-fvjl2\") pod \"kserve-controller-manager-776cc66d47-kwv2h\" (UID: \"f2ca511f-24cb-4e9c-9452-0859666a8430\") " pod="opendatahub/kserve-controller-manager-776cc66d47-kwv2h"
Nov 02 08:12:44.742646 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:44.742627    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-64xrk"]
Nov 02 08:12:44.746079 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:44.746063    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-64xrk"
Nov 02 08:12:44.795225 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:44.795201    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Nov 02 08:12:44.795225 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:44.795202    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-drs99\""
Nov 02 08:12:44.799936 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:44.799909    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-64xrk"]
Nov 02 08:12:44.841407 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:44.841378    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvjl2\" (UniqueName: \"kubernetes.io/projected/f2ca511f-24cb-4e9c-9452-0859666a8430-kube-api-access-fvjl2\") pod \"kserve-controller-manager-776cc66d47-kwv2h\" (UID: \"f2ca511f-24cb-4e9c-9452-0859666a8430\") " pod="opendatahub/kserve-controller-manager-776cc66d47-kwv2h"
Nov 02 08:12:44.841548 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:44.841418    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp6hg\" (UniqueName: \"kubernetes.io/projected/04ec7d78-64c7-4b61-a5ac-9e6ed258d170-kube-api-access-xp6hg\") pod \"llmisvc-controller-manager-869d5dcc5d-64xrk\" (UID: \"04ec7d78-64c7-4b61-a5ac-9e6ed258d170\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-64xrk"
Nov 02 08:12:44.841548 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:44.841453    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2ca511f-24cb-4e9c-9452-0859666a8430-cert\") pod \"kserve-controller-manager-776cc66d47-kwv2h\" (UID: \"f2ca511f-24cb-4e9c-9452-0859666a8430\") " pod="opendatahub/kserve-controller-manager-776cc66d47-kwv2h"
Nov 02 08:12:44.841548 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:44.841489    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04ec7d78-64c7-4b61-a5ac-9e6ed258d170-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-64xrk\" (UID: \"04ec7d78-64c7-4b61-a5ac-9e6ed258d170\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-64xrk"
Nov 02 08:12:44.843844 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:44.843819    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2ca511f-24cb-4e9c-9452-0859666a8430-cert\") pod \"kserve-controller-manager-776cc66d47-kwv2h\" (UID: \"f2ca511f-24cb-4e9c-9452-0859666a8430\") " pod="opendatahub/kserve-controller-manager-776cc66d47-kwv2h"
Nov 02 08:12:44.894721 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:44.894662    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvjl2\" (UniqueName: \"kubernetes.io/projected/f2ca511f-24cb-4e9c-9452-0859666a8430-kube-api-access-fvjl2\") pod \"kserve-controller-manager-776cc66d47-kwv2h\" (UID: \"f2ca511f-24cb-4e9c-9452-0859666a8430\") " pod="opendatahub/kserve-controller-manager-776cc66d47-kwv2h"
Nov 02 08:12:44.942578 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:44.942547    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04ec7d78-64c7-4b61-a5ac-9e6ed258d170-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-64xrk\" (UID: \"04ec7d78-64c7-4b61-a5ac-9e6ed258d170\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-64xrk"
Nov 02 08:12:44.942705 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:44.942603    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp6hg\" (UniqueName: \"kubernetes.io/projected/04ec7d78-64c7-4b61-a5ac-9e6ed258d170-kube-api-access-xp6hg\") pod \"llmisvc-controller-manager-869d5dcc5d-64xrk\" (UID: \"04ec7d78-64c7-4b61-a5ac-9e6ed258d170\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-64xrk"
Nov 02 08:12:44.944774 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:44.944748    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04ec7d78-64c7-4b61-a5ac-9e6ed258d170-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-64xrk\" (UID: \"04ec7d78-64c7-4b61-a5ac-9e6ed258d170\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-64xrk"
Nov 02 08:12:44.951682 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:44.951657    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-kwv2h"
Nov 02 08:12:44.995484 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:44.995443    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp6hg\" (UniqueName: \"kubernetes.io/projected/04ec7d78-64c7-4b61-a5ac-9e6ed258d170-kube-api-access-xp6hg\") pod \"llmisvc-controller-manager-869d5dcc5d-64xrk\" (UID: \"04ec7d78-64c7-4b61-a5ac-9e6ed258d170\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-64xrk"
Nov 02 08:12:45.058139 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:45.058110    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-64xrk"
Nov 02 08:12:45.311295 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:45.311265    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-kwv2h"]
Nov 02 08:12:45.314085 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:12:45.314056    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2ca511f_24cb_4e9c_9452_0859666a8430.slice/crio-3cdad91812182364a755f42939ba33192a4d8a1cf57238c55a4429abe7e4f800 WatchSource:0}: Error finding container 3cdad91812182364a755f42939ba33192a4d8a1cf57238c55a4429abe7e4f800: Status 404 returned error can't find the container with id 3cdad91812182364a755f42939ba33192a4d8a1cf57238c55a4429abe7e4f800
Nov 02 08:12:45.417311 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:45.417282    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-64xrk"]
Nov 02 08:12:45.420038 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:12:45.420006    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod04ec7d78_64c7_4b61_a5ac_9e6ed258d170.slice/crio-c6bf395ac18c143d6a4a0f646eba06ab169ee5a365c087f96936eb9a1c0c66e7 WatchSource:0}: Error finding container c6bf395ac18c143d6a4a0f646eba06ab169ee5a365c087f96936eb9a1c0c66e7: Status 404 returned error can't find the container with id c6bf395ac18c143d6a4a0f646eba06ab169ee5a365c087f96936eb9a1c0c66e7
Nov 02 08:12:45.787010 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:45.786971    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-64xrk" event={"ID":"04ec7d78-64c7-4b61-a5ac-9e6ed258d170","Type":"ContainerStarted","Data":"c6bf395ac18c143d6a4a0f646eba06ab169ee5a365c087f96936eb9a1c0c66e7"}
Nov 02 08:12:45.788250 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:45.788226    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-kwv2h" event={"ID":"f2ca511f-24cb-4e9c-9452-0859666a8430","Type":"ContainerStarted","Data":"3cdad91812182364a755f42939ba33192a4d8a1cf57238c55a4429abe7e4f800"}
Nov 02 08:12:47.744130 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:47.744091    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75695549d4-cp6tv"
Nov 02 08:12:47.744607 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:47.744188    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7bb9976d7-w6btv"
Nov 02 08:12:47.983166 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:47.982603    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75695549d4-cp6tv"]
Nov 02 08:12:47.983166 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:47.982780    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-75695549d4-cp6tv" podUID="7d2fde63-168f-42c0-a0e6-fec7d29edb86" containerName="manager" containerID="cri-o://cee6461dd4da67ae0f02392521d44515a31786a530c3c83182fe70408429a2aa" gracePeriod=30
Nov 02 08:12:48.247940 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:48.247913    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75695549d4-cp6tv"
Nov 02 08:12:48.372965 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:48.372936    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7d2fde63-168f-42c0-a0e6-fec7d29edb86-webhook-cert\" (UniqueName: \"kubernetes.io/secret/7d2fde63-168f-42c0-a0e6-fec7d29edb86-webhook-cert\") pod \"7d2fde63-168f-42c0-a0e6-fec7d29edb86\" (UID: \"7d2fde63-168f-42c0-a0e6-fec7d29edb86\") "
Nov 02 08:12:48.373095 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:48.372988    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7d2fde63-168f-42c0-a0e6-fec7d29edb86-kube-api-access-4brdk\" (UniqueName: \"kubernetes.io/projected/7d2fde63-168f-42c0-a0e6-fec7d29edb86-kube-api-access-4brdk\") pod \"7d2fde63-168f-42c0-a0e6-fec7d29edb86\" (UID: \"7d2fde63-168f-42c0-a0e6-fec7d29edb86\") "
Nov 02 08:12:48.373163 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:48.373100    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7d2fde63-168f-42c0-a0e6-fec7d29edb86-metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d2fde63-168f-42c0-a0e6-fec7d29edb86-metrics-certs\") pod \"7d2fde63-168f-42c0-a0e6-fec7d29edb86\" (UID: \"7d2fde63-168f-42c0-a0e6-fec7d29edb86\") "
Nov 02 08:12:48.375410 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:48.375371    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d2fde63-168f-42c0-a0e6-fec7d29edb86-metrics-certs" pod "7d2fde63-168f-42c0-a0e6-fec7d29edb86" (UID: "7d2fde63-168f-42c0-a0e6-fec7d29edb86"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:12:48.375564 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:48.375538    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d2fde63-168f-42c0-a0e6-fec7d29edb86-webhook-cert" pod "7d2fde63-168f-42c0-a0e6-fec7d29edb86" (UID: "7d2fde63-168f-42c0-a0e6-fec7d29edb86"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:12:48.375620 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:48.375557    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d2fde63-168f-42c0-a0e6-fec7d29edb86-kube-api-access-4brdk" pod "7d2fde63-168f-42c0-a0e6-fec7d29edb86" (UID: "7d2fde63-168f-42c0-a0e6-fec7d29edb86"). InnerVolumeSpecName "kube-api-access-4brdk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:12:48.474638 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:48.474606    6210 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d2fde63-168f-42c0-a0e6-fec7d29edb86-metrics-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:12:48.474638 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:48.474634    6210 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7d2fde63-168f-42c0-a0e6-fec7d29edb86-webhook-cert\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:12:48.474638 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:48.474645    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4brdk\" (UniqueName: \"kubernetes.io/projected/7d2fde63-168f-42c0-a0e6-fec7d29edb86-kube-api-access-4brdk\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:12:48.805778 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:48.805732    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-64xrk" event={"ID":"04ec7d78-64c7-4b61-a5ac-9e6ed258d170","Type":"ContainerStarted","Data":"9a84cc3792550d7e335a5070125e1c604e5de886d0746561b423d5e0fb97d582"}
Nov 02 08:12:48.806234 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:48.805806    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-64xrk"
Nov 02 08:12:48.807343 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:48.807317    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-kwv2h" event={"ID":"f2ca511f-24cb-4e9c-9452-0859666a8430","Type":"ContainerStarted","Data":"bebc783f51a35969b95e1ebdb796a47921f96715e9168894a8db13a0f16c8f9e"}
Nov 02 08:12:48.807464 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:48.807391    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-776cc66d47-kwv2h"
Nov 02 08:12:48.808505 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:48.808483    6210 generic.go:356] "Generic (PLEG): container finished" podID="7d2fde63-168f-42c0-a0e6-fec7d29edb86" containerID="cee6461dd4da67ae0f02392521d44515a31786a530c3c83182fe70408429a2aa" exitCode=0
Nov 02 08:12:48.808583 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:48.808529    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75695549d4-cp6tv"
Nov 02 08:12:48.808583 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:48.808566    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75695549d4-cp6tv" event={"ID":"7d2fde63-168f-42c0-a0e6-fec7d29edb86","Type":"ContainerDied","Data":"cee6461dd4da67ae0f02392521d44515a31786a530c3c83182fe70408429a2aa"}
Nov 02 08:12:48.808663 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:48.808605    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75695549d4-cp6tv" event={"ID":"7d2fde63-168f-42c0-a0e6-fec7d29edb86","Type":"ContainerDied","Data":"99285c3fa4af5e4f3499d615a72bf57547195133320d6a0289c54fdda5a63c15"}
Nov 02 08:12:48.808663 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:48.808625    6210 scope.go:122] "RemoveContainer" containerID="cee6461dd4da67ae0f02392521d44515a31786a530c3c83182fe70408429a2aa"
Nov 02 08:12:48.817354 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:48.817333    6210 scope.go:122] "RemoveContainer" containerID="cee6461dd4da67ae0f02392521d44515a31786a530c3c83182fe70408429a2aa"
Nov 02 08:12:48.817666 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:12:48.817647    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cee6461dd4da67ae0f02392521d44515a31786a530c3c83182fe70408429a2aa\": container with ID starting with cee6461dd4da67ae0f02392521d44515a31786a530c3c83182fe70408429a2aa not found: ID does not exist" containerID="cee6461dd4da67ae0f02392521d44515a31786a530c3c83182fe70408429a2aa"
Nov 02 08:12:48.817723 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:48.817674    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cee6461dd4da67ae0f02392521d44515a31786a530c3c83182fe70408429a2aa"} err="failed to get container status \"cee6461dd4da67ae0f02392521d44515a31786a530c3c83182fe70408429a2aa\": rpc error: code = NotFound desc = could not find container \"cee6461dd4da67ae0f02392521d44515a31786a530c3c83182fe70408429a2aa\": container with ID starting with cee6461dd4da67ae0f02392521d44515a31786a530c3c83182fe70408429a2aa not found: ID does not exist"
Nov 02 08:12:48.912807 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:48.912752    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-64xrk" podStartSLOduration=2.384763208 podStartE2EDuration="4.91273974s" totalImagesPullingTime="2.527976532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:12:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:12:48.911134751 +0000 UTC m=+358.669563495" watchObservedRunningTime="2026-11-02 08:12:48.91273974 +0000 UTC m=+358.671168471"
Nov 02 08:12:49.015801 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:49.015772    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75695549d4-cp6tv"]
Nov 02 08:12:49.019507 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:49.019480    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-75695549d4-cp6tv"]
Nov 02 08:12:49.124304 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:49.124217    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-776cc66d47-kwv2h" podStartSLOduration=2.143634742 podStartE2EDuration="5.12417616s" totalImagesPullingTime="2.980541418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:12:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:12:49.123602807 +0000 UTC m=+358.882031539" watchObservedRunningTime="2026-11-02 08:12:49.12417616 +0000 UTC m=+358.882604891"
Nov 02 08:12:50.350463 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:12:50.350431    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7d2fde63-168f-42c0-a0e6-fec7d29edb86" path="/var/lib/kubelet/pods/7d2fde63-168f-42c0-a0e6-fec7d29edb86/volumes"
Nov 02 08:13:00.819636 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:13:00.819599    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:13:19.815844 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:19.815812    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-64xrk"
Nov 02 08:13:19.819052 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:19.819032    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-776cc66d47-kwv2h"
Nov 02 08:13:27.798909 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:27.798857    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6c8b96766-xr5jk"]
Nov 02 08:13:27.799325 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:27.799259    6210 cpu_manager.go:414] "containerMap: removing container" podUID="7d2fde63-168f-42c0-a0e6-fec7d29edb86" containerName="manager"
Nov 02 08:13:27.799325 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:27.799271    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7d2fde63-168f-42c0-a0e6-fec7d29edb86" containerName="manager"
Nov 02 08:13:27.799414 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:27.799342    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="7d2fde63-168f-42c0-a0e6-fec7d29edb86" containerName="manager"
Nov 02 08:13:27.801353 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:27.801329    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6c8b96766-xr5jk"
Nov 02 08:13:27.896509 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:27.896474    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-n86zq\""
Nov 02 08:13:27.896509 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:27.896496    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Nov 02 08:13:27.896509 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:27.896481    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Nov 02 08:13:27.897657 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:27.897632    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6c8b96766-xr5jk"]
Nov 02 08:13:27.930920 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:27.930894    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9672af25-ccbe-4e4b-9092-36bb77bbc976-openshift-service-ca\") pod \"maas-api-6c8b96766-xr5jk\" (UID: \"9672af25-ccbe-4e4b-9092-36bb77bbc976\") " pod="odh-ai-gateway-infra/maas-api-6c8b96766-xr5jk"
Nov 02 08:13:27.931028 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:27.930967    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qjbs\" (UniqueName: \"kubernetes.io/projected/9672af25-ccbe-4e4b-9092-36bb77bbc976-kube-api-access-2qjbs\") pod \"maas-api-6c8b96766-xr5jk\" (UID: \"9672af25-ccbe-4e4b-9092-36bb77bbc976\") " pod="odh-ai-gateway-infra/maas-api-6c8b96766-xr5jk"
Nov 02 08:13:27.931072 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:27.931036    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9672af25-ccbe-4e4b-9092-36bb77bbc976-maas-api-tls\") pod \"maas-api-6c8b96766-xr5jk\" (UID: \"9672af25-ccbe-4e4b-9092-36bb77bbc976\") " pod="odh-ai-gateway-infra/maas-api-6c8b96766-xr5jk"
Nov 02 08:13:27.931109 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:27.931081    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9672af25-ccbe-4e4b-9092-36bb77bbc976-metrics-certs\") pod \"maas-api-6c8b96766-xr5jk\" (UID: \"9672af25-ccbe-4e4b-9092-36bb77bbc976\") " pod="odh-ai-gateway-infra/maas-api-6c8b96766-xr5jk"
Nov 02 08:13:28.032132 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:28.032103    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qjbs\" (UniqueName: \"kubernetes.io/projected/9672af25-ccbe-4e4b-9092-36bb77bbc976-kube-api-access-2qjbs\") pod \"maas-api-6c8b96766-xr5jk\" (UID: \"9672af25-ccbe-4e4b-9092-36bb77bbc976\") " pod="odh-ai-gateway-infra/maas-api-6c8b96766-xr5jk"
Nov 02 08:13:28.032132 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:28.032134    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9672af25-ccbe-4e4b-9092-36bb77bbc976-maas-api-tls\") pod \"maas-api-6c8b96766-xr5jk\" (UID: \"9672af25-ccbe-4e4b-9092-36bb77bbc976\") " pod="odh-ai-gateway-infra/maas-api-6c8b96766-xr5jk"
Nov 02 08:13:28.032322 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:28.032163    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9672af25-ccbe-4e4b-9092-36bb77bbc976-metrics-certs\") pod \"maas-api-6c8b96766-xr5jk\" (UID: \"9672af25-ccbe-4e4b-9092-36bb77bbc976\") " pod="odh-ai-gateway-infra/maas-api-6c8b96766-xr5jk"
Nov 02 08:13:28.032322 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:28.032202    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9672af25-ccbe-4e4b-9092-36bb77bbc976-openshift-service-ca\") pod \"maas-api-6c8b96766-xr5jk\" (UID: \"9672af25-ccbe-4e4b-9092-36bb77bbc976\") " pod="odh-ai-gateway-infra/maas-api-6c8b96766-xr5jk"
Nov 02 08:13:28.032933 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:28.032909    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9672af25-ccbe-4e4b-9092-36bb77bbc976-openshift-service-ca\") pod \"maas-api-6c8b96766-xr5jk\" (UID: \"9672af25-ccbe-4e4b-9092-36bb77bbc976\") " pod="odh-ai-gateway-infra/maas-api-6c8b96766-xr5jk"
Nov 02 08:13:28.034559 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:28.034535    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9672af25-ccbe-4e4b-9092-36bb77bbc976-maas-api-tls\") pod \"maas-api-6c8b96766-xr5jk\" (UID: \"9672af25-ccbe-4e4b-9092-36bb77bbc976\") " pod="odh-ai-gateway-infra/maas-api-6c8b96766-xr5jk"
Nov 02 08:13:28.034706 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:28.034688    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9672af25-ccbe-4e4b-9092-36bb77bbc976-metrics-certs\") pod \"maas-api-6c8b96766-xr5jk\" (UID: \"9672af25-ccbe-4e4b-9092-36bb77bbc976\") " pod="odh-ai-gateway-infra/maas-api-6c8b96766-xr5jk"
Nov 02 08:13:28.085555 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:28.085484    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qjbs\" (UniqueName: \"kubernetes.io/projected/9672af25-ccbe-4e4b-9092-36bb77bbc976-kube-api-access-2qjbs\") pod \"maas-api-6c8b96766-xr5jk\" (UID: \"9672af25-ccbe-4e4b-9092-36bb77bbc976\") " pod="odh-ai-gateway-infra/maas-api-6c8b96766-xr5jk"
Nov 02 08:13:28.113369 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:28.113340    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6c8b96766-xr5jk"
Nov 02 08:13:28.480050 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:28.480017    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6c8b96766-xr5jk"]
Nov 02 08:13:28.483489 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:13:28.483458    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9672af25_ccbe_4e4b_9092_36bb77bbc976.slice/crio-968f3cce49881d6fa8061a9411239229e1c63ac26920a357bcc29573cdf70576 WatchSource:0}: Error finding container 968f3cce49881d6fa8061a9411239229e1c63ac26920a357bcc29573cdf70576: Status 404 returned error can't find the container with id 968f3cce49881d6fa8061a9411239229e1c63ac26920a357bcc29573cdf70576
Nov 02 08:13:28.979699 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:28.979664    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6c8b96766-xr5jk" event={"ID":"9672af25-ccbe-4e4b-9092-36bb77bbc976","Type":"ContainerStarted","Data":"968f3cce49881d6fa8061a9411239229e1c63ac26920a357bcc29573cdf70576"}
Nov 02 08:13:30.820850 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:13:30.820810    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:13:30.990134 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:30.990047    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6c8b96766-xr5jk" event={"ID":"9672af25-ccbe-4e4b-9092-36bb77bbc976","Type":"ContainerStarted","Data":"1a34f2aa4874beec2e37a4fe81e86f411e61eefe7548539c38debd41ea6fec9c"}
Nov 02 08:13:30.990273 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:30.990156    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6c8b96766-xr5jk"
Nov 02 08:13:31.097263 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:31.097197    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6c8b96766-xr5jk" podStartSLOduration=1.860678896 podStartE2EDuration="4.097179675s" totalImagesPullingTime="2.236500779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:13:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:13:31.09667528 +0000 UTC m=+400.855104024" watchObservedRunningTime="2026-11-02 08:13:31.097179675 +0000 UTC m=+400.855608405"
Nov 02 08:13:31.853317 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:31.853286    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-nj5xz"]
Nov 02 08:13:31.853798 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:31.853469    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-nj5xz" podUID="0d54bd00-93d3-41a2-a8b4-44dffee143fd" containerName="authorino" containerID="cri-o://49dd799aa81532f7b2526783e0124df1050789fad450fb873fb40a374a83238e" gracePeriod=30
Nov 02 08:13:31.996994 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:31.996964    6210 generic.go:356] "Generic (PLEG): container finished" podID="0d54bd00-93d3-41a2-a8b4-44dffee143fd" containerID="49dd799aa81532f7b2526783e0124df1050789fad450fb873fb40a374a83238e" exitCode=0
Nov 02 08:13:31.997145 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:31.997038    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-nj5xz" event={"ID":"0d54bd00-93d3-41a2-a8b4-44dffee143fd","Type":"ContainerDied","Data":"49dd799aa81532f7b2526783e0124df1050789fad450fb873fb40a374a83238e"}
Nov 02 08:13:32.104301 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:32.104253    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-nj5xz"
Nov 02 08:13:32.271107 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:32.271078    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0d54bd00-93d3-41a2-a8b4-44dffee143fd-kube-api-access-gzthm\" (UniqueName: \"kubernetes.io/projected/0d54bd00-93d3-41a2-a8b4-44dffee143fd-kube-api-access-gzthm\") pod \"0d54bd00-93d3-41a2-a8b4-44dffee143fd\" (UID: \"0d54bd00-93d3-41a2-a8b4-44dffee143fd\") "
Nov 02 08:13:32.273140 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:32.273107    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d54bd00-93d3-41a2-a8b4-44dffee143fd-kube-api-access-gzthm" pod "0d54bd00-93d3-41a2-a8b4-44dffee143fd" (UID: "0d54bd00-93d3-41a2-a8b4-44dffee143fd"). InnerVolumeSpecName "kube-api-access-gzthm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:13:32.372479 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:32.372450    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzthm\" (UniqueName: \"kubernetes.io/projected/0d54bd00-93d3-41a2-a8b4-44dffee143fd-kube-api-access-gzthm\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:13:33.002690 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:33.002655    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-nj5xz"
Nov 02 08:13:33.003182 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:33.002680    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-nj5xz" event={"ID":"0d54bd00-93d3-41a2-a8b4-44dffee143fd","Type":"ContainerDied","Data":"76160e2002dcb83bbe6334f665ffac51e594760e71b151fafbadfa7ab62e65bc"}
Nov 02 08:13:33.003182 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:33.002739    6210 scope.go:122] "RemoveContainer" containerID="49dd799aa81532f7b2526783e0124df1050789fad450fb873fb40a374a83238e"
Nov 02 08:13:33.153348 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:33.153313    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-nj5xz"]
Nov 02 08:13:33.155182 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:33.155156    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-nj5xz"]
Nov 02 08:13:34.351956 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:34.351925    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0d54bd00-93d3-41a2-a8b4-44dffee143fd" path="/var/lib/kubelet/pods/0d54bd00-93d3-41a2-a8b4-44dffee143fd/volumes"
Nov 02 08:13:37.002784 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:37.002758    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6c8b96766-xr5jk"
Nov 02 08:13:52.908580 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:52.908544    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-t4whx"]
Nov 02 08:13:52.908984 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:52.908957    6210 cpu_manager.go:414] "containerMap: removing container" podUID="0d54bd00-93d3-41a2-a8b4-44dffee143fd" containerName="authorino"
Nov 02 08:13:52.908984 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:52.908969    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0d54bd00-93d3-41a2-a8b4-44dffee143fd" containerName="authorino"
Nov 02 08:13:52.909056 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:52.909027    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="0d54bd00-93d3-41a2-a8b4-44dffee143fd" containerName="authorino"
Nov 02 08:13:52.913514 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:52.913495    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-t4whx"
Nov 02 08:13:52.947094 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:52.947062    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34a9f3d0-66b8-4ee2-af43-6933dfcb20b8-cert\") pod \"llmisvc-controller-manager-6466c554d8-t4whx\" (UID: \"34a9f3d0-66b8-4ee2-af43-6933dfcb20b8\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-t4whx"
Nov 02 08:13:52.947208 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:52.947095    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btjdp\" (UniqueName: \"kubernetes.io/projected/34a9f3d0-66b8-4ee2-af43-6933dfcb20b8-kube-api-access-btjdp\") pod \"llmisvc-controller-manager-6466c554d8-t4whx\" (UID: \"34a9f3d0-66b8-4ee2-af43-6933dfcb20b8\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-t4whx"
Nov 02 08:13:52.966235 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:52.966208    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-t4whx"]
Nov 02 08:13:53.047766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:53.047729    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btjdp\" (UniqueName: \"kubernetes.io/projected/34a9f3d0-66b8-4ee2-af43-6933dfcb20b8-kube-api-access-btjdp\") pod \"llmisvc-controller-manager-6466c554d8-t4whx\" (UID: \"34a9f3d0-66b8-4ee2-af43-6933dfcb20b8\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-t4whx"
Nov 02 08:13:53.047919 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:53.047845    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34a9f3d0-66b8-4ee2-af43-6933dfcb20b8-cert\") pod \"llmisvc-controller-manager-6466c554d8-t4whx\" (UID: \"34a9f3d0-66b8-4ee2-af43-6933dfcb20b8\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-t4whx"
Nov 02 08:13:53.050165 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:53.050132    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34a9f3d0-66b8-4ee2-af43-6933dfcb20b8-cert\") pod \"llmisvc-controller-manager-6466c554d8-t4whx\" (UID: \"34a9f3d0-66b8-4ee2-af43-6933dfcb20b8\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-t4whx"
Nov 02 08:13:53.101218 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:53.101189    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btjdp\" (UniqueName: \"kubernetes.io/projected/34a9f3d0-66b8-4ee2-af43-6933dfcb20b8-kube-api-access-btjdp\") pod \"llmisvc-controller-manager-6466c554d8-t4whx\" (UID: \"34a9f3d0-66b8-4ee2-af43-6933dfcb20b8\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-t4whx"
Nov 02 08:13:53.225863 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:53.225835    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-t4whx"
Nov 02 08:13:53.588522 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:53.588447    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-t4whx"]
Nov 02 08:13:53.592377 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:13:53.592348    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34a9f3d0_66b8_4ee2_af43_6933dfcb20b8.slice/crio-506e64067939bbdb38f1878735406df9a34859a706a532d63435c1be8f01a04c WatchSource:0}: Error finding container 506e64067939bbdb38f1878735406df9a34859a706a532d63435c1be8f01a04c: Status 404 returned error can't find the container with id 506e64067939bbdb38f1878735406df9a34859a706a532d63435c1be8f01a04c
Nov 02 08:13:54.093396 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:54.093358    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-t4whx" event={"ID":"34a9f3d0-66b8-4ee2-af43-6933dfcb20b8","Type":"ContainerStarted","Data":"506e64067939bbdb38f1878735406df9a34859a706a532d63435c1be8f01a04c"}
Nov 02 08:13:55.098954 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:55.098920    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-t4whx" event={"ID":"34a9f3d0-66b8-4ee2-af43-6933dfcb20b8","Type":"ContainerStarted","Data":"7395e88ad291c5f9933fa012b6a89ee64e97f3e85d9d0426fc0406aa5a1add49"}
Nov 02 08:13:55.099426 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:13:55.099016    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-t4whx"
Nov 02 08:14:00.819790 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:14:00.819752    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:14:11.758957 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:14:11.758918    6210 prober.go:122] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.us-west-2.compute.internal" podUID="5efd6818a2d6de09c2e33ba0444837d8" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": context deadline exceeded"
Nov 02 08:14:26.106188 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:14:26.106152    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-t4whx"
Nov 02 08:14:26.212327 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:14:26.212278    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-6466c554d8-t4whx" podStartSLOduration=33.413338453 podStartE2EDuration="34.212264498s" totalImagesPullingTime="798.926045ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:13:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:13:55.250184004 +0000 UTC m=+425.008612735" watchObservedRunningTime="2026-11-02 08:14:26.212264498 +0000 UTC m=+455.970693230"
Nov 02 08:14:26.258933 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:14:26.258904    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-64xrk"]
Nov 02 08:14:26.259169 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:14:26.259146    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-64xrk" podUID="04ec7d78-64c7-4b61-a5ac-9e6ed258d170" containerName="manager" containerID="cri-o://9a84cc3792550d7e335a5070125e1c604e5de886d0746561b423d5e0fb97d582" gracePeriod=30
Nov 02 08:14:26.503175 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:14:26.503141    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-64xrk"
Nov 02 08:14:26.645388 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:14:26.645310    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/04ec7d78-64c7-4b61-a5ac-9e6ed258d170-cert\" (UniqueName: \"kubernetes.io/secret/04ec7d78-64c7-4b61-a5ac-9e6ed258d170-cert\") pod \"04ec7d78-64c7-4b61-a5ac-9e6ed258d170\" (UID: \"04ec7d78-64c7-4b61-a5ac-9e6ed258d170\") "
Nov 02 08:14:26.645520 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:14:26.645429    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/04ec7d78-64c7-4b61-a5ac-9e6ed258d170-kube-api-access-xp6hg\" (UniqueName: \"kubernetes.io/projected/04ec7d78-64c7-4b61-a5ac-9e6ed258d170-kube-api-access-xp6hg\") pod \"04ec7d78-64c7-4b61-a5ac-9e6ed258d170\" (UID: \"04ec7d78-64c7-4b61-a5ac-9e6ed258d170\") "
Nov 02 08:14:26.647276 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:14:26.647248    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04ec7d78-64c7-4b61-a5ac-9e6ed258d170-cert" pod "04ec7d78-64c7-4b61-a5ac-9e6ed258d170" (UID: "04ec7d78-64c7-4b61-a5ac-9e6ed258d170"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:14:26.647399 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:14:26.647382    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04ec7d78-64c7-4b61-a5ac-9e6ed258d170-kube-api-access-xp6hg" pod "04ec7d78-64c7-4b61-a5ac-9e6ed258d170" (UID: "04ec7d78-64c7-4b61-a5ac-9e6ed258d170"). InnerVolumeSpecName "kube-api-access-xp6hg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:14:26.746629 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:14:26.746592    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xp6hg\" (UniqueName: \"kubernetes.io/projected/04ec7d78-64c7-4b61-a5ac-9e6ed258d170-kube-api-access-xp6hg\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:14:26.746629 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:14:26.746622    6210 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04ec7d78-64c7-4b61-a5ac-9e6ed258d170-cert\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:14:27.240292 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:14:27.240256    6210 generic.go:356] "Generic (PLEG): container finished" podID="04ec7d78-64c7-4b61-a5ac-9e6ed258d170" containerID="9a84cc3792550d7e335a5070125e1c604e5de886d0746561b423d5e0fb97d582" exitCode=0
Nov 02 08:14:27.240742 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:14:27.240305    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-64xrk"
Nov 02 08:14:27.240742 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:14:27.240340    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-64xrk" event={"ID":"04ec7d78-64c7-4b61-a5ac-9e6ed258d170","Type":"ContainerDied","Data":"9a84cc3792550d7e335a5070125e1c604e5de886d0746561b423d5e0fb97d582"}
Nov 02 08:14:27.240742 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:14:27.240397    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-64xrk" event={"ID":"04ec7d78-64c7-4b61-a5ac-9e6ed258d170","Type":"ContainerDied","Data":"c6bf395ac18c143d6a4a0f646eba06ab169ee5a365c087f96936eb9a1c0c66e7"}
Nov 02 08:14:27.240742 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:14:27.240425    6210 scope.go:122] "RemoveContainer" containerID="9a84cc3792550d7e335a5070125e1c604e5de886d0746561b423d5e0fb97d582"
Nov 02 08:14:27.249985 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:14:27.249967    6210 scope.go:122] "RemoveContainer" containerID="9a84cc3792550d7e335a5070125e1c604e5de886d0746561b423d5e0fb97d582"
Nov 02 08:14:27.250258 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:14:27.250240    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a84cc3792550d7e335a5070125e1c604e5de886d0746561b423d5e0fb97d582\": container with ID starting with 9a84cc3792550d7e335a5070125e1c604e5de886d0746561b423d5e0fb97d582 not found: ID does not exist" containerID="9a84cc3792550d7e335a5070125e1c604e5de886d0746561b423d5e0fb97d582"
Nov 02 08:14:27.250308 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:14:27.250268    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a84cc3792550d7e335a5070125e1c604e5de886d0746561b423d5e0fb97d582"} err="failed to get container status \"9a84cc3792550d7e335a5070125e1c604e5de886d0746561b423d5e0fb97d582\": rpc error: code = NotFound desc = could not find container \"9a84cc3792550d7e335a5070125e1c604e5de886d0746561b423d5e0fb97d582\": container with ID starting with 9a84cc3792550d7e335a5070125e1c604e5de886d0746561b423d5e0fb97d582 not found: ID does not exist"
Nov 02 08:14:27.395084 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:14:27.395047    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-64xrk"]
Nov 02 08:14:27.397907 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:14:27.397843    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-64xrk"]
Nov 02 08:14:28.350207 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:14:28.350174    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="04ec7d78-64c7-4b61-a5ac-9e6ed258d170" path="/var/lib/kubelet/pods/04ec7d78-64c7-4b61-a5ac-9e6ed258d170/volumes"
Nov 02 08:14:30.821426 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:14:30.821383    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:15:00.826035 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:15:00.821120    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:15:30.821910 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:15:30.821856    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:16:00.819482 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:16:00.819446    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:16:20.575313 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:20.575279    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"]
Nov 02 08:16:20.575800 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:20.575649    6210 cpu_manager.go:414] "containerMap: removing container" podUID="04ec7d78-64c7-4b61-a5ac-9e6ed258d170" containerName="manager"
Nov 02 08:16:20.575800 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:20.575660    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="04ec7d78-64c7-4b61-a5ac-9e6ed258d170" containerName="manager"
Nov 02 08:16:20.575800 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:20.575756    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="04ec7d78-64c7-4b61-a5ac-9e6ed258d170" containerName="manager"
Nov 02 08:16:20.578996 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:20.578975    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"
Nov 02 08:16:20.627816 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:20.627795    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-zmgsp\""
Nov 02 08:16:20.675799 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:20.675766    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"]
Nov 02 08:16:20.738232 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:20.738204    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c39ad91-eb96-4108-ba21-2259f7f90371-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-95rfd\" (UID: \"3c39ad91-eb96-4108-ba21-2259f7f90371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"
Nov 02 08:16:20.738411 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:20.738236    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6fch\" (UniqueName: \"kubernetes.io/projected/3c39ad91-eb96-4108-ba21-2259f7f90371-kube-api-access-w6fch\") pod \"maas-default-gateway-openshift-default-769df7846c-95rfd\" (UID: \"3c39ad91-eb96-4108-ba21-2259f7f90371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"
Nov 02 08:16:20.738411 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:20.738275    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c39ad91-eb96-4108-ba21-2259f7f90371-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-95rfd\" (UID: \"3c39ad91-eb96-4108-ba21-2259f7f90371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"
Nov 02 08:16:20.738542 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:20.738426    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c39ad91-eb96-4108-ba21-2259f7f90371-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-95rfd\" (UID: \"3c39ad91-eb96-4108-ba21-2259f7f90371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"
Nov 02 08:16:20.738542 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:20.738470    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c39ad91-eb96-4108-ba21-2259f7f90371-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-95rfd\" (UID: \"3c39ad91-eb96-4108-ba21-2259f7f90371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"
Nov 02 08:16:20.738646 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:20.738573    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c39ad91-eb96-4108-ba21-2259f7f90371-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-95rfd\" (UID: \"3c39ad91-eb96-4108-ba21-2259f7f90371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"
Nov 02 08:16:20.738646 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:20.738601    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c39ad91-eb96-4108-ba21-2259f7f90371-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-95rfd\" (UID: \"3c39ad91-eb96-4108-ba21-2259f7f90371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"
Nov 02 08:16:20.738761 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:20.738691    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c39ad91-eb96-4108-ba21-2259f7f90371-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-95rfd\" (UID: \"3c39ad91-eb96-4108-ba21-2259f7f90371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"
Nov 02 08:16:20.738761 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:20.738729    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c39ad91-eb96-4108-ba21-2259f7f90371-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-95rfd\" (UID: \"3c39ad91-eb96-4108-ba21-2259f7f90371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"
Nov 02 08:16:20.840175 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:20.840093    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c39ad91-eb96-4108-ba21-2259f7f90371-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-95rfd\" (UID: \"3c39ad91-eb96-4108-ba21-2259f7f90371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"
Nov 02 08:16:20.840175 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:20.840134    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c39ad91-eb96-4108-ba21-2259f7f90371-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-95rfd\" (UID: \"3c39ad91-eb96-4108-ba21-2259f7f90371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"
Nov 02 08:16:20.840389 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:20.840175    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c39ad91-eb96-4108-ba21-2259f7f90371-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-95rfd\" (UID: \"3c39ad91-eb96-4108-ba21-2259f7f90371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"
Nov 02 08:16:20.840389 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:20.840200    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c39ad91-eb96-4108-ba21-2259f7f90371-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-95rfd\" (UID: \"3c39ad91-eb96-4108-ba21-2259f7f90371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"
Nov 02 08:16:20.840389 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:20.840243    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c39ad91-eb96-4108-ba21-2259f7f90371-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-95rfd\" (UID: \"3c39ad91-eb96-4108-ba21-2259f7f90371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"
Nov 02 08:16:20.840389 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:20.840269    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6fch\" (UniqueName: \"kubernetes.io/projected/3c39ad91-eb96-4108-ba21-2259f7f90371-kube-api-access-w6fch\") pod \"maas-default-gateway-openshift-default-769df7846c-95rfd\" (UID: \"3c39ad91-eb96-4108-ba21-2259f7f90371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"
Nov 02 08:16:20.840389 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:20.840313    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c39ad91-eb96-4108-ba21-2259f7f90371-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-95rfd\" (UID: \"3c39ad91-eb96-4108-ba21-2259f7f90371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"
Nov 02 08:16:20.840389 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:20.840370    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c39ad91-eb96-4108-ba21-2259f7f90371-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-95rfd\" (UID: \"3c39ad91-eb96-4108-ba21-2259f7f90371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"
Nov 02 08:16:20.840687 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:20.840403    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c39ad91-eb96-4108-ba21-2259f7f90371-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-95rfd\" (UID: \"3c39ad91-eb96-4108-ba21-2259f7f90371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"
Nov 02 08:16:20.840687 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:20.840532    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c39ad91-eb96-4108-ba21-2259f7f90371-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-95rfd\" (UID: \"3c39ad91-eb96-4108-ba21-2259f7f90371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"
Nov 02 08:16:20.840817 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:20.840799    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c39ad91-eb96-4108-ba21-2259f7f90371-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-95rfd\" (UID: \"3c39ad91-eb96-4108-ba21-2259f7f90371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"
Nov 02 08:16:20.840910 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:20.840850    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c39ad91-eb96-4108-ba21-2259f7f90371-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-95rfd\" (UID: \"3c39ad91-eb96-4108-ba21-2259f7f90371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"
Nov 02 08:16:20.840986 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:20.840944    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c39ad91-eb96-4108-ba21-2259f7f90371-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-95rfd\" (UID: \"3c39ad91-eb96-4108-ba21-2259f7f90371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"
Nov 02 08:16:20.841047 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:20.840980    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c39ad91-eb96-4108-ba21-2259f7f90371-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-95rfd\" (UID: \"3c39ad91-eb96-4108-ba21-2259f7f90371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"
Nov 02 08:16:20.842792 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:20.842770    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c39ad91-eb96-4108-ba21-2259f7f90371-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-95rfd\" (UID: \"3c39ad91-eb96-4108-ba21-2259f7f90371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"
Nov 02 08:16:20.843344 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:20.843322    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c39ad91-eb96-4108-ba21-2259f7f90371-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-95rfd\" (UID: \"3c39ad91-eb96-4108-ba21-2259f7f90371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"
Nov 02 08:16:20.896863 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:20.896832    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c39ad91-eb96-4108-ba21-2259f7f90371-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-95rfd\" (UID: \"3c39ad91-eb96-4108-ba21-2259f7f90371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"
Nov 02 08:16:20.896974 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:20.896835    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6fch\" (UniqueName: \"kubernetes.io/projected/3c39ad91-eb96-4108-ba21-2259f7f90371-kube-api-access-w6fch\") pod \"maas-default-gateway-openshift-default-769df7846c-95rfd\" (UID: \"3c39ad91-eb96-4108-ba21-2259f7f90371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"
Nov 02 08:16:21.192560 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:21.192488    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"
Nov 02 08:16:21.607086 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:21.607055    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"]
Nov 02 08:16:21.610072 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:16:21.610045    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c39ad91_eb96_4108_ba21_2259f7f90371.slice/crio-fbc82dccfceaa57f4f7ca2b1f60e016476b486b670e19d39173803cb51bd558f WatchSource:0}: Error finding container fbc82dccfceaa57f4f7ca2b1f60e016476b486b670e19d39173803cb51bd558f: Status 404 returned error can't find the container with id fbc82dccfceaa57f4f7ca2b1f60e016476b486b670e19d39173803cb51bd558f
Nov 02 08:16:21.742774 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:21.742740    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd" event={"ID":"3c39ad91-eb96-4108-ba21-2259f7f90371","Type":"ContainerStarted","Data":"fbc82dccfceaa57f4f7ca2b1f60e016476b486b670e19d39173803cb51bd558f"}
Nov 02 08:16:25.440095 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:25.440063    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:16:25.440371 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:25.440129    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:16:25.440371 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:25.440159    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:16:25.766361 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:25.766328    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd" event={"ID":"3c39ad91-eb96-4108-ba21-2259f7f90371","Type":"ContainerStarted","Data":"9cde03c09b71ddbf71d4afca2cfc5337907c84360e01cf936cab90041cba1129"}
Nov 02 08:16:25.931064 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:25.930999    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd" podStartSLOduration=2.103734275 podStartE2EDuration="5.930978399s" totalImagesPullingTime="3.827244124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:16:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:16:25.930353546 +0000 UTC m=+575.688782279" watchObservedRunningTime="2026-11-02 08:16:25.930978399 +0000 UTC m=+575.689407133"
Nov 02 08:16:26.192933 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:26.192843    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"
Nov 02 08:16:26.194345 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:26.194321    6210 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-95rfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Nov 02 08:16:26.194464 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:26.194365    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd" podUID="3c39ad91-eb96-4108-ba21-2259f7f90371" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Nov 02 08:16:27.193645 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:27.193605    6210 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-95rfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Nov 02 08:16:27.194055 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:27.193684    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd" podUID="3c39ad91-eb96-4108-ba21-2259f7f90371" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Nov 02 08:16:28.193739 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:28.193701    6210 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-95rfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Nov 02 08:16:28.194258 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:28.193785    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd" podUID="3c39ad91-eb96-4108-ba21-2259f7f90371" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Nov 02 08:16:29.193131 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:29.193094    6210 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-95rfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Nov 02 08:16:29.193308 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:29.193164    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd" podUID="3c39ad91-eb96-4108-ba21-2259f7f90371" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Nov 02 08:16:30.193262 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:30.193224    6210 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-95rfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Nov 02 08:16:30.193674 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:30.193279    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd" podUID="3c39ad91-eb96-4108-ba21-2259f7f90371" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Nov 02 08:16:30.846986 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:16:30.846942    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:16:31.193438 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:31.193352    6210 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-95rfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Nov 02 08:16:31.193438 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:31.193413    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd" podUID="3c39ad91-eb96-4108-ba21-2259f7f90371" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Nov 02 08:16:32.193191 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:32.193151    6210 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-95rfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Nov 02 08:16:32.193468 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:32.193209    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd" podUID="3c39ad91-eb96-4108-ba21-2259f7f90371" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Nov 02 08:16:33.706930 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:33.706893    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"
Nov 02 08:16:33.707448 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:33.707235    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"
Nov 02 08:16:33.708131 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:33.708110    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"
Nov 02 08:16:50.398993 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:50.398960    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q_f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae/extract/0.log"
Nov 02 08:16:50.399799 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:50.399773    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q_f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae/extract/0.log"
Nov 02 08:16:50.413521 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:50.413498    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb77f_3e7ae74c-fcd8-4820-a8b7-769a5fff9f15/ovn-acl-logging/0.log"
Nov 02 08:16:50.414686 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:16:50.414664    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb77f_3e7ae74c-fcd8-4820-a8b7-769a5fff9f15/ovn-acl-logging/0.log"
Nov 02 08:17:00.819861 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:17:00.819825    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:17:17.721990 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:17.721927    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2b62c067-5758697c69-pfcq2"]
Nov 02 08:17:17.725584 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:17.725565    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b62c067-5758697c69-pfcq2"
Nov 02 08:17:17.775440 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:17.775412    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-2b62c067-serving-cert\""
Nov 02 08:17:17.810584 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:17.810554    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61e6f457-ba4d-4540-8b83-9e0a94f7f9a8-metrics-certs\") pod \"maas-api-e2e-ait-2b62c067-5758697c69-pfcq2\" (UID: \"61e6f457-ba4d-4540-8b83-9e0a94f7f9a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b62c067-5758697c69-pfcq2"
Nov 02 08:17:17.810740 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:17.810616    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztvd8\" (UniqueName: \"kubernetes.io/projected/61e6f457-ba4d-4540-8b83-9e0a94f7f9a8-kube-api-access-ztvd8\") pod \"maas-api-e2e-ait-2b62c067-5758697c69-pfcq2\" (UID: \"61e6f457-ba4d-4540-8b83-9e0a94f7f9a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b62c067-5758697c69-pfcq2"
Nov 02 08:17:17.810740 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:17.810718    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61e6f457-ba4d-4540-8b83-9e0a94f7f9a8-maas-api-tls\") pod \"maas-api-e2e-ait-2b62c067-5758697c69-pfcq2\" (UID: \"61e6f457-ba4d-4540-8b83-9e0a94f7f9a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b62c067-5758697c69-pfcq2"
Nov 02 08:17:17.810851 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:17.810770    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61e6f457-ba4d-4540-8b83-9e0a94f7f9a8-openshift-service-ca\") pod \"maas-api-e2e-ait-2b62c067-5758697c69-pfcq2\" (UID: \"61e6f457-ba4d-4540-8b83-9e0a94f7f9a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b62c067-5758697c69-pfcq2"
Nov 02 08:17:17.822964 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:17.822940    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2b62c067-5758697c69-pfcq2"]
Nov 02 08:17:17.911403 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:17.911361    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztvd8\" (UniqueName: \"kubernetes.io/projected/61e6f457-ba4d-4540-8b83-9e0a94f7f9a8-kube-api-access-ztvd8\") pod \"maas-api-e2e-ait-2b62c067-5758697c69-pfcq2\" (UID: \"61e6f457-ba4d-4540-8b83-9e0a94f7f9a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b62c067-5758697c69-pfcq2"
Nov 02 08:17:17.911403 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:17.911398    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61e6f457-ba4d-4540-8b83-9e0a94f7f9a8-maas-api-tls\") pod \"maas-api-e2e-ait-2b62c067-5758697c69-pfcq2\" (UID: \"61e6f457-ba4d-4540-8b83-9e0a94f7f9a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b62c067-5758697c69-pfcq2"
Nov 02 08:17:17.911642 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:17.911425    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61e6f457-ba4d-4540-8b83-9e0a94f7f9a8-openshift-service-ca\") pod \"maas-api-e2e-ait-2b62c067-5758697c69-pfcq2\" (UID: \"61e6f457-ba4d-4540-8b83-9e0a94f7f9a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b62c067-5758697c69-pfcq2"
Nov 02 08:17:17.911642 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:17:17.911535    6210 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-2b62c067-serving-cert: secret "maas-api-e2e-ait-2b62c067-serving-cert" not found
Nov 02 08:17:17.911642 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:17.911604    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61e6f457-ba4d-4540-8b83-9e0a94f7f9a8-metrics-certs\") pod \"maas-api-e2e-ait-2b62c067-5758697c69-pfcq2\" (UID: \"61e6f457-ba4d-4540-8b83-9e0a94f7f9a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b62c067-5758697c69-pfcq2"
Nov 02 08:17:17.911815 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:17:17.911713    6210 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61e6f457-ba4d-4540-8b83-9e0a94f7f9a8-maas-api-tls podName:61e6f457-ba4d-4540-8b83-9e0a94f7f9a8 nodeName:}" failed. No retries permitted until 2026-11-02 08:17:18.411686631 +0000 UTC m=+628.170115341 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/61e6f457-ba4d-4540-8b83-9e0a94f7f9a8-maas-api-tls") pod "maas-api-e2e-ait-2b62c067-5758697c69-pfcq2" (UID: "61e6f457-ba4d-4540-8b83-9e0a94f7f9a8") : secret "maas-api-e2e-ait-2b62c067-serving-cert" not found
Nov 02 08:17:17.912063 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:17.912039    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61e6f457-ba4d-4540-8b83-9e0a94f7f9a8-openshift-service-ca\") pod \"maas-api-e2e-ait-2b62c067-5758697c69-pfcq2\" (UID: \"61e6f457-ba4d-4540-8b83-9e0a94f7f9a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b62c067-5758697c69-pfcq2"
Nov 02 08:17:17.914005 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:17.913983    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61e6f457-ba4d-4540-8b83-9e0a94f7f9a8-metrics-certs\") pod \"maas-api-e2e-ait-2b62c067-5758697c69-pfcq2\" (UID: \"61e6f457-ba4d-4540-8b83-9e0a94f7f9a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b62c067-5758697c69-pfcq2"
Nov 02 08:17:17.967959 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:17.967927    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztvd8\" (UniqueName: \"kubernetes.io/projected/61e6f457-ba4d-4540-8b83-9e0a94f7f9a8-kube-api-access-ztvd8\") pod \"maas-api-e2e-ait-2b62c067-5758697c69-pfcq2\" (UID: \"61e6f457-ba4d-4540-8b83-9e0a94f7f9a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b62c067-5758697c69-pfcq2"
Nov 02 08:17:18.416593 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:18.416558    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61e6f457-ba4d-4540-8b83-9e0a94f7f9a8-maas-api-tls\") pod \"maas-api-e2e-ait-2b62c067-5758697c69-pfcq2\" (UID: \"61e6f457-ba4d-4540-8b83-9e0a94f7f9a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b62c067-5758697c69-pfcq2"
Nov 02 08:17:18.418917 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:18.418895    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61e6f457-ba4d-4540-8b83-9e0a94f7f9a8-maas-api-tls\") pod \"maas-api-e2e-ait-2b62c067-5758697c69-pfcq2\" (UID: \"61e6f457-ba4d-4540-8b83-9e0a94f7f9a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b62c067-5758697c69-pfcq2"
Nov 02 08:17:18.638082 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:18.638052    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b62c067-5758697c69-pfcq2"
Nov 02 08:17:19.005048 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:19.004653    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2b62c067-5758697c69-pfcq2"]
Nov 02 08:17:19.008085 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:17:19.008056    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61e6f457_ba4d_4540_8b83_9e0a94f7f9a8.slice/crio-2e706962e5b30f2b46dedf49c0e2402d9478a69ce34fb1fccb2f0bc728fc24d0 WatchSource:0}: Error finding container 2e706962e5b30f2b46dedf49c0e2402d9478a69ce34fb1fccb2f0bc728fc24d0: Status 404 returned error can't find the container with id 2e706962e5b30f2b46dedf49c0e2402d9478a69ce34fb1fccb2f0bc728fc24d0
Nov 02 08:17:20.011917 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:20.011890    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b62c067-5758697c69-pfcq2" event={"ID":"61e6f457-ba4d-4540-8b83-9e0a94f7f9a8","Type":"ContainerStarted","Data":"8672ba48959a3bc37cefa2b19d0bfe9c33566d74b87704f13efad277be444b00"}
Nov 02 08:17:20.012255 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:20.011950    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b62c067-5758697c69-pfcq2" event={"ID":"61e6f457-ba4d-4540-8b83-9e0a94f7f9a8","Type":"ContainerStarted","Data":"2e706962e5b30f2b46dedf49c0e2402d9478a69ce34fb1fccb2f0bc728fc24d0"}
Nov 02 08:17:20.012255 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:20.012040    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b62c067-5758697c69-pfcq2"
Nov 02 08:17:20.122042 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:20.121983    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b62c067-5758697c69-pfcq2" podStartSLOduration=2.218084539 podStartE2EDuration="3.121965729s" totalImagesPullingTime="903.88119ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:17:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:17:20.121042635 +0000 UTC m=+629.879471367" watchObservedRunningTime="2026-11-02 08:17:20.121965729 +0000 UTC m=+629.880394461"
Nov 02 08:17:23.181296 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:23.181260    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-53cc8e62-68db469795-lffvz"]
Nov 02 08:17:23.184955 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:23.184931    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-53cc8e62-68db469795-lffvz"
Nov 02 08:17:23.234235 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:23.234205    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-53cc8e62-serving-cert\""
Nov 02 08:17:23.267418 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:23.267382    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzh5d\" (UniqueName: \"kubernetes.io/projected/4d235018-51e9-4fde-b8c7-eb12447b9c64-kube-api-access-jzh5d\") pod \"maas-api-e2e-migrate-53cc8e62-68db469795-lffvz\" (UID: \"4d235018-51e9-4fde-b8c7-eb12447b9c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-53cc8e62-68db469795-lffvz"
Nov 02 08:17:23.267581 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:23.267430    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d235018-51e9-4fde-b8c7-eb12447b9c64-maas-api-tls\") pod \"maas-api-e2e-migrate-53cc8e62-68db469795-lffvz\" (UID: \"4d235018-51e9-4fde-b8c7-eb12447b9c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-53cc8e62-68db469795-lffvz"
Nov 02 08:17:23.267581 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:23.267528    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d235018-51e9-4fde-b8c7-eb12447b9c64-metrics-certs\") pod \"maas-api-e2e-migrate-53cc8e62-68db469795-lffvz\" (UID: \"4d235018-51e9-4fde-b8c7-eb12447b9c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-53cc8e62-68db469795-lffvz"
Nov 02 08:17:23.267661 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:23.267622    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d235018-51e9-4fde-b8c7-eb12447b9c64-openshift-service-ca\") pod \"maas-api-e2e-migrate-53cc8e62-68db469795-lffvz\" (UID: \"4d235018-51e9-4fde-b8c7-eb12447b9c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-53cc8e62-68db469795-lffvz"
Nov 02 08:17:23.282203 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:23.282176    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-53cc8e62-68db469795-lffvz"]
Nov 02 08:17:23.368943 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:23.368905    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d235018-51e9-4fde-b8c7-eb12447b9c64-openshift-service-ca\") pod \"maas-api-e2e-migrate-53cc8e62-68db469795-lffvz\" (UID: \"4d235018-51e9-4fde-b8c7-eb12447b9c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-53cc8e62-68db469795-lffvz"
Nov 02 08:17:23.369123 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:23.368964    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzh5d\" (UniqueName: \"kubernetes.io/projected/4d235018-51e9-4fde-b8c7-eb12447b9c64-kube-api-access-jzh5d\") pod \"maas-api-e2e-migrate-53cc8e62-68db469795-lffvz\" (UID: \"4d235018-51e9-4fde-b8c7-eb12447b9c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-53cc8e62-68db469795-lffvz"
Nov 02 08:17:23.369123 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:23.369065    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d235018-51e9-4fde-b8c7-eb12447b9c64-maas-api-tls\") pod \"maas-api-e2e-migrate-53cc8e62-68db469795-lffvz\" (UID: \"4d235018-51e9-4fde-b8c7-eb12447b9c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-53cc8e62-68db469795-lffvz"
Nov 02 08:17:23.369237 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:23.369135    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d235018-51e9-4fde-b8c7-eb12447b9c64-metrics-certs\") pod \"maas-api-e2e-migrate-53cc8e62-68db469795-lffvz\" (UID: \"4d235018-51e9-4fde-b8c7-eb12447b9c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-53cc8e62-68db469795-lffvz"
Nov 02 08:17:23.369276 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:17:23.369252    6210 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-53cc8e62-serving-cert: secret "maas-api-e2e-migrate-53cc8e62-serving-cert" not found
Nov 02 08:17:23.369330 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:17:23.369319    6210 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d235018-51e9-4fde-b8c7-eb12447b9c64-maas-api-tls podName:4d235018-51e9-4fde-b8c7-eb12447b9c64 nodeName:}" failed. No retries permitted until 2026-11-02 08:17:23.869300097 +0000 UTC m=+633.627728814 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4d235018-51e9-4fde-b8c7-eb12447b9c64-maas-api-tls") pod "maas-api-e2e-migrate-53cc8e62-68db469795-lffvz" (UID: "4d235018-51e9-4fde-b8c7-eb12447b9c64") : secret "maas-api-e2e-migrate-53cc8e62-serving-cert" not found
Nov 02 08:17:23.369699 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:23.369679    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d235018-51e9-4fde-b8c7-eb12447b9c64-openshift-service-ca\") pod \"maas-api-e2e-migrate-53cc8e62-68db469795-lffvz\" (UID: \"4d235018-51e9-4fde-b8c7-eb12447b9c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-53cc8e62-68db469795-lffvz"
Nov 02 08:17:23.371569 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:23.371549    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d235018-51e9-4fde-b8c7-eb12447b9c64-metrics-certs\") pod \"maas-api-e2e-migrate-53cc8e62-68db469795-lffvz\" (UID: \"4d235018-51e9-4fde-b8c7-eb12447b9c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-53cc8e62-68db469795-lffvz"
Nov 02 08:17:23.424002 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:23.423976    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzh5d\" (UniqueName: \"kubernetes.io/projected/4d235018-51e9-4fde-b8c7-eb12447b9c64-kube-api-access-jzh5d\") pod \"maas-api-e2e-migrate-53cc8e62-68db469795-lffvz\" (UID: \"4d235018-51e9-4fde-b8c7-eb12447b9c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-53cc8e62-68db469795-lffvz"
Nov 02 08:17:23.873310 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:23.873268    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d235018-51e9-4fde-b8c7-eb12447b9c64-maas-api-tls\") pod \"maas-api-e2e-migrate-53cc8e62-68db469795-lffvz\" (UID: \"4d235018-51e9-4fde-b8c7-eb12447b9c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-53cc8e62-68db469795-lffvz"
Nov 02 08:17:23.875773 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:23.875746    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d235018-51e9-4fde-b8c7-eb12447b9c64-maas-api-tls\") pod \"maas-api-e2e-migrate-53cc8e62-68db469795-lffvz\" (UID: \"4d235018-51e9-4fde-b8c7-eb12447b9c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-53cc8e62-68db469795-lffvz"
Nov 02 08:17:24.097454 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:24.097419    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-53cc8e62-68db469795-lffvz"
Nov 02 08:17:24.460763 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:24.460732    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-53cc8e62-68db469795-lffvz"]
Nov 02 08:17:24.464229 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:17:24.464198    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d235018_51e9_4fde_b8c7_eb12447b9c64.slice/crio-32b9493640f44c0087976ce91e8eff4b74dfc11cdea75e468ca117616870b76d WatchSource:0}: Error finding container 32b9493640f44c0087976ce91e8eff4b74dfc11cdea75e468ca117616870b76d: Status 404 returned error can't find the container with id 32b9493640f44c0087976ce91e8eff4b74dfc11cdea75e468ca117616870b76d
Nov 02 08:17:25.037393 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:25.037359    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-53cc8e62-68db469795-lffvz" event={"ID":"4d235018-51e9-4fde-b8c7-eb12447b9c64","Type":"ContainerStarted","Data":"32b9493640f44c0087976ce91e8eff4b74dfc11cdea75e468ca117616870b76d"}
Nov 02 08:17:26.022102 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:26.022067    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b62c067-5758697c69-pfcq2"
Nov 02 08:17:26.051356 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:26.049916    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-53cc8e62-68db469795-lffvz" event={"ID":"4d235018-51e9-4fde-b8c7-eb12447b9c64","Type":"ContainerStarted","Data":"7aed43069154e0919b42045d018da643f8cebe33e9e51c7da50feb10632d74b5"}
Nov 02 08:17:26.051356 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:26.050600    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-53cc8e62-68db469795-lffvz"
Nov 02 08:17:26.248406 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:26.248336    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-53cc8e62-68db469795-lffvz" podStartSLOduration=2.3282138039999998 podStartE2EDuration="3.248320026s" totalImagesPullingTime="920.106222ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:17:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:17:26.248085706 +0000 UTC m=+636.006514439" watchObservedRunningTime="2026-11-02 08:17:26.248320026 +0000 UTC m=+636.006748757"
Nov 02 08:17:30.819049 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:17:30.819010    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:17:33.065538 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:33.065508    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-53cc8e62-68db469795-lffvz"
Nov 02 08:17:37.624993 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:37.624958    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c"]
Nov 02 08:17:37.628762 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:37.628741    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c"
Nov 02 08:17:37.704739 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:37.704704    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c\" (UID: \"b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c"
Nov 02 08:17:37.704739 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:37.704743    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drlhx\" (UniqueName: \"kubernetes.io/projected/b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb-kube-api-access-drlhx\") pod \"payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c\" (UID: \"b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c"
Nov 02 08:17:37.726653 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:37.726631    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-e6ca80\""
Nov 02 08:17:37.726909 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:37.726870    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-e6ca80-dockercfg-pnmpg\""
Nov 02 08:17:37.728071 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:37.728053    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c"]
Nov 02 08:17:37.805657 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:37.805624    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c\" (UID: \"b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c"
Nov 02 08:17:37.805657 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:37.805664    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drlhx\" (UniqueName: \"kubernetes.io/projected/b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb-kube-api-access-drlhx\") pod \"payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c\" (UID: \"b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c"
Nov 02 08:17:37.806354 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:37.806331    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c\" (UID: \"b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c"
Nov 02 08:17:37.859529 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:37.859499    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drlhx\" (UniqueName: \"kubernetes.io/projected/b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb-kube-api-access-drlhx\") pod \"payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c\" (UID: \"b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c"
Nov 02 08:17:37.942433 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:37.942355    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c"
Nov 02 08:17:38.304887 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:38.304847    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c"]
Nov 02 08:17:38.307914 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:17:38.307869    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb42fd087_dcbf_4cfc_9d12_81ec7cf5fdfb.slice/crio-597966591f882b7e47bc0a153b7e053f1ce2122d740bb24d2e81d18b718229fb WatchSource:0}: Error finding container 597966591f882b7e47bc0a153b7e053f1ce2122d740bb24d2e81d18b718229fb: Status 404 returned error can't find the container with id 597966591f882b7e47bc0a153b7e053f1ce2122d740bb24d2e81d18b718229fb
Nov 02 08:17:38.310037 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:38.310017    6210 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 02 08:17:38.341182 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:38.341154    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5"]
Nov 02 08:17:38.345871 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:38.345848    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5"
Nov 02 08:17:38.394792 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:38.394759    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w1-d0628e-serving-cert\""
Nov 02 08:17:38.399906 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:38.399869    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5"]
Nov 02 08:17:38.411645 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:38.411616    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndvzj\" (UniqueName: \"kubernetes.io/projected/e6c2bace-5413-4a8d-84da-34790415a48d-kube-api-access-ndvzj\") pod \"maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5\" (UID: \"e6c2bace-5413-4a8d-84da-34790415a48d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5"
Nov 02 08:17:38.411735 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:38.411653    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6c2bace-5413-4a8d-84da-34790415a48d-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5\" (UID: \"e6c2bace-5413-4a8d-84da-34790415a48d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5"
Nov 02 08:17:38.411735 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:38.411678    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6c2bace-5413-4a8d-84da-34790415a48d-metrics-certs\") pod \"maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5\" (UID: \"e6c2bace-5413-4a8d-84da-34790415a48d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5"
Nov 02 08:17:38.411809 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:38.411742    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6c2bace-5413-4a8d-84da-34790415a48d-maas-api-tls\") pod \"maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5\" (UID: \"e6c2bace-5413-4a8d-84da-34790415a48d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5"
Nov 02 08:17:38.512781 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:38.512742    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndvzj\" (UniqueName: \"kubernetes.io/projected/e6c2bace-5413-4a8d-84da-34790415a48d-kube-api-access-ndvzj\") pod \"maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5\" (UID: \"e6c2bace-5413-4a8d-84da-34790415a48d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5"
Nov 02 08:17:38.512934 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:38.512789    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6c2bace-5413-4a8d-84da-34790415a48d-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5\" (UID: \"e6c2bace-5413-4a8d-84da-34790415a48d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5"
Nov 02 08:17:38.512934 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:38.512814    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6c2bace-5413-4a8d-84da-34790415a48d-metrics-certs\") pod \"maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5\" (UID: \"e6c2bace-5413-4a8d-84da-34790415a48d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5"
Nov 02 08:17:38.513022 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:38.512992    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6c2bace-5413-4a8d-84da-34790415a48d-maas-api-tls\") pod \"maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5\" (UID: \"e6c2bace-5413-4a8d-84da-34790415a48d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5"
Nov 02 08:17:38.513128 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:17:38.513111    6210 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w1-d0628e-serving-cert: secret "maas-api-e2e-worker-w1-d0628e-serving-cert" not found
Nov 02 08:17:38.513179 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:17:38.513169    6210 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6c2bace-5413-4a8d-84da-34790415a48d-maas-api-tls podName:e6c2bace-5413-4a8d-84da-34790415a48d nodeName:}" failed. No retries permitted until 2026-11-02 08:17:39.013156038 +0000 UTC m=+648.771584771 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e6c2bace-5413-4a8d-84da-34790415a48d-maas-api-tls") pod "maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5" (UID: "e6c2bace-5413-4a8d-84da-34790415a48d") : secret "maas-api-e2e-worker-w1-d0628e-serving-cert" not found
Nov 02 08:17:38.513515 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:38.513499    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6c2bace-5413-4a8d-84da-34790415a48d-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5\" (UID: \"e6c2bace-5413-4a8d-84da-34790415a48d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5"
Nov 02 08:17:38.515229 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:38.515213    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6c2bace-5413-4a8d-84da-34790415a48d-metrics-certs\") pod \"maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5\" (UID: \"e6c2bace-5413-4a8d-84da-34790415a48d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5"
Nov 02 08:17:38.568405 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:38.568343    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndvzj\" (UniqueName: \"kubernetes.io/projected/e6c2bace-5413-4a8d-84da-34790415a48d-kube-api-access-ndvzj\") pod \"maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5\" (UID: \"e6c2bace-5413-4a8d-84da-34790415a48d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5"
Nov 02 08:17:39.018016 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:39.017983    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6c2bace-5413-4a8d-84da-34790415a48d-maas-api-tls\") pod \"maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5\" (UID: \"e6c2bace-5413-4a8d-84da-34790415a48d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5"
Nov 02 08:17:39.020425 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:39.020398    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6c2bace-5413-4a8d-84da-34790415a48d-maas-api-tls\") pod \"maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5\" (UID: \"e6c2bace-5413-4a8d-84da-34790415a48d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5"
Nov 02 08:17:39.108032 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:39.107998    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c" event={"ID":"b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb","Type":"ContainerStarted","Data":"597966591f882b7e47bc0a153b7e053f1ce2122d740bb24d2e81d18b718229fb"}
Nov 02 08:17:39.259627 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:39.259597    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5"
Nov 02 08:17:39.637075 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:39.637049    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5"]
Nov 02 08:17:39.640130 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:17:39.640100    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6c2bace_5413_4a8d_84da_34790415a48d.slice/crio-ff087ef29999012d88d07be9a554b2b21f1498c7199b63e5dc548d873a0e0a60 WatchSource:0}: Error finding container ff087ef29999012d88d07be9a554b2b21f1498c7199b63e5dc548d873a0e0a60: Status 404 returned error can't find the container with id ff087ef29999012d88d07be9a554b2b21f1498c7199b63e5dc548d873a0e0a60
Nov 02 08:17:40.113415 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:40.113380    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5" event={"ID":"e6c2bace-5413-4a8d-84da-34790415a48d","Type":"ContainerStarted","Data":"ff087ef29999012d88d07be9a554b2b21f1498c7199b63e5dc548d873a0e0a60"}
Nov 02 08:17:41.120714 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:41.120683    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c" event={"ID":"b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb","Type":"ContainerStarted","Data":"ee8c18753b4a1195ca5d4f911d1e004c968e93853239601f08799092e561e476"}
Nov 02 08:17:41.121160 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:41.120804    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c"
Nov 02 08:17:41.122197 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:41.122174    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5" event={"ID":"e6c2bace-5413-4a8d-84da-34790415a48d","Type":"ContainerStarted","Data":"fd581d1687f19a1e4b7400c289690a5fcfb90b622c9ed79bc8e28121ed075362"}
Nov 02 08:17:41.122320 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:41.122265    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5"
Nov 02 08:17:41.229248 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:41.229139    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c" podStartSLOduration=1.581367444 podStartE2EDuration="4.2291243s" totalImagesPullingTime="2.647756856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:17:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:17:41.228517613 +0000 UTC m=+650.986946358" watchObservedRunningTime="2026-11-02 08:17:41.2291243 +0000 UTC m=+650.987553033"
Nov 02 08:17:41.337194 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:41.337133    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5" podStartSLOduration=2.499684237 podStartE2EDuration="3.337116123s" totalImagesPullingTime="837.431886ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:17:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:17:41.336024044 +0000 UTC m=+651.094452981" watchObservedRunningTime="2026-11-02 08:17:41.337116123 +0000 UTC m=+651.095544856"
Nov 02 08:17:47.132398 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:47.132368    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5"
Nov 02 08:17:49.061312 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:49.061273    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-16457c0e-75b5586765-cxjfr"]
Nov 02 08:17:49.065142 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:49.065120    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-16457c0e-75b5586765-cxjfr"
Nov 02 08:17:49.113677 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:49.113652    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-16457c0e-serving-cert\""
Nov 02 08:17:49.131524 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:49.131501    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tshhq\" (UniqueName: \"kubernetes.io/projected/6bbd4b1c-6125-49a6-87a7-e28ba7288c4a-kube-api-access-tshhq\") pod \"maas-api-e2e-derive-16457c0e-75b5586765-cxjfr\" (UID: \"6bbd4b1c-6125-49a6-87a7-e28ba7288c4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-16457c0e-75b5586765-cxjfr"
Nov 02 08:17:49.131619 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:49.131546    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bbd4b1c-6125-49a6-87a7-e28ba7288c4a-metrics-certs\") pod \"maas-api-e2e-derive-16457c0e-75b5586765-cxjfr\" (UID: \"6bbd4b1c-6125-49a6-87a7-e28ba7288c4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-16457c0e-75b5586765-cxjfr"
Nov 02 08:17:49.131682 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:49.131668    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bbd4b1c-6125-49a6-87a7-e28ba7288c4a-maas-api-tls\") pod \"maas-api-e2e-derive-16457c0e-75b5586765-cxjfr\" (UID: \"6bbd4b1c-6125-49a6-87a7-e28ba7288c4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-16457c0e-75b5586765-cxjfr"
Nov 02 08:17:49.131718 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:49.131689    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bbd4b1c-6125-49a6-87a7-e28ba7288c4a-openshift-service-ca\") pod \"maas-api-e2e-derive-16457c0e-75b5586765-cxjfr\" (UID: \"6bbd4b1c-6125-49a6-87a7-e28ba7288c4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-16457c0e-75b5586765-cxjfr"
Nov 02 08:17:49.161346 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:49.161320    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-16457c0e-75b5586765-cxjfr"]
Nov 02 08:17:49.232935 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:49.232871    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tshhq\" (UniqueName: \"kubernetes.io/projected/6bbd4b1c-6125-49a6-87a7-e28ba7288c4a-kube-api-access-tshhq\") pod \"maas-api-e2e-derive-16457c0e-75b5586765-cxjfr\" (UID: \"6bbd4b1c-6125-49a6-87a7-e28ba7288c4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-16457c0e-75b5586765-cxjfr"
Nov 02 08:17:49.233118 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:49.232981    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bbd4b1c-6125-49a6-87a7-e28ba7288c4a-metrics-certs\") pod \"maas-api-e2e-derive-16457c0e-75b5586765-cxjfr\" (UID: \"6bbd4b1c-6125-49a6-87a7-e28ba7288c4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-16457c0e-75b5586765-cxjfr"
Nov 02 08:17:49.233118 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:49.233068    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bbd4b1c-6125-49a6-87a7-e28ba7288c4a-maas-api-tls\") pod \"maas-api-e2e-derive-16457c0e-75b5586765-cxjfr\" (UID: \"6bbd4b1c-6125-49a6-87a7-e28ba7288c4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-16457c0e-75b5586765-cxjfr"
Nov 02 08:17:49.233118 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:49.233092    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bbd4b1c-6125-49a6-87a7-e28ba7288c4a-openshift-service-ca\") pod \"maas-api-e2e-derive-16457c0e-75b5586765-cxjfr\" (UID: \"6bbd4b1c-6125-49a6-87a7-e28ba7288c4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-16457c0e-75b5586765-cxjfr"
Nov 02 08:17:49.233312 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:17:49.233192    6210 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-16457c0e-serving-cert: secret "maas-api-e2e-derive-16457c0e-serving-cert" not found
Nov 02 08:17:49.233312 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:17:49.233278    6210 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bbd4b1c-6125-49a6-87a7-e28ba7288c4a-maas-api-tls podName:6bbd4b1c-6125-49a6-87a7-e28ba7288c4a nodeName:}" failed. No retries permitted until 2026-11-02 08:17:49.733256117 +0000 UTC m=+659.491684834 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6bbd4b1c-6125-49a6-87a7-e28ba7288c4a-maas-api-tls") pod "maas-api-e2e-derive-16457c0e-75b5586765-cxjfr" (UID: "6bbd4b1c-6125-49a6-87a7-e28ba7288c4a") : secret "maas-api-e2e-derive-16457c0e-serving-cert" not found
Nov 02 08:17:49.233787 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:49.233766    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bbd4b1c-6125-49a6-87a7-e28ba7288c4a-openshift-service-ca\") pod \"maas-api-e2e-derive-16457c0e-75b5586765-cxjfr\" (UID: \"6bbd4b1c-6125-49a6-87a7-e28ba7288c4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-16457c0e-75b5586765-cxjfr"
Nov 02 08:17:49.235340 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:49.235320    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bbd4b1c-6125-49a6-87a7-e28ba7288c4a-metrics-certs\") pod \"maas-api-e2e-derive-16457c0e-75b5586765-cxjfr\" (UID: \"6bbd4b1c-6125-49a6-87a7-e28ba7288c4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-16457c0e-75b5586765-cxjfr"
Nov 02 08:17:49.286357 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:49.286335    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tshhq\" (UniqueName: \"kubernetes.io/projected/6bbd4b1c-6125-49a6-87a7-e28ba7288c4a-kube-api-access-tshhq\") pod \"maas-api-e2e-derive-16457c0e-75b5586765-cxjfr\" (UID: \"6bbd4b1c-6125-49a6-87a7-e28ba7288c4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-16457c0e-75b5586765-cxjfr"
Nov 02 08:17:49.738711 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:49.738675    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bbd4b1c-6125-49a6-87a7-e28ba7288c4a-maas-api-tls\") pod \"maas-api-e2e-derive-16457c0e-75b5586765-cxjfr\" (UID: \"6bbd4b1c-6125-49a6-87a7-e28ba7288c4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-16457c0e-75b5586765-cxjfr"
Nov 02 08:17:49.741148 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:49.741126    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bbd4b1c-6125-49a6-87a7-e28ba7288c4a-maas-api-tls\") pod \"maas-api-e2e-derive-16457c0e-75b5586765-cxjfr\" (UID: \"6bbd4b1c-6125-49a6-87a7-e28ba7288c4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-16457c0e-75b5586765-cxjfr"
Nov 02 08:17:49.978256 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:49.978223    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-16457c0e-75b5586765-cxjfr"
Nov 02 08:17:50.338754 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:50.338577    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-16457c0e-75b5586765-cxjfr"]
Nov 02 08:17:50.341573 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:17:50.341544    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bbd4b1c_6125_49a6_87a7_e28ba7288c4a.slice/crio-8b3dc8519eda06b4e3f50adac96545d3c7c374b3280d005fda59b6ab28ec2340 WatchSource:0}: Error finding container 8b3dc8519eda06b4e3f50adac96545d3c7c374b3280d005fda59b6ab28ec2340: Status 404 returned error can't find the container with id 8b3dc8519eda06b4e3f50adac96545d3c7c374b3280d005fda59b6ab28ec2340
Nov 02 08:17:51.189311 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:51.189272    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-16457c0e-75b5586765-cxjfr" event={"ID":"6bbd4b1c-6125-49a6-87a7-e28ba7288c4a","Type":"ContainerStarted","Data":"8b3dc8519eda06b4e3f50adac96545d3c7c374b3280d005fda59b6ab28ec2340"}
Nov 02 08:17:52.130109 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:52.130076    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c"
Nov 02 08:17:52.195825 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:52.195767    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-16457c0e-75b5586765-cxjfr" event={"ID":"6bbd4b1c-6125-49a6-87a7-e28ba7288c4a","Type":"ContainerStarted","Data":"0d3695ab60fff7b6f6f7d59e3b847e58a51f8eccc73019c934fb1109afac5fc2"}
Nov 02 08:17:52.196454 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:52.196413    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-16457c0e-75b5586765-cxjfr"
Nov 02 08:17:52.346094 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:52.346040    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-16457c0e-75b5586765-cxjfr" podStartSLOduration=2.434456251 podStartE2EDuration="3.346025992s" totalImagesPullingTime="911.569741ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:17:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:17:52.345095115 +0000 UTC m=+662.103523864" watchObservedRunningTime="2026-11-02 08:17:52.346025992 +0000 UTC m=+662.104454770"
Nov 02 08:17:59.208535 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:17:59.208496    6210 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-derive-16457c0e-75b5586765-cxjfr" podUID="6bbd4b1c-6125-49a6-87a7-e28ba7288c4a" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.36:8443/health\": dial tcp 10.134.0.36:8443: connect: connection refused"
Nov 02 08:18:00.820491 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:18:00.820448    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:18:02.249522 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:02.249490    6210 generic.go:356] "Generic (PLEG): container finished" podID="6bbd4b1c-6125-49a6-87a7-e28ba7288c4a" containerID="0d3695ab60fff7b6f6f7d59e3b847e58a51f8eccc73019c934fb1109afac5fc2" exitCode=1
Nov 02 08:18:02.249949 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:02.249559    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-16457c0e-75b5586765-cxjfr" event={"ID":"6bbd4b1c-6125-49a6-87a7-e28ba7288c4a","Type":"ContainerDied","Data":"0d3695ab60fff7b6f6f7d59e3b847e58a51f8eccc73019c934fb1109afac5fc2"}
Nov 02 08:18:02.250005 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:02.249949    6210 scope.go:122] "RemoveContainer" containerID="0d3695ab60fff7b6f6f7d59e3b847e58a51f8eccc73019c934fb1109afac5fc2"
Nov 02 08:18:03.256980 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:03.256945    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-16457c0e-75b5586765-cxjfr" event={"ID":"6bbd4b1c-6125-49a6-87a7-e28ba7288c4a","Type":"ContainerStarted","Data":"e22e41fd6e386f999776c196100fd2319640d56151ceaa5fe2a13ff5c94ae093"}
Nov 02 08:18:03.257396 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:03.257179    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-16457c0e-75b5586765-cxjfr"
Nov 02 08:18:09.266922 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:09.266892    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-16457c0e-75b5586765-cxjfr"
Nov 02 08:18:30.821368 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:18:30.821324    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:18:35.375797 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:35.375761    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2b62c067-5758697c69-pfcq2"]
Nov 02 08:18:35.376267 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:35.375984    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b62c067-5758697c69-pfcq2" podUID="61e6f457-ba4d-4540-8b83-9e0a94f7f9a8" containerName="maas-api" containerID="cri-o://8672ba48959a3bc37cefa2b19d0bfe9c33566d74b87704f13efad277be444b00" gracePeriod=30
Nov 02 08:18:35.627838 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:35.627780    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b62c067-5758697c69-pfcq2"
Nov 02 08:18:35.768210 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:35.768170    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/61e6f457-ba4d-4540-8b83-9e0a94f7f9a8-kube-api-access-ztvd8\" (UniqueName: \"kubernetes.io/projected/61e6f457-ba4d-4540-8b83-9e0a94f7f9a8-kube-api-access-ztvd8\") pod \"61e6f457-ba4d-4540-8b83-9e0a94f7f9a8\" (UID: \"61e6f457-ba4d-4540-8b83-9e0a94f7f9a8\") "
Nov 02 08:18:35.768399 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:35.768215    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/61e6f457-ba4d-4540-8b83-9e0a94f7f9a8-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61e6f457-ba4d-4540-8b83-9e0a94f7f9a8-maas-api-tls\") pod \"61e6f457-ba4d-4540-8b83-9e0a94f7f9a8\" (UID: \"61e6f457-ba4d-4540-8b83-9e0a94f7f9a8\") "
Nov 02 08:18:35.768399 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:35.768342    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/61e6f457-ba4d-4540-8b83-9e0a94f7f9a8-metrics-certs\" (UniqueName: \"kubernetes.io/secret/61e6f457-ba4d-4540-8b83-9e0a94f7f9a8-metrics-certs\") pod \"61e6f457-ba4d-4540-8b83-9e0a94f7f9a8\" (UID: \"61e6f457-ba4d-4540-8b83-9e0a94f7f9a8\") "
Nov 02 08:18:35.768534 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:35.768403    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/61e6f457-ba4d-4540-8b83-9e0a94f7f9a8-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61e6f457-ba4d-4540-8b83-9e0a94f7f9a8-openshift-service-ca\") pod \"61e6f457-ba4d-4540-8b83-9e0a94f7f9a8\" (UID: \"61e6f457-ba4d-4540-8b83-9e0a94f7f9a8\") "
Nov 02 08:18:35.768939 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:35.768907    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61e6f457-ba4d-4540-8b83-9e0a94f7f9a8-openshift-service-ca" pod "61e6f457-ba4d-4540-8b83-9e0a94f7f9a8" (UID: "61e6f457-ba4d-4540-8b83-9e0a94f7f9a8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:18:35.770476 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:35.770449    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61e6f457-ba4d-4540-8b83-9e0a94f7f9a8-metrics-certs" pod "61e6f457-ba4d-4540-8b83-9e0a94f7f9a8" (UID: "61e6f457-ba4d-4540-8b83-9e0a94f7f9a8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:18:35.770605 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:35.770502    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61e6f457-ba4d-4540-8b83-9e0a94f7f9a8-maas-api-tls" pod "61e6f457-ba4d-4540-8b83-9e0a94f7f9a8" (UID: "61e6f457-ba4d-4540-8b83-9e0a94f7f9a8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:18:35.770684 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:35.770669    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61e6f457-ba4d-4540-8b83-9e0a94f7f9a8-kube-api-access-ztvd8" pod "61e6f457-ba4d-4540-8b83-9e0a94f7f9a8" (UID: "61e6f457-ba4d-4540-8b83-9e0a94f7f9a8"). InnerVolumeSpecName "kube-api-access-ztvd8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:18:35.873965 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:35.873844    6210 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61e6f457-ba4d-4540-8b83-9e0a94f7f9a8-metrics-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:18:35.873965 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:35.873906    6210 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61e6f457-ba4d-4540-8b83-9e0a94f7f9a8-openshift-service-ca\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:18:35.873965 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:35.873923    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztvd8\" (UniqueName: \"kubernetes.io/projected/61e6f457-ba4d-4540-8b83-9e0a94f7f9a8-kube-api-access-ztvd8\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:18:35.873965 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:35.873938    6210 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61e6f457-ba4d-4540-8b83-9e0a94f7f9a8-maas-api-tls\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:18:36.415988 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:36.415955    6210 generic.go:356] "Generic (PLEG): container finished" podID="61e6f457-ba4d-4540-8b83-9e0a94f7f9a8" containerID="8672ba48959a3bc37cefa2b19d0bfe9c33566d74b87704f13efad277be444b00" exitCode=0
Nov 02 08:18:36.416481 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:36.415998    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b62c067-5758697c69-pfcq2"
Nov 02 08:18:36.416481 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:36.416015    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b62c067-5758697c69-pfcq2" event={"ID":"61e6f457-ba4d-4540-8b83-9e0a94f7f9a8","Type":"ContainerDied","Data":"8672ba48959a3bc37cefa2b19d0bfe9c33566d74b87704f13efad277be444b00"}
Nov 02 08:18:36.416481 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:36.416056    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2b62c067-5758697c69-pfcq2" event={"ID":"61e6f457-ba4d-4540-8b83-9e0a94f7f9a8","Type":"ContainerDied","Data":"2e706962e5b30f2b46dedf49c0e2402d9478a69ce34fb1fccb2f0bc728fc24d0"}
Nov 02 08:18:36.416481 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:36.416076    6210 scope.go:122] "RemoveContainer" containerID="8672ba48959a3bc37cefa2b19d0bfe9c33566d74b87704f13efad277be444b00"
Nov 02 08:18:36.425397 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:36.425375    6210 scope.go:122] "RemoveContainer" containerID="8672ba48959a3bc37cefa2b19d0bfe9c33566d74b87704f13efad277be444b00"
Nov 02 08:18:36.425665 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:18:36.425644    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8672ba48959a3bc37cefa2b19d0bfe9c33566d74b87704f13efad277be444b00\": container with ID starting with 8672ba48959a3bc37cefa2b19d0bfe9c33566d74b87704f13efad277be444b00 not found: ID does not exist" containerID="8672ba48959a3bc37cefa2b19d0bfe9c33566d74b87704f13efad277be444b00"
Nov 02 08:18:36.425715 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:36.425674    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8672ba48959a3bc37cefa2b19d0bfe9c33566d74b87704f13efad277be444b00"} err="failed to get container status \"8672ba48959a3bc37cefa2b19d0bfe9c33566d74b87704f13efad277be444b00\": rpc error: code = NotFound desc = could not find container \"8672ba48959a3bc37cefa2b19d0bfe9c33566d74b87704f13efad277be444b00\": container with ID starting with 8672ba48959a3bc37cefa2b19d0bfe9c33566d74b87704f13efad277be444b00 not found: ID does not exist"
Nov 02 08:18:36.575744 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:36.575712    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-53cc8e62-68db469795-lffvz"]
Nov 02 08:18:36.575954 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:36.575934    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-53cc8e62-68db469795-lffvz" podUID="4d235018-51e9-4fde-b8c7-eb12447b9c64" containerName="maas-api" containerID="cri-o://7aed43069154e0919b42045d018da643f8cebe33e9e51c7da50feb10632d74b5" gracePeriod=30
Nov 02 08:18:36.599701 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:36.599672    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2b62c067-5758697c69-pfcq2"]
Nov 02 08:18:36.604749 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:36.604723    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2b62c067-5758697c69-pfcq2"]
Nov 02 08:18:36.834667 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:36.834646    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-53cc8e62-68db469795-lffvz"
Nov 02 08:18:36.989315 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:36.989280    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4d235018-51e9-4fde-b8c7-eb12447b9c64-kube-api-access-jzh5d\" (UniqueName: \"kubernetes.io/projected/4d235018-51e9-4fde-b8c7-eb12447b9c64-kube-api-access-jzh5d\") pod \"4d235018-51e9-4fde-b8c7-eb12447b9c64\" (UID: \"4d235018-51e9-4fde-b8c7-eb12447b9c64\") "
Nov 02 08:18:36.989520 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:36.989322    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4d235018-51e9-4fde-b8c7-eb12447b9c64-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d235018-51e9-4fde-b8c7-eb12447b9c64-maas-api-tls\") pod \"4d235018-51e9-4fde-b8c7-eb12447b9c64\" (UID: \"4d235018-51e9-4fde-b8c7-eb12447b9c64\") "
Nov 02 08:18:36.989520 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:36.989341    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4d235018-51e9-4fde-b8c7-eb12447b9c64-metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d235018-51e9-4fde-b8c7-eb12447b9c64-metrics-certs\") pod \"4d235018-51e9-4fde-b8c7-eb12447b9c64\" (UID: \"4d235018-51e9-4fde-b8c7-eb12447b9c64\") "
Nov 02 08:18:36.989520 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:36.989420    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4d235018-51e9-4fde-b8c7-eb12447b9c64-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d235018-51e9-4fde-b8c7-eb12447b9c64-openshift-service-ca\") pod \"4d235018-51e9-4fde-b8c7-eb12447b9c64\" (UID: \"4d235018-51e9-4fde-b8c7-eb12447b9c64\") "
Nov 02 08:18:36.989980 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:36.989954    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d235018-51e9-4fde-b8c7-eb12447b9c64-openshift-service-ca" pod "4d235018-51e9-4fde-b8c7-eb12447b9c64" (UID: "4d235018-51e9-4fde-b8c7-eb12447b9c64"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:18:36.991471 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:36.991446    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d235018-51e9-4fde-b8c7-eb12447b9c64-kube-api-access-jzh5d" pod "4d235018-51e9-4fde-b8c7-eb12447b9c64" (UID: "4d235018-51e9-4fde-b8c7-eb12447b9c64"). InnerVolumeSpecName "kube-api-access-jzh5d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:18:36.991912 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:36.991868    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d235018-51e9-4fde-b8c7-eb12447b9c64-metrics-certs" pod "4d235018-51e9-4fde-b8c7-eb12447b9c64" (UID: "4d235018-51e9-4fde-b8c7-eb12447b9c64"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:18:36.991912 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:36.991906    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d235018-51e9-4fde-b8c7-eb12447b9c64-maas-api-tls" pod "4d235018-51e9-4fde-b8c7-eb12447b9c64" (UID: "4d235018-51e9-4fde-b8c7-eb12447b9c64"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:18:37.090766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:37.090732    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzh5d\" (UniqueName: \"kubernetes.io/projected/4d235018-51e9-4fde-b8c7-eb12447b9c64-kube-api-access-jzh5d\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:18:37.090766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:37.090764    6210 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d235018-51e9-4fde-b8c7-eb12447b9c64-maas-api-tls\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:18:37.090766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:37.090776    6210 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d235018-51e9-4fde-b8c7-eb12447b9c64-metrics-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:18:37.091017 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:37.090787    6210 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d235018-51e9-4fde-b8c7-eb12447b9c64-openshift-service-ca\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:18:37.421982 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:37.421898    6210 generic.go:356] "Generic (PLEG): container finished" podID="4d235018-51e9-4fde-b8c7-eb12447b9c64" containerID="7aed43069154e0919b42045d018da643f8cebe33e9e51c7da50feb10632d74b5" exitCode=0
Nov 02 08:18:37.421982 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:37.421935    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-53cc8e62-68db469795-lffvz" event={"ID":"4d235018-51e9-4fde-b8c7-eb12447b9c64","Type":"ContainerDied","Data":"7aed43069154e0919b42045d018da643f8cebe33e9e51c7da50feb10632d74b5"}
Nov 02 08:18:37.422506 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:37.422005    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-53cc8e62-68db469795-lffvz" event={"ID":"4d235018-51e9-4fde-b8c7-eb12447b9c64","Type":"ContainerDied","Data":"32b9493640f44c0087976ce91e8eff4b74dfc11cdea75e468ca117616870b76d"}
Nov 02 08:18:37.422506 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:37.421954    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-53cc8e62-68db469795-lffvz"
Nov 02 08:18:37.422506 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:37.422035    6210 scope.go:122] "RemoveContainer" containerID="7aed43069154e0919b42045d018da643f8cebe33e9e51c7da50feb10632d74b5"
Nov 02 08:18:37.431471 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:37.431444    6210 scope.go:122] "RemoveContainer" containerID="7aed43069154e0919b42045d018da643f8cebe33e9e51c7da50feb10632d74b5"
Nov 02 08:18:37.431724 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:18:37.431704    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7aed43069154e0919b42045d018da643f8cebe33e9e51c7da50feb10632d74b5\": container with ID starting with 7aed43069154e0919b42045d018da643f8cebe33e9e51c7da50feb10632d74b5 not found: ID does not exist" containerID="7aed43069154e0919b42045d018da643f8cebe33e9e51c7da50feb10632d74b5"
Nov 02 08:18:37.431778 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:37.431733    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7aed43069154e0919b42045d018da643f8cebe33e9e51c7da50feb10632d74b5"} err="failed to get container status \"7aed43069154e0919b42045d018da643f8cebe33e9e51c7da50feb10632d74b5\": rpc error: code = NotFound desc = could not find container \"7aed43069154e0919b42045d018da643f8cebe33e9e51c7da50feb10632d74b5\": container with ID starting with 7aed43069154e0919b42045d018da643f8cebe33e9e51c7da50feb10632d74b5 not found: ID does not exist"
Nov 02 08:18:37.574118 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:37.574083    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-53cc8e62-68db469795-lffvz"]
Nov 02 08:18:37.579793 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:37.579767    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-53cc8e62-68db469795-lffvz"]
Nov 02 08:18:38.350630 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:38.350598    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4d235018-51e9-4fde-b8c7-eb12447b9c64" path="/var/lib/kubelet/pods/4d235018-51e9-4fde-b8c7-eb12447b9c64/volumes"
Nov 02 08:18:38.351021 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:38.351007    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="61e6f457-ba4d-4540-8b83-9e0a94f7f9a8" path="/var/lib/kubelet/pods/61e6f457-ba4d-4540-8b83-9e0a94f7f9a8/volumes"
Nov 02 08:18:39.398012 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.397981    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"]
Nov 02 08:18:39.398496 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.398370    6210 cpu_manager.go:414] "containerMap: removing container" podUID="61e6f457-ba4d-4540-8b83-9e0a94f7f9a8" containerName="maas-api"
Nov 02 08:18:39.398496 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.398381    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="61e6f457-ba4d-4540-8b83-9e0a94f7f9a8" containerName="maas-api"
Nov 02 08:18:39.398496 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.398396    6210 cpu_manager.go:414] "containerMap: removing container" podUID="4d235018-51e9-4fde-b8c7-eb12447b9c64" containerName="maas-api"
Nov 02 08:18:39.398496 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.398401    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4d235018-51e9-4fde-b8c7-eb12447b9c64" containerName="maas-api"
Nov 02 08:18:39.398496 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.398468    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="4d235018-51e9-4fde-b8c7-eb12447b9c64" containerName="maas-api"
Nov 02 08:18:39.398496 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.398483    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="61e6f457-ba4d-4540-8b83-9e0a94f7f9a8" containerName="maas-api"
Nov 02 08:18:39.402650 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.402615    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:18:39.452901 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.452043    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-9d77b6-openshift-default-dockercfg-r279j\""
Nov 02 08:18:39.466279 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.465340    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"]
Nov 02 08:18:39.513816 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.513773    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75541fe0-a299-4697-a692-0a0c72d810f1-istiod-ca-cert\") pod \"e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6\" (UID: \"75541fe0-a299-4697-a692-0a0c72d810f1\") " pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:18:39.514019 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.513972    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75541fe0-a299-4697-a692-0a0c72d810f1-istio-data\") pod \"e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6\" (UID: \"75541fe0-a299-4697-a692-0a0c72d810f1\") " pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:18:39.514083 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.514045    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75541fe0-a299-4697-a692-0a0c72d810f1-credential-socket\") pod \"e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6\" (UID: \"75541fe0-a299-4697-a692-0a0c72d810f1\") " pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:18:39.514161 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.514135    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75541fe0-a299-4697-a692-0a0c72d810f1-istio-podinfo\") pod \"e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6\" (UID: \"75541fe0-a299-4697-a692-0a0c72d810f1\") " pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:18:39.514220 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.514196    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75541fe0-a299-4697-a692-0a0c72d810f1-istio-token\") pod \"e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6\" (UID: \"75541fe0-a299-4697-a692-0a0c72d810f1\") " pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:18:39.514277 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.514262    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r6j8\" (UniqueName: \"kubernetes.io/projected/75541fe0-a299-4697-a692-0a0c72d810f1-kube-api-access-7r6j8\") pod \"e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6\" (UID: \"75541fe0-a299-4697-a692-0a0c72d810f1\") " pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:18:39.514318 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.514289    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75541fe0-a299-4697-a692-0a0c72d810f1-workload-socket\") pod \"e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6\" (UID: \"75541fe0-a299-4697-a692-0a0c72d810f1\") " pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:18:39.514318 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.514309    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75541fe0-a299-4697-a692-0a0c72d810f1-workload-certs\") pod \"e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6\" (UID: \"75541fe0-a299-4697-a692-0a0c72d810f1\") " pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:18:39.514407 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.514328    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75541fe0-a299-4697-a692-0a0c72d810f1-istio-envoy\") pod \"e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6\" (UID: \"75541fe0-a299-4697-a692-0a0c72d810f1\") " pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:18:39.615239 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.615206    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75541fe0-a299-4697-a692-0a0c72d810f1-istio-token\") pod \"e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6\" (UID: \"75541fe0-a299-4697-a692-0a0c72d810f1\") " pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:18:39.615445 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.615248    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7r6j8\" (UniqueName: \"kubernetes.io/projected/75541fe0-a299-4697-a692-0a0c72d810f1-kube-api-access-7r6j8\") pod \"e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6\" (UID: \"75541fe0-a299-4697-a692-0a0c72d810f1\") " pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:18:39.615445 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.615273    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75541fe0-a299-4697-a692-0a0c72d810f1-workload-socket\") pod \"e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6\" (UID: \"75541fe0-a299-4697-a692-0a0c72d810f1\") " pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:18:39.615445 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.615294    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75541fe0-a299-4697-a692-0a0c72d810f1-workload-certs\") pod \"e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6\" (UID: \"75541fe0-a299-4697-a692-0a0c72d810f1\") " pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:18:39.615445 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.615316    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75541fe0-a299-4697-a692-0a0c72d810f1-istio-envoy\") pod \"e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6\" (UID: \"75541fe0-a299-4697-a692-0a0c72d810f1\") " pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:18:39.615445 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.615352    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75541fe0-a299-4697-a692-0a0c72d810f1-istiod-ca-cert\") pod \"e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6\" (UID: \"75541fe0-a299-4697-a692-0a0c72d810f1\") " pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:18:39.615445 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.615431    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75541fe0-a299-4697-a692-0a0c72d810f1-istio-data\") pod \"e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6\" (UID: \"75541fe0-a299-4697-a692-0a0c72d810f1\") " pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:18:39.615768 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.615489    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75541fe0-a299-4697-a692-0a0c72d810f1-credential-socket\") pod \"e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6\" (UID: \"75541fe0-a299-4697-a692-0a0c72d810f1\") " pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:18:39.615768 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.615538    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75541fe0-a299-4697-a692-0a0c72d810f1-istio-podinfo\") pod \"e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6\" (UID: \"75541fe0-a299-4697-a692-0a0c72d810f1\") " pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:18:39.615768 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.615700    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75541fe0-a299-4697-a692-0a0c72d810f1-workload-socket\") pod \"e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6\" (UID: \"75541fe0-a299-4697-a692-0a0c72d810f1\") " pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:18:39.615904 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.615862    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75541fe0-a299-4697-a692-0a0c72d810f1-istio-data\") pod \"e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6\" (UID: \"75541fe0-a299-4697-a692-0a0c72d810f1\") " pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:18:39.615952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.615897    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75541fe0-a299-4697-a692-0a0c72d810f1-credential-socket\") pod \"e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6\" (UID: \"75541fe0-a299-4697-a692-0a0c72d810f1\") " pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:18:39.616038 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.616016    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75541fe0-a299-4697-a692-0a0c72d810f1-workload-certs\") pod \"e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6\" (UID: \"75541fe0-a299-4697-a692-0a0c72d810f1\") " pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:18:39.616306 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.616281    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75541fe0-a299-4697-a692-0a0c72d810f1-istiod-ca-cert\") pod \"e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6\" (UID: \"75541fe0-a299-4697-a692-0a0c72d810f1\") " pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:18:39.617748 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.617721    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75541fe0-a299-4697-a692-0a0c72d810f1-istio-envoy\") pod \"e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6\" (UID: \"75541fe0-a299-4697-a692-0a0c72d810f1\") " pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:18:39.618205 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.618188    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75541fe0-a299-4697-a692-0a0c72d810f1-istio-podinfo\") pod \"e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6\" (UID: \"75541fe0-a299-4697-a692-0a0c72d810f1\") " pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:18:39.674867 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.674788    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75541fe0-a299-4697-a692-0a0c72d810f1-istio-token\") pod \"e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6\" (UID: \"75541fe0-a299-4697-a692-0a0c72d810f1\") " pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:18:39.675820 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.675799    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r6j8\" (UniqueName: \"kubernetes.io/projected/75541fe0-a299-4697-a692-0a0c72d810f1-kube-api-access-7r6j8\") pod \"e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6\" (UID: \"75541fe0-a299-4697-a692-0a0c72d810f1\") " pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:18:39.727370 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:39.727333    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:18:40.151140 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:40.151113    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"]
Nov 02 08:18:40.153933 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:18:40.153897    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75541fe0_a299_4697_a692_0a0c72d810f1.slice/crio-b5dc769a93fc831b666c5de07a6de00a351ee0e06b40d052d379bc97f9d0eaaf WatchSource:0}: Error finding container b5dc769a93fc831b666c5de07a6de00a351ee0e06b40d052d379bc97f9d0eaaf: Status 404 returned error can't find the container with id b5dc769a93fc831b666c5de07a6de00a351ee0e06b40d052d379bc97f9d0eaaf
Nov 02 08:18:40.155987 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:40.155952    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:18:40.156056 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:40.156020    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:18:40.156088 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:40.156052    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:18:40.451285 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:40.451201    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6" event={"ID":"75541fe0-a299-4697-a692-0a0c72d810f1","Type":"ContainerStarted","Data":"42b8f7925c270402444f1257285b8246975eec3bf74dc3608a4d789ec8352f25"}
Nov 02 08:18:40.451285 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:40.451258    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6" event={"ID":"75541fe0-a299-4697-a692-0a0c72d810f1","Type":"ContainerStarted","Data":"b5dc769a93fc831b666c5de07a6de00a351ee0e06b40d052d379bc97f9d0eaaf"}
Nov 02 08:18:40.573112 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:40.573044    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6" podStartSLOduration=1.573029609 podStartE2EDuration="1.573029609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:18:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:18:40.571269076 +0000 UTC m=+710.329697807" watchObservedRunningTime="2026-11-02 08:18:40.573029609 +0000 UTC m=+710.331458340"
Nov 02 08:18:40.727809 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:40.727773    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:18:41.733313 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:41.733281    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:18:42.460582 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:42.460548    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:18:42.461519 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:42.461501    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:18:54.866285 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:54.866247    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264"]
Nov 02 08:18:54.871345 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:54.871317    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264"
Nov 02 08:18:54.912557 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:54.912527    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-16457c0e-75b5586765-cxjfr"]
Nov 02 08:18:54.912780 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:54.912743    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-16457c0e-75b5586765-cxjfr" podUID="6bbd4b1c-6125-49a6-87a7-e28ba7288c4a" containerName="maas-api" containerID="cri-o://e22e41fd6e386f999776c196100fd2319640d56151ceaa5fe2a13ff5c94ae093" gracePeriod=30
Nov 02 08:18:54.933629 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:54.933579    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264"]
Nov 02 08:18:54.957604 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:54.957568    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-d0628e\"/\"premium-w1-d0628e-kserve-self-signed-certs\""
Nov 02 08:18:54.957751 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:54.957676    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-d0628e\"/\"default-dockercfg-g4f7x\""
Nov 02 08:18:54.957751 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:54.957701    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-d0628e\"/\"openshift-service-ca.crt\""
Nov 02 08:18:54.962992 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:54.962969    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-d0628e\"/\"kube-root-ca.crt\""
Nov 02 08:18:54.967558 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:54.967532    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5daab9ec-0229-47b7-81aa-c98cc178523b-dshm\") pod \"premium-w1-d0628e-kserve-6cc9594468-2z264\" (UID: \"5daab9ec-0229-47b7-81aa-c98cc178523b\") " pod="e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264"
Nov 02 08:18:54.967716 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:54.967569    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5daab9ec-0229-47b7-81aa-c98cc178523b-tls-certs\") pod \"premium-w1-d0628e-kserve-6cc9594468-2z264\" (UID: \"5daab9ec-0229-47b7-81aa-c98cc178523b\") " pod="e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264"
Nov 02 08:18:54.967817 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:54.967769    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5daab9ec-0229-47b7-81aa-c98cc178523b-home\") pod \"premium-w1-d0628e-kserve-6cc9594468-2z264\" (UID: \"5daab9ec-0229-47b7-81aa-c98cc178523b\") " pod="e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264"
Nov 02 08:18:54.967894 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:54.967820    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5daab9ec-0229-47b7-81aa-c98cc178523b-tmp-dir\") pod \"premium-w1-d0628e-kserve-6cc9594468-2z264\" (UID: \"5daab9ec-0229-47b7-81aa-c98cc178523b\") " pod="e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264"
Nov 02 08:18:54.967894 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:54.967848    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht97z\" (UniqueName: \"kubernetes.io/projected/5daab9ec-0229-47b7-81aa-c98cc178523b-kube-api-access-ht97z\") pod \"premium-w1-d0628e-kserve-6cc9594468-2z264\" (UID: \"5daab9ec-0229-47b7-81aa-c98cc178523b\") " pod="e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264"
Nov 02 08:18:54.967999 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:54.967973    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5daab9ec-0229-47b7-81aa-c98cc178523b-model-cache\") pod \"premium-w1-d0628e-kserve-6cc9594468-2z264\" (UID: \"5daab9ec-0229-47b7-81aa-c98cc178523b\") " pod="e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264"
Nov 02 08:18:55.068663 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.068625    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5daab9ec-0229-47b7-81aa-c98cc178523b-dshm\") pod \"premium-w1-d0628e-kserve-6cc9594468-2z264\" (UID: \"5daab9ec-0229-47b7-81aa-c98cc178523b\") " pod="e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264"
Nov 02 08:18:55.068830 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.068680    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5daab9ec-0229-47b7-81aa-c98cc178523b-tls-certs\") pod \"premium-w1-d0628e-kserve-6cc9594468-2z264\" (UID: \"5daab9ec-0229-47b7-81aa-c98cc178523b\") " pod="e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264"
Nov 02 08:18:55.068830 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.068751    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5daab9ec-0229-47b7-81aa-c98cc178523b-home\") pod \"premium-w1-d0628e-kserve-6cc9594468-2z264\" (UID: \"5daab9ec-0229-47b7-81aa-c98cc178523b\") " pod="e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264"
Nov 02 08:18:55.069181 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.069148    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5daab9ec-0229-47b7-81aa-c98cc178523b-tmp-dir\") pod \"premium-w1-d0628e-kserve-6cc9594468-2z264\" (UID: \"5daab9ec-0229-47b7-81aa-c98cc178523b\") " pod="e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264"
Nov 02 08:18:55.069318 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.069194    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5daab9ec-0229-47b7-81aa-c98cc178523b-home\") pod \"premium-w1-d0628e-kserve-6cc9594468-2z264\" (UID: \"5daab9ec-0229-47b7-81aa-c98cc178523b\") " pod="e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264"
Nov 02 08:18:55.069318 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.069199    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht97z\" (UniqueName: \"kubernetes.io/projected/5daab9ec-0229-47b7-81aa-c98cc178523b-kube-api-access-ht97z\") pod \"premium-w1-d0628e-kserve-6cc9594468-2z264\" (UID: \"5daab9ec-0229-47b7-81aa-c98cc178523b\") " pod="e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264"
Nov 02 08:18:55.069433 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.069319    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5daab9ec-0229-47b7-81aa-c98cc178523b-model-cache\") pod \"premium-w1-d0628e-kserve-6cc9594468-2z264\" (UID: \"5daab9ec-0229-47b7-81aa-c98cc178523b\") " pod="e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264"
Nov 02 08:18:55.069587 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.069565    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5daab9ec-0229-47b7-81aa-c98cc178523b-tmp-dir\") pod \"premium-w1-d0628e-kserve-6cc9594468-2z264\" (UID: \"5daab9ec-0229-47b7-81aa-c98cc178523b\") " pod="e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264"
Nov 02 08:18:55.069663 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.069629    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5daab9ec-0229-47b7-81aa-c98cc178523b-model-cache\") pod \"premium-w1-d0628e-kserve-6cc9594468-2z264\" (UID: \"5daab9ec-0229-47b7-81aa-c98cc178523b\") " pod="e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264"
Nov 02 08:18:55.071031 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.070985    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5daab9ec-0229-47b7-81aa-c98cc178523b-dshm\") pod \"premium-w1-d0628e-kserve-6cc9594468-2z264\" (UID: \"5daab9ec-0229-47b7-81aa-c98cc178523b\") " pod="e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264"
Nov 02 08:18:55.072440 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.072416    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5daab9ec-0229-47b7-81aa-c98cc178523b-tls-certs\") pod \"premium-w1-d0628e-kserve-6cc9594468-2z264\" (UID: \"5daab9ec-0229-47b7-81aa-c98cc178523b\") " pod="e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264"
Nov 02 08:18:55.122646 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.122577    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht97z\" (UniqueName: \"kubernetes.io/projected/5daab9ec-0229-47b7-81aa-c98cc178523b-kube-api-access-ht97z\") pod \"premium-w1-d0628e-kserve-6cc9594468-2z264\" (UID: \"5daab9ec-0229-47b7-81aa-c98cc178523b\") " pod="e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264"
Nov 02 08:18:55.171049 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.171017    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-16457c0e-75b5586765-cxjfr"
Nov 02 08:18:55.195115 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.195080    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264"
Nov 02 08:18:55.271082 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.271044    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6bbd4b1c-6125-49a6-87a7-e28ba7288c4a-metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bbd4b1c-6125-49a6-87a7-e28ba7288c4a-metrics-certs\") pod \"6bbd4b1c-6125-49a6-87a7-e28ba7288c4a\" (UID: \"6bbd4b1c-6125-49a6-87a7-e28ba7288c4a\") "
Nov 02 08:18:55.271203 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.271122    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6bbd4b1c-6125-49a6-87a7-e28ba7288c4a-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bbd4b1c-6125-49a6-87a7-e28ba7288c4a-maas-api-tls\") pod \"6bbd4b1c-6125-49a6-87a7-e28ba7288c4a\" (UID: \"6bbd4b1c-6125-49a6-87a7-e28ba7288c4a\") "
Nov 02 08:18:55.271273 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.271259    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6bbd4b1c-6125-49a6-87a7-e28ba7288c4a-kube-api-access-tshhq\" (UniqueName: \"kubernetes.io/projected/6bbd4b1c-6125-49a6-87a7-e28ba7288c4a-kube-api-access-tshhq\") pod \"6bbd4b1c-6125-49a6-87a7-e28ba7288c4a\" (UID: \"6bbd4b1c-6125-49a6-87a7-e28ba7288c4a\") "
Nov 02 08:18:55.271318 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.271304    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6bbd4b1c-6125-49a6-87a7-e28ba7288c4a-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bbd4b1c-6125-49a6-87a7-e28ba7288c4a-openshift-service-ca\") pod \"6bbd4b1c-6125-49a6-87a7-e28ba7288c4a\" (UID: \"6bbd4b1c-6125-49a6-87a7-e28ba7288c4a\") "
Nov 02 08:18:55.272211 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.272182    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bbd4b1c-6125-49a6-87a7-e28ba7288c4a-openshift-service-ca" pod "6bbd4b1c-6125-49a6-87a7-e28ba7288c4a" (UID: "6bbd4b1c-6125-49a6-87a7-e28ba7288c4a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:18:55.300728 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.297051    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bbd4b1c-6125-49a6-87a7-e28ba7288c4a-metrics-certs" pod "6bbd4b1c-6125-49a6-87a7-e28ba7288c4a" (UID: "6bbd4b1c-6125-49a6-87a7-e28ba7288c4a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:18:55.300728 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.297173    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bbd4b1c-6125-49a6-87a7-e28ba7288c4a-maas-api-tls" pod "6bbd4b1c-6125-49a6-87a7-e28ba7288c4a" (UID: "6bbd4b1c-6125-49a6-87a7-e28ba7288c4a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:18:55.301010 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.300822    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bbd4b1c-6125-49a6-87a7-e28ba7288c4a-kube-api-access-tshhq" pod "6bbd4b1c-6125-49a6-87a7-e28ba7288c4a" (UID: "6bbd4b1c-6125-49a6-87a7-e28ba7288c4a"). InnerVolumeSpecName "kube-api-access-tshhq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:18:55.372454 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.372414    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tshhq\" (UniqueName: \"kubernetes.io/projected/6bbd4b1c-6125-49a6-87a7-e28ba7288c4a-kube-api-access-tshhq\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:18:55.372454 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.372453    6210 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bbd4b1c-6125-49a6-87a7-e28ba7288c4a-openshift-service-ca\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:18:55.372679 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.372470    6210 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bbd4b1c-6125-49a6-87a7-e28ba7288c4a-metrics-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:18:55.372679 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.372484    6210 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bbd4b1c-6125-49a6-87a7-e28ba7288c4a-maas-api-tls\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:18:55.526454 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.526415    6210 generic.go:356] "Generic (PLEG): container finished" podID="6bbd4b1c-6125-49a6-87a7-e28ba7288c4a" containerID="e22e41fd6e386f999776c196100fd2319640d56151ceaa5fe2a13ff5c94ae093" exitCode=0
Nov 02 08:18:55.526645 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.526473    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-16457c0e-75b5586765-cxjfr"
Nov 02 08:18:55.526645 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.526509    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-16457c0e-75b5586765-cxjfr" event={"ID":"6bbd4b1c-6125-49a6-87a7-e28ba7288c4a","Type":"ContainerDied","Data":"e22e41fd6e386f999776c196100fd2319640d56151ceaa5fe2a13ff5c94ae093"}
Nov 02 08:18:55.526645 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.526577    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-16457c0e-75b5586765-cxjfr" event={"ID":"6bbd4b1c-6125-49a6-87a7-e28ba7288c4a","Type":"ContainerDied","Data":"8b3dc8519eda06b4e3f50adac96545d3c7c374b3280d005fda59b6ab28ec2340"}
Nov 02 08:18:55.526645 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.526606    6210 scope.go:122] "RemoveContainer" containerID="e22e41fd6e386f999776c196100fd2319640d56151ceaa5fe2a13ff5c94ae093"
Nov 02 08:18:55.535991 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.535974    6210 scope.go:122] "RemoveContainer" containerID="0d3695ab60fff7b6f6f7d59e3b847e58a51f8eccc73019c934fb1109afac5fc2"
Nov 02 08:18:55.543734 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.543714    6210 scope.go:122] "RemoveContainer" containerID="e22e41fd6e386f999776c196100fd2319640d56151ceaa5fe2a13ff5c94ae093"
Nov 02 08:18:55.544011 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:18:55.543993    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e22e41fd6e386f999776c196100fd2319640d56151ceaa5fe2a13ff5c94ae093\": container with ID starting with e22e41fd6e386f999776c196100fd2319640d56151ceaa5fe2a13ff5c94ae093 not found: ID does not exist" containerID="e22e41fd6e386f999776c196100fd2319640d56151ceaa5fe2a13ff5c94ae093"
Nov 02 08:18:55.544063 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.544021    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e22e41fd6e386f999776c196100fd2319640d56151ceaa5fe2a13ff5c94ae093"} err="failed to get container status \"e22e41fd6e386f999776c196100fd2319640d56151ceaa5fe2a13ff5c94ae093\": rpc error: code = NotFound desc = could not find container \"e22e41fd6e386f999776c196100fd2319640d56151ceaa5fe2a13ff5c94ae093\": container with ID starting with e22e41fd6e386f999776c196100fd2319640d56151ceaa5fe2a13ff5c94ae093 not found: ID does not exist"
Nov 02 08:18:55.544063 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.544039    6210 scope.go:122] "RemoveContainer" containerID="0d3695ab60fff7b6f6f7d59e3b847e58a51f8eccc73019c934fb1109afac5fc2"
Nov 02 08:18:55.544267 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:18:55.544252    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d3695ab60fff7b6f6f7d59e3b847e58a51f8eccc73019c934fb1109afac5fc2\": container with ID starting with 0d3695ab60fff7b6f6f7d59e3b847e58a51f8eccc73019c934fb1109afac5fc2 not found: ID does not exist" containerID="0d3695ab60fff7b6f6f7d59e3b847e58a51f8eccc73019c934fb1109afac5fc2"
Nov 02 08:18:55.544313 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.544270    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d3695ab60fff7b6f6f7d59e3b847e58a51f8eccc73019c934fb1109afac5fc2"} err="failed to get container status \"0d3695ab60fff7b6f6f7d59e3b847e58a51f8eccc73019c934fb1109afac5fc2\": rpc error: code = NotFound desc = could not find container \"0d3695ab60fff7b6f6f7d59e3b847e58a51f8eccc73019c934fb1109afac5fc2\": container with ID starting with 0d3695ab60fff7b6f6f7d59e3b847e58a51f8eccc73019c934fb1109afac5fc2 not found: ID does not exist"
Nov 02 08:18:55.564437 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.564400    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264"]
Nov 02 08:18:55.567230 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:18:55.567204    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5daab9ec_0229_47b7_81aa_c98cc178523b.slice/crio-f3682afd361b3de93abcbc20ad85a08e2de151fefada621038fe6cf6155456b2 WatchSource:0}: Error finding container f3682afd361b3de93abcbc20ad85a08e2de151fefada621038fe6cf6155456b2: Status 404 returned error can't find the container with id f3682afd361b3de93abcbc20ad85a08e2de151fefada621038fe6cf6155456b2
Nov 02 08:18:55.681661 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.681577    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-16457c0e-75b5586765-cxjfr"]
Nov 02 08:18:55.687343 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:55.687315    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-16457c0e-75b5586765-cxjfr"]
Nov 02 08:18:56.352989 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:56.352954    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6bbd4b1c-6125-49a6-87a7-e28ba7288c4a" path="/var/lib/kubelet/pods/6bbd4b1c-6125-49a6-87a7-e28ba7288c4a/volumes"
Nov 02 08:18:56.539601 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:56.539525    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264" event={"ID":"5daab9ec-0229-47b7-81aa-c98cc178523b","Type":"ContainerStarted","Data":"f3682afd361b3de93abcbc20ad85a08e2de151fefada621038fe6cf6155456b2"}
Nov 02 08:18:57.547606 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:57.547573    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264" event={"ID":"5daab9ec-0229-47b7-81aa-c98cc178523b","Type":"ContainerStarted","Data":"5c4b17e888edd473d46384dcc2177d125986aa55d7cb170920306c8d5f6eb928"}
Nov 02 08:18:57.655989 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:57.655944    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264" podStartSLOduration=2.110289952 podStartE2EDuration="3.655930965s" totalImagesPullingTime="1.545641013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:18:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:18:57.654797947 +0000 UTC m=+727.413226679" watchObservedRunningTime="2026-11-02 08:18:57.655930965 +0000 UTC m=+727.414359697"
Nov 02 08:18:58.195768 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:18:58.195731    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264"
Nov 02 08:19:00.821331 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:19:00.821288    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:19:05.196037 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:05.195996    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264"
Nov 02 08:19:05.208732 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:05.208705    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264"
Nov 02 08:19:05.594766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:05.594731    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264"
Nov 02 08:19:14.119145 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:14.119110    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b"]
Nov 02 08:19:14.119631 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:14.119498    6210 cpu_manager.go:414] "containerMap: removing container" podUID="6bbd4b1c-6125-49a6-87a7-e28ba7288c4a" containerName="maas-api"
Nov 02 08:19:14.119631 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:14.119509    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6bbd4b1c-6125-49a6-87a7-e28ba7288c4a" containerName="maas-api"
Nov 02 08:19:14.119631 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:14.119522    6210 cpu_manager.go:414] "containerMap: removing container" podUID="6bbd4b1c-6125-49a6-87a7-e28ba7288c4a" containerName="maas-api"
Nov 02 08:19:14.119631 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:14.119529    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6bbd4b1c-6125-49a6-87a7-e28ba7288c4a" containerName="maas-api"
Nov 02 08:19:14.119631 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:14.119615    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="6bbd4b1c-6125-49a6-87a7-e28ba7288c4a" containerName="maas-api"
Nov 02 08:19:14.119631 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:14.119624    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="6bbd4b1c-6125-49a6-87a7-e28ba7288c4a" containerName="maas-api"
Nov 02 08:19:14.122807 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:14.122787    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b"
Nov 02 08:19:14.218063 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:14.218025    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-e6ca80\"/\"kube-root-ca.crt\""
Nov 02 08:19:14.218063 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:14.218041    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-e6ca80\"/\"default-dockercfg-57rx9\""
Nov 02 08:19:14.218063 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:14.218025    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-e6ca80\"/\"openshift-service-ca.crt\""
Nov 02 08:19:14.218384 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:14.218099    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-e6ca80\"/\"simulator-w0-e6ca80-kserve-self-signed-certs\""
Nov 02 08:19:14.219592 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:14.219570    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b"]
Nov 02 08:19:14.249046 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:14.249004    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-tls-certs\") pod \"simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b\" (UID: \"6c761c52-0af5-4c7a-95d5-f47c14f00aa2\") " pod="e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b"
Nov 02 08:19:14.249225 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:14.249107    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-dshm\") pod \"simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b\" (UID: \"6c761c52-0af5-4c7a-95d5-f47c14f00aa2\") " pod="e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b"
Nov 02 08:19:14.249225 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:14.249168    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-home\") pod \"simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b\" (UID: \"6c761c52-0af5-4c7a-95d5-f47c14f00aa2\") " pod="e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b"
Nov 02 08:19:14.249359 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:14.249257    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-tmp-dir\") pod \"simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b\" (UID: \"6c761c52-0af5-4c7a-95d5-f47c14f00aa2\") " pod="e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b"
Nov 02 08:19:14.249359 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:14.249323    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-model-cache\") pod \"simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b\" (UID: \"6c761c52-0af5-4c7a-95d5-f47c14f00aa2\") " pod="e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b"
Nov 02 08:19:14.249359 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:14.249352    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp989\" (UniqueName: \"kubernetes.io/projected/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-kube-api-access-gp989\") pod \"simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b\" (UID: \"6c761c52-0af5-4c7a-95d5-f47c14f00aa2\") " pod="e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b"
Nov 02 08:19:14.349930 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:14.349901    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-tmp-dir\") pod \"simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b\" (UID: \"6c761c52-0af5-4c7a-95d5-f47c14f00aa2\") " pod="e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b"
Nov 02 08:19:14.350128 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:14.349945    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-model-cache\") pod \"simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b\" (UID: \"6c761c52-0af5-4c7a-95d5-f47c14f00aa2\") " pod="e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b"
Nov 02 08:19:14.350128 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:14.349975    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp989\" (UniqueName: \"kubernetes.io/projected/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-kube-api-access-gp989\") pod \"simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b\" (UID: \"6c761c52-0af5-4c7a-95d5-f47c14f00aa2\") " pod="e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b"
Nov 02 08:19:14.350128 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:14.350014    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-tls-certs\") pod \"simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b\" (UID: \"6c761c52-0af5-4c7a-95d5-f47c14f00aa2\") " pod="e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b"
Nov 02 08:19:14.350128 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:14.350035    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-dshm\") pod \"simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b\" (UID: \"6c761c52-0af5-4c7a-95d5-f47c14f00aa2\") " pod="e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b"
Nov 02 08:19:14.350128 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:14.350085    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-home\") pod \"simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b\" (UID: \"6c761c52-0af5-4c7a-95d5-f47c14f00aa2\") " pod="e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b"
Nov 02 08:19:14.350401 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:14.350363    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-tmp-dir\") pod \"simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b\" (UID: \"6c761c52-0af5-4c7a-95d5-f47c14f00aa2\") " pod="e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b"
Nov 02 08:19:14.350460 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:14.350403    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-model-cache\") pod \"simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b\" (UID: \"6c761c52-0af5-4c7a-95d5-f47c14f00aa2\") " pod="e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b"
Nov 02 08:19:14.350460 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:14.350431    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-home\") pod \"simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b\" (UID: \"6c761c52-0af5-4c7a-95d5-f47c14f00aa2\") " pod="e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b"
Nov 02 08:19:14.352630 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:14.352603    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-dshm\") pod \"simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b\" (UID: \"6c761c52-0af5-4c7a-95d5-f47c14f00aa2\") " pod="e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b"
Nov 02 08:19:14.352783 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:14.352761    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-tls-certs\") pod \"simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b\" (UID: \"6c761c52-0af5-4c7a-95d5-f47c14f00aa2\") " pod="e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b"
Nov 02 08:19:14.403667 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:14.403586    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp989\" (UniqueName: \"kubernetes.io/projected/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-kube-api-access-gp989\") pod \"simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b\" (UID: \"6c761c52-0af5-4c7a-95d5-f47c14f00aa2\") " pod="e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b"
Nov 02 08:19:14.434518 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:14.434473    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b"
Nov 02 08:19:14.794660 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:14.794637    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b"]
Nov 02 08:19:14.797212 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:19:14.797146    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c761c52_0af5_4c7a_95d5_f47c14f00aa2.slice/crio-941cedd657ebf40a9c6fd47281e1b1fd7b8d163398d6fcebf6aed1cb413e1e24 WatchSource:0}: Error finding container 941cedd657ebf40a9c6fd47281e1b1fd7b8d163398d6fcebf6aed1cb413e1e24: Status 404 returned error can't find the container with id 941cedd657ebf40a9c6fd47281e1b1fd7b8d163398d6fcebf6aed1cb413e1e24
Nov 02 08:19:15.635337 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:15.635301    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b" event={"ID":"6c761c52-0af5-4c7a-95d5-f47c14f00aa2","Type":"ContainerStarted","Data":"c9d71cb5b23228509226762da231513c0979586fac5824ca39dbfd5f55a3ee4e"}
Nov 02 08:19:15.635337 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:15.635338    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b" event={"ID":"6c761c52-0af5-4c7a-95d5-f47c14f00aa2","Type":"ContainerStarted","Data":"941cedd657ebf40a9c6fd47281e1b1fd7b8d163398d6fcebf6aed1cb413e1e24"}
Nov 02 08:19:16.435368 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:16.435333    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b"
Nov 02 08:19:24.435208 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:24.435115    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b"
Nov 02 08:19:24.447590 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:24.447561    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b"
Nov 02 08:19:24.554921 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:24.554134    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b" podStartSLOduration=10.554118298 podStartE2EDuration="10.554118298s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:19:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:19:15.741737616 +0000 UTC m=+745.500166348" watchObservedRunningTime="2026-11-02 08:19:24.554118298 +0000 UTC m=+754.312547031"
Nov 02 08:19:24.691051 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:24.690951    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b"
Nov 02 08:19:27.827233 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:27.827204    6210 patch_prober.go:29] interesting pod/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": read tcp 10.134.0.2:40728->10.134.0.37:15021: read: connection reset by peer" start-of-body=
Nov 02 08:19:27.827941 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:27.827285    6210 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6" podUID="75541fe0-a299-4697-a692-0a0c72d810f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": read tcp 10.134.0.2:40728->10.134.0.37:15021: read: connection reset by peer"
Nov 02 08:19:28.694998 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:28.694966    6210 generic.go:356] "Generic (PLEG): container finished" podID="75541fe0-a299-4697-a692-0a0c72d810f1" containerID="42b8f7925c270402444f1257285b8246975eec3bf74dc3608a4d789ec8352f25" exitCode=0
Nov 02 08:19:28.695167 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:28.695029    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6" event={"ID":"75541fe0-a299-4697-a692-0a0c72d810f1","Type":"ContainerDied","Data":"42b8f7925c270402444f1257285b8246975eec3bf74dc3608a4d789ec8352f25"}
Nov 02 08:19:28.695384 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:28.695370    6210 scope.go:122] "RemoveContainer" containerID="42b8f7925c270402444f1257285b8246975eec3bf74dc3608a4d789ec8352f25"
Nov 02 08:19:28.696629 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:28.696602    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:19:28.696680 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:28.696672    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:19:28.696727 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:28.696704    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:19:29.709829 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:29.708777    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6" event={"ID":"75541fe0-a299-4697-a692-0a0c72d810f1","Type":"ContainerStarted","Data":"27ef2786d73c2fbc76c950825d1045bce77c299da7ad4d1d059d1cb8817198de"}
Nov 02 08:19:29.728399 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:29.728361    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:19:29.728612 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:29.728589    6210 patch_prober.go:29] interesting pod/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Nov 02 08:19:29.728700 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:29.728641    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6" podUID="75541fe0-a299-4697-a692-0a0c72d810f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Nov 02 08:19:30.730410 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:30.730378    6210 patch_prober.go:29] interesting pod/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Nov 02 08:19:30.730828 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:30.730452    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6" podUID="75541fe0-a299-4697-a692-0a0c72d810f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Nov 02 08:19:30.849028 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:19:30.848992    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:19:31.729621 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:31.729589    6210 patch_prober.go:29] interesting pod/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Nov 02 08:19:31.729975 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:31.729896    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6" podUID="75541fe0-a299-4697-a692-0a0c72d810f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Nov 02 08:19:32.728249 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:32.728208    6210 patch_prober.go:29] interesting pod/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Nov 02 08:19:32.728754 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:32.728288    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6" podUID="75541fe0-a299-4697-a692-0a0c72d810f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Nov 02 08:19:33.729214 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:33.728082    6210 patch_prober.go:29] interesting pod/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Nov 02 08:19:33.729214 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:33.728145    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6" podUID="75541fe0-a299-4697-a692-0a0c72d810f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Nov 02 08:19:34.719353 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:34.719312    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t"]
Nov 02 08:19:34.722198 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:34.722178    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t"
Nov 02 08:19:34.728020 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:34.727991    6210 patch_prober.go:29] interesting pod/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Nov 02 08:19:34.728127 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:34.728061    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6" podUID="75541fe0-a299-4697-a692-0a0c72d810f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Nov 02 08:19:34.772247 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:34.772208    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76c6603b-42f0-4934-9a30-efc0fbc412cb-tmp-dir\") pod \"premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t\" (UID: \"76c6603b-42f0-4934-9a30-efc0fbc412cb\") " pod="e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t"
Nov 02 08:19:34.772672 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:34.772405    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76c6603b-42f0-4934-9a30-efc0fbc412cb-model-cache\") pod \"premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t\" (UID: \"76c6603b-42f0-4934-9a30-efc0fbc412cb\") " pod="e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t"
Nov 02 08:19:34.772672 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:34.772487    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76c6603b-42f0-4934-9a30-efc0fbc412cb-home\") pod \"premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t\" (UID: \"76c6603b-42f0-4934-9a30-efc0fbc412cb\") " pod="e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t"
Nov 02 08:19:34.772672 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:34.772516    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76c6603b-42f0-4934-9a30-efc0fbc412cb-dshm\") pod \"premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t\" (UID: \"76c6603b-42f0-4934-9a30-efc0fbc412cb\") " pod="e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t"
Nov 02 08:19:34.772672 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:34.772552    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76c6603b-42f0-4934-9a30-efc0fbc412cb-tls-certs\") pod \"premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t\" (UID: \"76c6603b-42f0-4934-9a30-efc0fbc412cb\") " pod="e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t"
Nov 02 08:19:34.772672 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:34.772581    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqfvm\" (UniqueName: \"kubernetes.io/projected/76c6603b-42f0-4934-9a30-efc0fbc412cb-kube-api-access-nqfvm\") pod \"premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t\" (UID: \"76c6603b-42f0-4934-9a30-efc0fbc412cb\") " pod="e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t"
Nov 02 08:19:34.817230 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:34.817200    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-e6ca80\"/\"premium-w0-e6ca80-kserve-self-signed-certs\""
Nov 02 08:19:34.819517 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:34.819486    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t"]
Nov 02 08:19:34.874319 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:34.874277    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76c6603b-42f0-4934-9a30-efc0fbc412cb-model-cache\") pod \"premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t\" (UID: \"76c6603b-42f0-4934-9a30-efc0fbc412cb\") " pod="e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t"
Nov 02 08:19:34.874696 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:34.874668    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76c6603b-42f0-4934-9a30-efc0fbc412cb-home\") pod \"premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t\" (UID: \"76c6603b-42f0-4934-9a30-efc0fbc412cb\") " pod="e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t"
Nov 02 08:19:34.874927 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:34.874907    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76c6603b-42f0-4934-9a30-efc0fbc412cb-dshm\") pod \"premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t\" (UID: \"76c6603b-42f0-4934-9a30-efc0fbc412cb\") " pod="e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t"
Nov 02 08:19:34.875108 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:34.875091    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76c6603b-42f0-4934-9a30-efc0fbc412cb-tls-certs\") pod \"premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t\" (UID: \"76c6603b-42f0-4934-9a30-efc0fbc412cb\") " pod="e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t"
Nov 02 08:19:34.875223 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:34.875207    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqfvm\" (UniqueName: \"kubernetes.io/projected/76c6603b-42f0-4934-9a30-efc0fbc412cb-kube-api-access-nqfvm\") pod \"premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t\" (UID: \"76c6603b-42f0-4934-9a30-efc0fbc412cb\") " pod="e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t"
Nov 02 08:19:34.875376 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:34.875361    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76c6603b-42f0-4934-9a30-efc0fbc412cb-tmp-dir\") pod \"premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t\" (UID: \"76c6603b-42f0-4934-9a30-efc0fbc412cb\") " pod="e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t"
Nov 02 08:19:34.875973 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:34.875950    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76c6603b-42f0-4934-9a30-efc0fbc412cb-tmp-dir\") pod \"premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t\" (UID: \"76c6603b-42f0-4934-9a30-efc0fbc412cb\") " pod="e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t"
Nov 02 08:19:34.876373 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:34.876354    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76c6603b-42f0-4934-9a30-efc0fbc412cb-model-cache\") pod \"premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t\" (UID: \"76c6603b-42f0-4934-9a30-efc0fbc412cb\") " pod="e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t"
Nov 02 08:19:34.876741 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:34.876719    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76c6603b-42f0-4934-9a30-efc0fbc412cb-home\") pod \"premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t\" (UID: \"76c6603b-42f0-4934-9a30-efc0fbc412cb\") " pod="e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t"
Nov 02 08:19:34.880860 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:34.880489    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76c6603b-42f0-4934-9a30-efc0fbc412cb-tls-certs\") pod \"premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t\" (UID: \"76c6603b-42f0-4934-9a30-efc0fbc412cb\") " pod="e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t"
Nov 02 08:19:34.901832 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:34.901797    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76c6603b-42f0-4934-9a30-efc0fbc412cb-dshm\") pod \"premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t\" (UID: \"76c6603b-42f0-4934-9a30-efc0fbc412cb\") " pod="e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t"
Nov 02 08:19:34.934537 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:34.934501    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqfvm\" (UniqueName: \"kubernetes.io/projected/76c6603b-42f0-4934-9a30-efc0fbc412cb-kube-api-access-nqfvm\") pod \"premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t\" (UID: \"76c6603b-42f0-4934-9a30-efc0fbc412cb\") " pod="e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t"
Nov 02 08:19:35.033134 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:35.033043    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t"
Nov 02 08:19:35.415791 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:35.415716    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t"]
Nov 02 08:19:35.419053 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:19:35.419026    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76c6603b_42f0_4934_9a30_efc0fbc412cb.slice/crio-dbf8437f961208ce1caca77f5e03f202a03c22aa11e51ad04a268f224405b730 WatchSource:0}: Error finding container dbf8437f961208ce1caca77f5e03f202a03c22aa11e51ad04a268f224405b730: Status 404 returned error can't find the container with id dbf8437f961208ce1caca77f5e03f202a03c22aa11e51ad04a268f224405b730
Nov 02 08:19:35.731425 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:35.731397    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:19:35.731689 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:35.731669    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:19:35.732295 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:35.732274    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:19:35.763385 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:35.763357    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t" event={"ID":"76c6603b-42f0-4934-9a30-efc0fbc412cb","Type":"ContainerStarted","Data":"a7beebd23ec2d6f86e366c12b8c8cab807c8e4d8031cedbcf54d3acdf8f5bdd0"}
Nov 02 08:19:35.763478 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:35.763389    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t" event={"ID":"76c6603b-42f0-4934-9a30-efc0fbc412cb","Type":"ContainerStarted","Data":"dbf8437f961208ce1caca77f5e03f202a03c22aa11e51ad04a268f224405b730"}
Nov 02 08:19:35.949326 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:35.949275    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t" podStartSLOduration=1.9492620459999999 podStartE2EDuration="1.949262046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:19:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:19:35.94775135 +0000 UTC m=+765.706180092" watchObservedRunningTime="2026-11-02 08:19:35.949262046 +0000 UTC m=+765.707690777"
Nov 02 08:19:36.033795 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:36.033717    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t"
Nov 02 08:19:40.768954 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:40.768921    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm"]
Nov 02 08:19:40.791751 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:40.791719    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm"
Nov 02 08:19:40.825341 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:40.825306    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm"]
Nov 02 08:19:40.833143 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:40.833113    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fcae226-6893-419e-bf0c-a39b596ae6c8-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm\" (UID: \"8fcae226-6893-419e-bf0c-a39b596ae6c8\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm"
Nov 02 08:19:40.833293 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:40.833271    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8slq\" (UniqueName: \"kubernetes.io/projected/8fcae226-6893-419e-bf0c-a39b596ae6c8-kube-api-access-f8slq\") pod \"payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm\" (UID: \"8fcae226-6893-419e-bf0c-a39b596ae6c8\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm"
Nov 02 08:19:40.840055 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:40.840036    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-8e6407\""
Nov 02 08:19:40.840272 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:40.840249    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-8e6407-dockercfg-dz8f6\""
Nov 02 08:19:40.934899 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:40.934842    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8slq\" (UniqueName: \"kubernetes.io/projected/8fcae226-6893-419e-bf0c-a39b596ae6c8-kube-api-access-f8slq\") pod \"payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm\" (UID: \"8fcae226-6893-419e-bf0c-a39b596ae6c8\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm"
Nov 02 08:19:40.935061 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:40.934964    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fcae226-6893-419e-bf0c-a39b596ae6c8-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm\" (UID: \"8fcae226-6893-419e-bf0c-a39b596ae6c8\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm"
Nov 02 08:19:40.935649 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:40.935629    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fcae226-6893-419e-bf0c-a39b596ae6c8-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm\" (UID: \"8fcae226-6893-419e-bf0c-a39b596ae6c8\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm"
Nov 02 08:19:40.988207 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:40.988174    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8slq\" (UniqueName: \"kubernetes.io/projected/8fcae226-6893-419e-bf0c-a39b596ae6c8-kube-api-access-f8slq\") pod \"payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm\" (UID: \"8fcae226-6893-419e-bf0c-a39b596ae6c8\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm"
Nov 02 08:19:41.104248 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.104170    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm"
Nov 02 08:19:41.462837 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.462813    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm"]
Nov 02 08:19:41.465497 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:19:41.465471    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fcae226_6893_419e_bf0c_a39b596ae6c8.slice/crio-a1a04e532305845052976158dcd763b25e678ad05aef7ac20315b7edc9ed05b3 WatchSource:0}: Error finding container a1a04e532305845052976158dcd763b25e678ad05aef7ac20315b7edc9ed05b3: Status 404 returned error can't find the container with id a1a04e532305845052976158dcd763b25e678ad05aef7ac20315b7edc9ed05b3
Nov 02 08:19:41.614623 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.614591    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"]
Nov 02 08:19:41.617014 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.616994    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"
Nov 02 08:19:41.641416 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.641394    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2be3439c-26f2-4042-b5e8-cf0203ed9682-istio-data\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx\" (UID: \"2be3439c-26f2-4042-b5e8-cf0203ed9682\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"
Nov 02 08:19:41.641527 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.641425    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2be3439c-26f2-4042-b5e8-cf0203ed9682-workload-socket\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx\" (UID: \"2be3439c-26f2-4042-b5e8-cf0203ed9682\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"
Nov 02 08:19:41.641573 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.641538    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2be3439c-26f2-4042-b5e8-cf0203ed9682-istio-token\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx\" (UID: \"2be3439c-26f2-4042-b5e8-cf0203ed9682\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"
Nov 02 08:19:41.641573 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.641563    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2be3439c-26f2-4042-b5e8-cf0203ed9682-istiod-ca-cert\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx\" (UID: \"2be3439c-26f2-4042-b5e8-cf0203ed9682\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"
Nov 02 08:19:41.641709 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.641596    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29lxt\" (UniqueName: \"kubernetes.io/projected/2be3439c-26f2-4042-b5e8-cf0203ed9682-kube-api-access-29lxt\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx\" (UID: \"2be3439c-26f2-4042-b5e8-cf0203ed9682\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"
Nov 02 08:19:41.641709 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.641687    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2be3439c-26f2-4042-b5e8-cf0203ed9682-workload-certs\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx\" (UID: \"2be3439c-26f2-4042-b5e8-cf0203ed9682\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"
Nov 02 08:19:41.641795 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.641728    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2be3439c-26f2-4042-b5e8-cf0203ed9682-istio-envoy\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx\" (UID: \"2be3439c-26f2-4042-b5e8-cf0203ed9682\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"
Nov 02 08:19:41.641795 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.641748    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2be3439c-26f2-4042-b5e8-cf0203ed9682-credential-socket\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx\" (UID: \"2be3439c-26f2-4042-b5e8-cf0203ed9682\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"
Nov 02 08:19:41.641795 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.641763    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2be3439c-26f2-4042-b5e8-cf0203ed9682-istio-podinfo\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx\" (UID: \"2be3439c-26f2-4042-b5e8-cf0203ed9682\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"
Nov 02 08:19:41.665574 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.665548    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-d0628e-openshift-default-dockercfg-qvj7g\""
Nov 02 08:19:41.676825 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.676801    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"]
Nov 02 08:19:41.742535 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.742452    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2be3439c-26f2-4042-b5e8-cf0203ed9682-istio-token\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx\" (UID: \"2be3439c-26f2-4042-b5e8-cf0203ed9682\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"
Nov 02 08:19:41.742535 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.742484    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2be3439c-26f2-4042-b5e8-cf0203ed9682-istiod-ca-cert\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx\" (UID: \"2be3439c-26f2-4042-b5e8-cf0203ed9682\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"
Nov 02 08:19:41.742535 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.742510    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29lxt\" (UniqueName: \"kubernetes.io/projected/2be3439c-26f2-4042-b5e8-cf0203ed9682-kube-api-access-29lxt\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx\" (UID: \"2be3439c-26f2-4042-b5e8-cf0203ed9682\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"
Nov 02 08:19:41.742535 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.742535    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2be3439c-26f2-4042-b5e8-cf0203ed9682-workload-certs\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx\" (UID: \"2be3439c-26f2-4042-b5e8-cf0203ed9682\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"
Nov 02 08:19:41.742855 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.742581    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2be3439c-26f2-4042-b5e8-cf0203ed9682-istio-envoy\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx\" (UID: \"2be3439c-26f2-4042-b5e8-cf0203ed9682\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"
Nov 02 08:19:41.742855 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.742607    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2be3439c-26f2-4042-b5e8-cf0203ed9682-credential-socket\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx\" (UID: \"2be3439c-26f2-4042-b5e8-cf0203ed9682\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"
Nov 02 08:19:41.742855 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.742633    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2be3439c-26f2-4042-b5e8-cf0203ed9682-istio-podinfo\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx\" (UID: \"2be3439c-26f2-4042-b5e8-cf0203ed9682\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"
Nov 02 08:19:41.742855 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.742729    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2be3439c-26f2-4042-b5e8-cf0203ed9682-istio-data\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx\" (UID: \"2be3439c-26f2-4042-b5e8-cf0203ed9682\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"
Nov 02 08:19:41.742855 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.742779    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2be3439c-26f2-4042-b5e8-cf0203ed9682-workload-socket\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx\" (UID: \"2be3439c-26f2-4042-b5e8-cf0203ed9682\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"
Nov 02 08:19:41.743128 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.743058    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2be3439c-26f2-4042-b5e8-cf0203ed9682-credential-socket\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx\" (UID: \"2be3439c-26f2-4042-b5e8-cf0203ed9682\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"
Nov 02 08:19:41.743128 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.743107    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2be3439c-26f2-4042-b5e8-cf0203ed9682-workload-certs\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx\" (UID: \"2be3439c-26f2-4042-b5e8-cf0203ed9682\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"
Nov 02 08:19:41.743205 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.743172    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2be3439c-26f2-4042-b5e8-cf0203ed9682-workload-socket\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx\" (UID: \"2be3439c-26f2-4042-b5e8-cf0203ed9682\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"
Nov 02 08:19:41.743329 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.743309    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2be3439c-26f2-4042-b5e8-cf0203ed9682-istiod-ca-cert\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx\" (UID: \"2be3439c-26f2-4042-b5e8-cf0203ed9682\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"
Nov 02 08:19:41.743415 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.743379    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2be3439c-26f2-4042-b5e8-cf0203ed9682-istio-data\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx\" (UID: \"2be3439c-26f2-4042-b5e8-cf0203ed9682\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"
Nov 02 08:19:41.745656 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.745633    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2be3439c-26f2-4042-b5e8-cf0203ed9682-istio-envoy\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx\" (UID: \"2be3439c-26f2-4042-b5e8-cf0203ed9682\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"
Nov 02 08:19:41.745793 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.745780    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2be3439c-26f2-4042-b5e8-cf0203ed9682-istio-podinfo\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx\" (UID: \"2be3439c-26f2-4042-b5e8-cf0203ed9682\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"
Nov 02 08:19:41.795962 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.795922    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2be3439c-26f2-4042-b5e8-cf0203ed9682-istio-token\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx\" (UID: \"2be3439c-26f2-4042-b5e8-cf0203ed9682\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"
Nov 02 08:19:41.796336 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.796052    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29lxt\" (UniqueName: \"kubernetes.io/projected/2be3439c-26f2-4042-b5e8-cf0203ed9682-kube-api-access-29lxt\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx\" (UID: \"2be3439c-26f2-4042-b5e8-cf0203ed9682\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"
Nov 02 08:19:41.800766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.800743    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm" event={"ID":"8fcae226-6893-419e-bf0c-a39b596ae6c8","Type":"ContainerStarted","Data":"bed728ba4e3acd65d500e3cf00325203736a3c0db3ae511093e2396438d2d5d8"}
Nov 02 08:19:41.800895 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.800785    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm" event={"ID":"8fcae226-6893-419e-bf0c-a39b596ae6c8","Type":"ContainerStarted","Data":"a1a04e532305845052976158dcd763b25e678ad05aef7ac20315b7edc9ed05b3"}
Nov 02 08:19:41.800944 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.800915    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm"
Nov 02 08:19:41.909057 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.908996    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm" podStartSLOduration=1.908977958 podStartE2EDuration="1.908977958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:19:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:19:41.908593672 +0000 UTC m=+771.667022407" watchObservedRunningTime="2026-11-02 08:19:41.908977958 +0000 UTC m=+771.667406669"
Nov 02 08:19:41.928518 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:41.928486    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"
Nov 02 08:19:42.353844 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:19:42.353804    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2be3439c_26f2_4042_b5e8_cf0203ed9682.slice/crio-88a49c3498208e12af85b84d2ed97a959323a0661aaa048e792b38cdf4e67d48 WatchSource:0}: Error finding container 88a49c3498208e12af85b84d2ed97a959323a0661aaa048e792b38cdf4e67d48: Status 404 returned error can't find the container with id 88a49c3498208e12af85b84d2ed97a959323a0661aaa048e792b38cdf4e67d48
Nov 02 08:19:42.355713 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:42.355685    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"]
Nov 02 08:19:42.355799 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:42.355732    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:19:42.355799 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:42.355794    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:19:42.355902 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:42.355821    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:19:42.808320 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:42.808278    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx" event={"ID":"2be3439c-26f2-4042-b5e8-cf0203ed9682","Type":"ContainerStarted","Data":"73156a6f791759aaf5d98b4139be16e41b8f5b3cc27b016fc3c65002c98ee665"}
Nov 02 08:19:42.808817 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:42.808334    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx" event={"ID":"2be3439c-26f2-4042-b5e8-cf0203ed9682","Type":"ContainerStarted","Data":"88a49c3498208e12af85b84d2ed97a959323a0661aaa048e792b38cdf4e67d48"}
Nov 02 08:19:42.929047 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:42.929005    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"
Nov 02 08:19:43.930235 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:43.930202    6210 patch_prober.go:29] interesting pod/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Nov 02 08:19:43.930628 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:43.930265    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx" podUID="2be3439c-26f2-4042-b5e8-cf0203ed9682" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Nov 02 08:19:44.929367 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:44.929333    6210 patch_prober.go:29] interesting pod/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Nov 02 08:19:44.929563 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:44.929390    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx" podUID="2be3439c-26f2-4042-b5e8-cf0203ed9682" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Nov 02 08:19:45.033342 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:45.033308    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t"
Nov 02 08:19:45.046442 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:45.046409    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t"
Nov 02 08:19:45.154643 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:45.154587    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx" podStartSLOduration=4.154570692 podStartE2EDuration="4.154570692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:19:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:19:42.921747925 +0000 UTC m=+772.680176658" watchObservedRunningTime="2026-11-02 08:19:45.154570692 +0000 UTC m=+774.912999424"
Nov 02 08:19:45.850662 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:45.850635    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t"
Nov 02 08:19:45.928866 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:45.928831    6210 patch_prober.go:29] interesting pod/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Nov 02 08:19:45.929056 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:45.928898    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx" podUID="2be3439c-26f2-4042-b5e8-cf0203ed9682" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Nov 02 08:19:46.929713 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:46.929676    6210 patch_prober.go:29] interesting pod/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Nov 02 08:19:46.930116 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:46.929743    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx" podUID="2be3439c-26f2-4042-b5e8-cf0203ed9682" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Nov 02 08:19:47.931316 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:47.931255    6210 patch_prober.go:29] interesting pod/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Nov 02 08:19:47.931915 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:47.931867    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx" podUID="2be3439c-26f2-4042-b5e8-cf0203ed9682" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Nov 02 08:19:49.069267 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:49.069232    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"
Nov 02 08:19:49.069721 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:49.069548    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"
Nov 02 08:19:49.070488 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:49.070467    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"
Nov 02 08:19:52.811954 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:19:52.811923    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm"
Nov 02 08:20:00.821978 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:20:00.821938    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:20:16.251960 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:16.251925    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"]
Nov 02 08:20:16.255104 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:16.255080    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"
Nov 02 08:20:16.298365 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:16.298331    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3021609f-3cfc-497f-8619-f292b7902deb-istio-token\") pod \"e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv\" (UID: \"3021609f-3cfc-497f-8619-f292b7902deb\") " pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"
Nov 02 08:20:16.298540 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:16.298385    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3021609f-3cfc-497f-8619-f292b7902deb-istio-envoy\") pod \"e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv\" (UID: \"3021609f-3cfc-497f-8619-f292b7902deb\") " pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"
Nov 02 08:20:16.298540 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:16.298457    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3021609f-3cfc-497f-8619-f292b7902deb-istio-data\") pod \"e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv\" (UID: \"3021609f-3cfc-497f-8619-f292b7902deb\") " pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"
Nov 02 08:20:16.298540 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:16.298495    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3021609f-3cfc-497f-8619-f292b7902deb-istio-podinfo\") pod \"e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv\" (UID: \"3021609f-3cfc-497f-8619-f292b7902deb\") " pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"
Nov 02 08:20:16.298540 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:16.298522    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr6mp\" (UniqueName: \"kubernetes.io/projected/3021609f-3cfc-497f-8619-f292b7902deb-kube-api-access-cr6mp\") pod \"e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv\" (UID: \"3021609f-3cfc-497f-8619-f292b7902deb\") " pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"
Nov 02 08:20:16.298752 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:16.298667    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3021609f-3cfc-497f-8619-f292b7902deb-workload-certs\") pod \"e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv\" (UID: \"3021609f-3cfc-497f-8619-f292b7902deb\") " pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"
Nov 02 08:20:16.298752 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:16.298712    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3021609f-3cfc-497f-8619-f292b7902deb-credential-socket\") pod \"e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv\" (UID: \"3021609f-3cfc-497f-8619-f292b7902deb\") " pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"
Nov 02 08:20:16.298820 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:16.298805    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3021609f-3cfc-497f-8619-f292b7902deb-workload-socket\") pod \"e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv\" (UID: \"3021609f-3cfc-497f-8619-f292b7902deb\") " pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"
Nov 02 08:20:16.298853 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:16.298834    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3021609f-3cfc-497f-8619-f292b7902deb-istiod-ca-cert\") pod \"e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv\" (UID: \"3021609f-3cfc-497f-8619-f292b7902deb\") " pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"
Nov 02 08:20:16.303540 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:16.303523    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-e6ca80-openshift-default-dockercfg-kspcn\""
Nov 02 08:20:16.351618 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:16.351585    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"]
Nov 02 08:20:16.400116 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:16.400086    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3021609f-3cfc-497f-8619-f292b7902deb-istio-token\") pod \"e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv\" (UID: \"3021609f-3cfc-497f-8619-f292b7902deb\") " pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"
Nov 02 08:20:16.400293 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:16.400130    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3021609f-3cfc-497f-8619-f292b7902deb-istio-envoy\") pod \"e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv\" (UID: \"3021609f-3cfc-497f-8619-f292b7902deb\") " pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"
Nov 02 08:20:16.400293 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:16.400147    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3021609f-3cfc-497f-8619-f292b7902deb-istio-data\") pod \"e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv\" (UID: \"3021609f-3cfc-497f-8619-f292b7902deb\") " pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"
Nov 02 08:20:16.400414 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:16.400336    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3021609f-3cfc-497f-8619-f292b7902deb-istio-podinfo\") pod \"e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv\" (UID: \"3021609f-3cfc-497f-8619-f292b7902deb\") " pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"
Nov 02 08:20:16.400414 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:16.400370    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr6mp\" (UniqueName: \"kubernetes.io/projected/3021609f-3cfc-497f-8619-f292b7902deb-kube-api-access-cr6mp\") pod \"e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv\" (UID: \"3021609f-3cfc-497f-8619-f292b7902deb\") " pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"
Nov 02 08:20:16.400516 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:16.400422    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3021609f-3cfc-497f-8619-f292b7902deb-workload-certs\") pod \"e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv\" (UID: \"3021609f-3cfc-497f-8619-f292b7902deb\") " pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"
Nov 02 08:20:16.400516 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:16.400445    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3021609f-3cfc-497f-8619-f292b7902deb-credential-socket\") pod \"e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv\" (UID: \"3021609f-3cfc-497f-8619-f292b7902deb\") " pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"
Nov 02 08:20:16.400619 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:16.400524    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3021609f-3cfc-497f-8619-f292b7902deb-istio-data\") pod \"e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv\" (UID: \"3021609f-3cfc-497f-8619-f292b7902deb\") " pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"
Nov 02 08:20:16.400619 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:16.400605    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3021609f-3cfc-497f-8619-f292b7902deb-workload-socket\") pod \"e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv\" (UID: \"3021609f-3cfc-497f-8619-f292b7902deb\") " pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"
Nov 02 08:20:16.400719 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:16.400652    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3021609f-3cfc-497f-8619-f292b7902deb-istiod-ca-cert\") pod \"e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv\" (UID: \"3021609f-3cfc-497f-8619-f292b7902deb\") " pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"
Nov 02 08:20:16.400803 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:16.400771    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3021609f-3cfc-497f-8619-f292b7902deb-workload-certs\") pod \"e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv\" (UID: \"3021609f-3cfc-497f-8619-f292b7902deb\") " pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"
Nov 02 08:20:16.400862 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:16.400784    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3021609f-3cfc-497f-8619-f292b7902deb-credential-socket\") pod \"e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv\" (UID: \"3021609f-3cfc-497f-8619-f292b7902deb\") " pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"
Nov 02 08:20:16.400957 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:16.400941    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3021609f-3cfc-497f-8619-f292b7902deb-workload-socket\") pod \"e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv\" (UID: \"3021609f-3cfc-497f-8619-f292b7902deb\") " pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"
Nov 02 08:20:16.401317 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:16.401294    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3021609f-3cfc-497f-8619-f292b7902deb-istiod-ca-cert\") pod \"e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv\" (UID: \"3021609f-3cfc-497f-8619-f292b7902deb\") " pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"
Nov 02 08:20:16.402351 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:16.402326    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3021609f-3cfc-497f-8619-f292b7902deb-istio-envoy\") pod \"e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv\" (UID: \"3021609f-3cfc-497f-8619-f292b7902deb\") " pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"
Nov 02 08:20:16.402807 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:16.402784    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3021609f-3cfc-497f-8619-f292b7902deb-istio-podinfo\") pod \"e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv\" (UID: \"3021609f-3cfc-497f-8619-f292b7902deb\") " pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"
Nov 02 08:20:16.453189 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:16.453154    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3021609f-3cfc-497f-8619-f292b7902deb-istio-token\") pod \"e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv\" (UID: \"3021609f-3cfc-497f-8619-f292b7902deb\") " pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"
Nov 02 08:20:16.453335 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:16.453268    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr6mp\" (UniqueName: \"kubernetes.io/projected/3021609f-3cfc-497f-8619-f292b7902deb-kube-api-access-cr6mp\") pod \"e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv\" (UID: \"3021609f-3cfc-497f-8619-f292b7902deb\") " pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"
Nov 02 08:20:16.567096 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:16.567011    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"
Nov 02 08:20:16.977500 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:16.977467    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"]
Nov 02 08:20:16.981337 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:20:16.981308    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3021609f_3cfc_497f_8619_f292b7902deb.slice/crio-d4b14c164a2f2ee72ebcdeb20f762b9a749ab9c6d87af7ac7143077b642d353e WatchSource:0}: Error finding container d4b14c164a2f2ee72ebcdeb20f762b9a749ab9c6d87af7ac7143077b642d353e: Status 404 returned error can't find the container with id d4b14c164a2f2ee72ebcdeb20f762b9a749ab9c6d87af7ac7143077b642d353e
Nov 02 08:20:16.983579 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:16.983543    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:20:16.983666 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:16.983612    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:20:16.983666 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:16.983653    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:20:16.991447 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:16.991421    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv" event={"ID":"3021609f-3cfc-497f-8619-f292b7902deb","Type":"ContainerStarted","Data":"d4b14c164a2f2ee72ebcdeb20f762b9a749ab9c6d87af7ac7143077b642d353e"}
Nov 02 08:20:17.998411 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:17.998372    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv" event={"ID":"3021609f-3cfc-497f-8619-f292b7902deb","Type":"ContainerStarted","Data":"77defe2284698c8c0c09f53eca9030930feaf197dd1a064143446b3f9cb266a1"}
Nov 02 08:20:18.154242 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:18.154186    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv" podStartSLOduration=2.154171226 podStartE2EDuration="2.154171226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:20:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:20:18.152462341 +0000 UTC m=+807.910891073" watchObservedRunningTime="2026-11-02 08:20:18.154171226 +0000 UTC m=+807.912600027"
Nov 02 08:20:18.567999 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:18.567957    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"
Nov 02 08:20:18.569250 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:18.569224    6210 patch_prober.go:29] interesting pod/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Nov 02 08:20:18.569378 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:18.569275    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv" podUID="3021609f-3cfc-497f-8619-f292b7902deb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Nov 02 08:20:19.567684 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:19.567643    6210 patch_prober.go:29] interesting pod/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Nov 02 08:20:19.568240 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:19.567703    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv" podUID="3021609f-3cfc-497f-8619-f292b7902deb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Nov 02 08:20:20.568038 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:20.568003    6210 patch_prober.go:29] interesting pod/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Nov 02 08:20:20.568458 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:20.568072    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv" podUID="3021609f-3cfc-497f-8619-f292b7902deb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Nov 02 08:20:21.567866 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:21.567831    6210 patch_prober.go:29] interesting pod/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Nov 02 08:20:21.568045 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:21.567904    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv" podUID="3021609f-3cfc-497f-8619-f292b7902deb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Nov 02 08:20:22.567655 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:22.567621    6210 patch_prober.go:29] interesting pod/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Nov 02 08:20:22.568144 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:22.567678    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv" podUID="3021609f-3cfc-497f-8619-f292b7902deb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Nov 02 08:20:23.567355 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:23.567316    6210 patch_prober.go:29] interesting pod/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Nov 02 08:20:23.567517 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:23.567379    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv" podUID="3021609f-3cfc-497f-8619-f292b7902deb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Nov 02 08:20:24.572129 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:24.572092    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"
Nov 02 08:20:24.572515 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:24.572456    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"
Nov 02 08:20:24.573048 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:20:24.573032    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"
Nov 02 08:20:30.821159 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:20:30.821121    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:21:00.820713 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:21:00.820675    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:21:06.725084 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:06.725045    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj"]
Nov 02 08:21:06.728615 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:06.728591    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj"
Nov 02 08:21:06.778060 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:06.778031    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-108cf9\"/\"openshift-service-ca.crt\""
Nov 02 08:21:06.824538 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:06.824507    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-108cf9\"/\"kube-root-ca.crt\""
Nov 02 08:21:06.824538 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:06.824530    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-108cf9\"/\"default-dockercfg-rh5vv\""
Nov 02 08:21:06.824788 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:06.824561    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-108cf9\"/\"simulator-w3-108cf9-kserve-self-signed-certs\""
Nov 02 08:21:06.826078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:06.826037    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8jv7\" (UniqueName: \"kubernetes.io/projected/49b40212-55da-41b0-904e-cbab2dc73648-kube-api-access-w8jv7\") pod \"simulator-w3-108cf9-kserve-6c6cc96889-pxrwj\" (UID: \"49b40212-55da-41b0-904e-cbab2dc73648\") " pod="e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj"
Nov 02 08:21:06.826227 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:06.826079    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49b40212-55da-41b0-904e-cbab2dc73648-tls-certs\") pod \"simulator-w3-108cf9-kserve-6c6cc96889-pxrwj\" (UID: \"49b40212-55da-41b0-904e-cbab2dc73648\") " pod="e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj"
Nov 02 08:21:06.826227 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:06.826121    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj"]
Nov 02 08:21:06.826227 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:06.826178    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49b40212-55da-41b0-904e-cbab2dc73648-dshm\") pod \"simulator-w3-108cf9-kserve-6c6cc96889-pxrwj\" (UID: \"49b40212-55da-41b0-904e-cbab2dc73648\") " pod="e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj"
Nov 02 08:21:06.826227 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:06.826217    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49b40212-55da-41b0-904e-cbab2dc73648-model-cache\") pod \"simulator-w3-108cf9-kserve-6c6cc96889-pxrwj\" (UID: \"49b40212-55da-41b0-904e-cbab2dc73648\") " pod="e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj"
Nov 02 08:21:06.826439 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:06.826410    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49b40212-55da-41b0-904e-cbab2dc73648-tmp-dir\") pod \"simulator-w3-108cf9-kserve-6c6cc96889-pxrwj\" (UID: \"49b40212-55da-41b0-904e-cbab2dc73648\") " pod="e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj"
Nov 02 08:21:06.826498 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:06.826458    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49b40212-55da-41b0-904e-cbab2dc73648-home\") pod \"simulator-w3-108cf9-kserve-6c6cc96889-pxrwj\" (UID: \"49b40212-55da-41b0-904e-cbab2dc73648\") " pod="e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj"
Nov 02 08:21:06.927154 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:06.927115    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49b40212-55da-41b0-904e-cbab2dc73648-tmp-dir\") pod \"simulator-w3-108cf9-kserve-6c6cc96889-pxrwj\" (UID: \"49b40212-55da-41b0-904e-cbab2dc73648\") " pod="e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj"
Nov 02 08:21:06.927329 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:06.927165    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49b40212-55da-41b0-904e-cbab2dc73648-home\") pod \"simulator-w3-108cf9-kserve-6c6cc96889-pxrwj\" (UID: \"49b40212-55da-41b0-904e-cbab2dc73648\") " pod="e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj"
Nov 02 08:21:06.927329 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:06.927240    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8jv7\" (UniqueName: \"kubernetes.io/projected/49b40212-55da-41b0-904e-cbab2dc73648-kube-api-access-w8jv7\") pod \"simulator-w3-108cf9-kserve-6c6cc96889-pxrwj\" (UID: \"49b40212-55da-41b0-904e-cbab2dc73648\") " pod="e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj"
Nov 02 08:21:06.927329 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:06.927271    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49b40212-55da-41b0-904e-cbab2dc73648-tls-certs\") pod \"simulator-w3-108cf9-kserve-6c6cc96889-pxrwj\" (UID: \"49b40212-55da-41b0-904e-cbab2dc73648\") " pod="e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj"
Nov 02 08:21:06.927329 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:06.927311    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49b40212-55da-41b0-904e-cbab2dc73648-dshm\") pod \"simulator-w3-108cf9-kserve-6c6cc96889-pxrwj\" (UID: \"49b40212-55da-41b0-904e-cbab2dc73648\") " pod="e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj"
Nov 02 08:21:06.927543 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:06.927338    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49b40212-55da-41b0-904e-cbab2dc73648-model-cache\") pod \"simulator-w3-108cf9-kserve-6c6cc96889-pxrwj\" (UID: \"49b40212-55da-41b0-904e-cbab2dc73648\") " pod="e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj"
Nov 02 08:21:06.927637 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:06.927610    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49b40212-55da-41b0-904e-cbab2dc73648-tmp-dir\") pod \"simulator-w3-108cf9-kserve-6c6cc96889-pxrwj\" (UID: \"49b40212-55da-41b0-904e-cbab2dc73648\") " pod="e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj"
Nov 02 08:21:06.927792 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:06.927648    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49b40212-55da-41b0-904e-cbab2dc73648-home\") pod \"simulator-w3-108cf9-kserve-6c6cc96889-pxrwj\" (UID: \"49b40212-55da-41b0-904e-cbab2dc73648\") " pod="e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj"
Nov 02 08:21:06.927792 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:06.927665    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49b40212-55da-41b0-904e-cbab2dc73648-model-cache\") pod \"simulator-w3-108cf9-kserve-6c6cc96889-pxrwj\" (UID: \"49b40212-55da-41b0-904e-cbab2dc73648\") " pod="e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj"
Nov 02 08:21:06.929644 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:06.929616    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49b40212-55da-41b0-904e-cbab2dc73648-dshm\") pod \"simulator-w3-108cf9-kserve-6c6cc96889-pxrwj\" (UID: \"49b40212-55da-41b0-904e-cbab2dc73648\") " pod="e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj"
Nov 02 08:21:06.929940 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:06.929920    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49b40212-55da-41b0-904e-cbab2dc73648-tls-certs\") pod \"simulator-w3-108cf9-kserve-6c6cc96889-pxrwj\" (UID: \"49b40212-55da-41b0-904e-cbab2dc73648\") " pod="e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj"
Nov 02 08:21:06.983224 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:06.983148    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8jv7\" (UniqueName: \"kubernetes.io/projected/49b40212-55da-41b0-904e-cbab2dc73648-kube-api-access-w8jv7\") pod \"simulator-w3-108cf9-kserve-6c6cc96889-pxrwj\" (UID: \"49b40212-55da-41b0-904e-cbab2dc73648\") " pod="e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj"
Nov 02 08:21:07.041619 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:07.041575    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj"
Nov 02 08:21:07.422380 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:07.422302    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj"]
Nov 02 08:21:07.425930 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:21:07.425901    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod49b40212_55da_41b0_904e_cbab2dc73648.slice/crio-3dc3f88a8bf542dda97af497f6a4aefd9491ccb1e96ca0a2b93c4b5fbb2ee85d WatchSource:0}: Error finding container 3dc3f88a8bf542dda97af497f6a4aefd9491ccb1e96ca0a2b93c4b5fbb2ee85d: Status 404 returned error can't find the container with id 3dc3f88a8bf542dda97af497f6a4aefd9491ccb1e96ca0a2b93c4b5fbb2ee85d
Nov 02 08:21:08.271888 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:08.271846    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj" event={"ID":"49b40212-55da-41b0-904e-cbab2dc73648","Type":"ContainerStarted","Data":"bf1eefcb0dfe1d5598a1657ce64f9d70b59145712142eebc47f1bf63187b5255"}
Nov 02 08:21:08.272308 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:08.271903    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj" event={"ID":"49b40212-55da-41b0-904e-cbab2dc73648","Type":"ContainerStarted","Data":"3dc3f88a8bf542dda97af497f6a4aefd9491ccb1e96ca0a2b93c4b5fbb2ee85d"}
Nov 02 08:21:08.379456 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:08.379401    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj" podStartSLOduration=2.379387286 podStartE2EDuration="2.379387286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:21:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:21:08.378389073 +0000 UTC m=+858.136817806" watchObservedRunningTime="2026-11-02 08:21:08.379387286 +0000 UTC m=+858.137816018"
Nov 02 08:21:09.042240 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:09.042204    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj"
Nov 02 08:21:17.042803 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:17.042770    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj"
Nov 02 08:21:17.055513 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:17.055490    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj"
Nov 02 08:21:17.324660 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:17.324582    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj"
Nov 02 08:21:17.481294 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:17.481264    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn"]
Nov 02 08:21:17.485022 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:17.485002    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn"
Nov 02 08:21:17.534055 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:17.534024    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-9d77b6\"/\"kube-root-ca.crt\""
Nov 02 08:21:17.534212 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:17.534069    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-9d77b6\"/\"openshift-service-ca.crt\""
Nov 02 08:21:17.534212 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:17.534135    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-9d77b6\"/\"premium-w5-9d77b6-kserve-self-signed-certs\""
Nov 02 08:21:17.534212 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:17.534168    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-9d77b6\"/\"default-dockercfg-gvtss\""
Nov 02 08:21:17.540074 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:17.540050    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn"]
Nov 02 08:21:17.547336 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:17.547312    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8490c0b-3384-43b7-a143-6c1db756aafe-tls-certs\") pod \"premium-w5-9d77b6-kserve-855f94db8d-qtzxn\" (UID: \"b8490c0b-3384-43b7-a143-6c1db756aafe\") " pod="e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn"
Nov 02 08:21:17.547453 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:17.547389    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d45mp\" (UniqueName: \"kubernetes.io/projected/b8490c0b-3384-43b7-a143-6c1db756aafe-kube-api-access-d45mp\") pod \"premium-w5-9d77b6-kserve-855f94db8d-qtzxn\" (UID: \"b8490c0b-3384-43b7-a143-6c1db756aafe\") " pod="e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn"
Nov 02 08:21:17.547523 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:17.547497    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8490c0b-3384-43b7-a143-6c1db756aafe-dshm\") pod \"premium-w5-9d77b6-kserve-855f94db8d-qtzxn\" (UID: \"b8490c0b-3384-43b7-a143-6c1db756aafe\") " pod="e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn"
Nov 02 08:21:17.547575 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:17.547527    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8490c0b-3384-43b7-a143-6c1db756aafe-tmp-dir\") pod \"premium-w5-9d77b6-kserve-855f94db8d-qtzxn\" (UID: \"b8490c0b-3384-43b7-a143-6c1db756aafe\") " pod="e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn"
Nov 02 08:21:17.547622 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:17.547600    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8490c0b-3384-43b7-a143-6c1db756aafe-model-cache\") pod \"premium-w5-9d77b6-kserve-855f94db8d-qtzxn\" (UID: \"b8490c0b-3384-43b7-a143-6c1db756aafe\") " pod="e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn"
Nov 02 08:21:17.547704 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:17.547691    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8490c0b-3384-43b7-a143-6c1db756aafe-home\") pod \"premium-w5-9d77b6-kserve-855f94db8d-qtzxn\" (UID: \"b8490c0b-3384-43b7-a143-6c1db756aafe\") " pod="e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn"
Nov 02 08:21:17.651862 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:17.651761    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d45mp\" (UniqueName: \"kubernetes.io/projected/b8490c0b-3384-43b7-a143-6c1db756aafe-kube-api-access-d45mp\") pod \"premium-w5-9d77b6-kserve-855f94db8d-qtzxn\" (UID: \"b8490c0b-3384-43b7-a143-6c1db756aafe\") " pod="e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn"
Nov 02 08:21:17.651862 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:17.651854    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8490c0b-3384-43b7-a143-6c1db756aafe-dshm\") pod \"premium-w5-9d77b6-kserve-855f94db8d-qtzxn\" (UID: \"b8490c0b-3384-43b7-a143-6c1db756aafe\") " pod="e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn"
Nov 02 08:21:17.652130 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:17.651896    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8490c0b-3384-43b7-a143-6c1db756aafe-tmp-dir\") pod \"premium-w5-9d77b6-kserve-855f94db8d-qtzxn\" (UID: \"b8490c0b-3384-43b7-a143-6c1db756aafe\") " pod="e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn"
Nov 02 08:21:17.652130 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:17.651940    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8490c0b-3384-43b7-a143-6c1db756aafe-model-cache\") pod \"premium-w5-9d77b6-kserve-855f94db8d-qtzxn\" (UID: \"b8490c0b-3384-43b7-a143-6c1db756aafe\") " pod="e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn"
Nov 02 08:21:17.652130 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:17.651982    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8490c0b-3384-43b7-a143-6c1db756aafe-home\") pod \"premium-w5-9d77b6-kserve-855f94db8d-qtzxn\" (UID: \"b8490c0b-3384-43b7-a143-6c1db756aafe\") " pod="e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn"
Nov 02 08:21:17.652130 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:17.652083    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8490c0b-3384-43b7-a143-6c1db756aafe-tls-certs\") pod \"premium-w5-9d77b6-kserve-855f94db8d-qtzxn\" (UID: \"b8490c0b-3384-43b7-a143-6c1db756aafe\") " pod="e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn"
Nov 02 08:21:17.653023 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:17.652995    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8490c0b-3384-43b7-a143-6c1db756aafe-tmp-dir\") pod \"premium-w5-9d77b6-kserve-855f94db8d-qtzxn\" (UID: \"b8490c0b-3384-43b7-a143-6c1db756aafe\") " pod="e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn"
Nov 02 08:21:17.653573 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:17.653552    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8490c0b-3384-43b7-a143-6c1db756aafe-model-cache\") pod \"premium-w5-9d77b6-kserve-855f94db8d-qtzxn\" (UID: \"b8490c0b-3384-43b7-a143-6c1db756aafe\") " pod="e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn"
Nov 02 08:21:17.654181 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:17.654154    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8490c0b-3384-43b7-a143-6c1db756aafe-home\") pod \"premium-w5-9d77b6-kserve-855f94db8d-qtzxn\" (UID: \"b8490c0b-3384-43b7-a143-6c1db756aafe\") " pod="e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn"
Nov 02 08:21:17.662457 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:17.662377    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8490c0b-3384-43b7-a143-6c1db756aafe-tls-certs\") pod \"premium-w5-9d77b6-kserve-855f94db8d-qtzxn\" (UID: \"b8490c0b-3384-43b7-a143-6c1db756aafe\") " pod="e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn"
Nov 02 08:21:17.665302 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:17.665247    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8490c0b-3384-43b7-a143-6c1db756aafe-dshm\") pod \"premium-w5-9d77b6-kserve-855f94db8d-qtzxn\" (UID: \"b8490c0b-3384-43b7-a143-6c1db756aafe\") " pod="e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn"
Nov 02 08:21:17.706613 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:17.706582    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d45mp\" (UniqueName: \"kubernetes.io/projected/b8490c0b-3384-43b7-a143-6c1db756aafe-kube-api-access-d45mp\") pod \"premium-w5-9d77b6-kserve-855f94db8d-qtzxn\" (UID: \"b8490c0b-3384-43b7-a143-6c1db756aafe\") " pod="e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn"
Nov 02 08:21:17.799366 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:17.799325    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn"
Nov 02 08:21:18.202308 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:18.202284    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn"]
Nov 02 08:21:18.205023 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:21:18.204995    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8490c0b_3384_43b7_a143_6c1db756aafe.slice/crio-db0a1525aeb3e386b923cccd510906fc3ff08c832945a7ada6c643716edb8ba1 WatchSource:0}: Error finding container db0a1525aeb3e386b923cccd510906fc3ff08c832945a7ada6c643716edb8ba1: Status 404 returned error can't find the container with id db0a1525aeb3e386b923cccd510906fc3ff08c832945a7ada6c643716edb8ba1
Nov 02 08:21:18.320204 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:18.320170    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn" event={"ID":"b8490c0b-3384-43b7-a143-6c1db756aafe","Type":"ContainerStarted","Data":"fb00fb1c873618b0b3343887eabe78f29f619a570b1734406fd979df30a76a62"}
Nov 02 08:21:18.320352 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:18.320213    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn" event={"ID":"b8490c0b-3384-43b7-a143-6c1db756aafe","Type":"ContainerStarted","Data":"db0a1525aeb3e386b923cccd510906fc3ff08c832945a7ada6c643716edb8ba1"}
Nov 02 08:21:18.426259 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:18.426199    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn" podStartSLOduration=1.426182542 podStartE2EDuration="1.426182542s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:21:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:21:18.425738412 +0000 UTC m=+868.184167145" watchObservedRunningTime="2026-11-02 08:21:18.426182542 +0000 UTC m=+868.184611274"
Nov 02 08:21:18.800276 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:18.800243    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn"
Nov 02 08:21:27.799927 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:27.799863    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn"
Nov 02 08:21:27.812632 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:27.812605    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn"
Nov 02 08:21:28.377333 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:28.377297    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn"
Nov 02 08:21:30.821274 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:21:30.821233    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:21:50.433774 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:50.433743    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q_f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae/extract/0.log"
Nov 02 08:21:50.435156 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:50.435132    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q_f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae/extract/0.log"
Nov 02 08:21:50.448818 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:50.448783    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb77f_3e7ae74c-fcd8-4820-a8b7-769a5fff9f15/ovn-acl-logging/0.log"
Nov 02 08:21:50.451479 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:21:50.451457    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb77f_3e7ae74c-fcd8-4820-a8b7-769a5fff9f15/ovn-acl-logging/0.log"
Nov 02 08:22:00.821269 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:22:00.821231    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:22:08.535283 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:08.535251    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm"]
Nov 02 08:22:08.538988 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:08.538967    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm"
Nov 02 08:22:08.633833 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:08.633806    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-108cf9\"/\"premium-w3-108cf9-kserve-self-signed-certs\""
Nov 02 08:22:08.635356 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:08.635336    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm"]
Nov 02 08:22:08.723500 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:08.723461    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/007e502b-178a-4249-a138-f583cc7a4508-home\") pod \"premium-w3-108cf9-kserve-649d58889b-9pjvm\" (UID: \"007e502b-178a-4249-a138-f583cc7a4508\") " pod="e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm"
Nov 02 08:22:08.723705 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:08.723566    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/007e502b-178a-4249-a138-f583cc7a4508-model-cache\") pod \"premium-w3-108cf9-kserve-649d58889b-9pjvm\" (UID: \"007e502b-178a-4249-a138-f583cc7a4508\") " pod="e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm"
Nov 02 08:22:08.723705 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:08.723623    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/007e502b-178a-4249-a138-f583cc7a4508-tls-certs\") pod \"premium-w3-108cf9-kserve-649d58889b-9pjvm\" (UID: \"007e502b-178a-4249-a138-f583cc7a4508\") " pod="e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm"
Nov 02 08:22:08.723705 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:08.723659    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw2m4\" (UniqueName: \"kubernetes.io/projected/007e502b-178a-4249-a138-f583cc7a4508-kube-api-access-lw2m4\") pod \"premium-w3-108cf9-kserve-649d58889b-9pjvm\" (UID: \"007e502b-178a-4249-a138-f583cc7a4508\") " pod="e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm"
Nov 02 08:22:08.723867 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:08.723766    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/007e502b-178a-4249-a138-f583cc7a4508-tmp-dir\") pod \"premium-w3-108cf9-kserve-649d58889b-9pjvm\" (UID: \"007e502b-178a-4249-a138-f583cc7a4508\") " pod="e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm"
Nov 02 08:22:08.723867 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:08.723820    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/007e502b-178a-4249-a138-f583cc7a4508-dshm\") pod \"premium-w3-108cf9-kserve-649d58889b-9pjvm\" (UID: \"007e502b-178a-4249-a138-f583cc7a4508\") " pod="e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm"
Nov 02 08:22:08.824851 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:08.824766    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/007e502b-178a-4249-a138-f583cc7a4508-home\") pod \"premium-w3-108cf9-kserve-649d58889b-9pjvm\" (UID: \"007e502b-178a-4249-a138-f583cc7a4508\") " pod="e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm"
Nov 02 08:22:08.824851 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:08.824816    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/007e502b-178a-4249-a138-f583cc7a4508-model-cache\") pod \"premium-w3-108cf9-kserve-649d58889b-9pjvm\" (UID: \"007e502b-178a-4249-a138-f583cc7a4508\") " pod="e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm"
Nov 02 08:22:08.825086 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:08.824928    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/007e502b-178a-4249-a138-f583cc7a4508-tls-certs\") pod \"premium-w3-108cf9-kserve-649d58889b-9pjvm\" (UID: \"007e502b-178a-4249-a138-f583cc7a4508\") " pod="e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm"
Nov 02 08:22:08.825086 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:08.824984    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lw2m4\" (UniqueName: \"kubernetes.io/projected/007e502b-178a-4249-a138-f583cc7a4508-kube-api-access-lw2m4\") pod \"premium-w3-108cf9-kserve-649d58889b-9pjvm\" (UID: \"007e502b-178a-4249-a138-f583cc7a4508\") " pod="e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm"
Nov 02 08:22:08.825086 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:08.825032    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/007e502b-178a-4249-a138-f583cc7a4508-tmp-dir\") pod \"premium-w3-108cf9-kserve-649d58889b-9pjvm\" (UID: \"007e502b-178a-4249-a138-f583cc7a4508\") " pod="e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm"
Nov 02 08:22:08.825086 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:08.825084    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/007e502b-178a-4249-a138-f583cc7a4508-dshm\") pod \"premium-w3-108cf9-kserve-649d58889b-9pjvm\" (UID: \"007e502b-178a-4249-a138-f583cc7a4508\") " pod="e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm"
Nov 02 08:22:08.825303 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:08.825242    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/007e502b-178a-4249-a138-f583cc7a4508-model-cache\") pod \"premium-w3-108cf9-kserve-649d58889b-9pjvm\" (UID: \"007e502b-178a-4249-a138-f583cc7a4508\") " pod="e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm"
Nov 02 08:22:08.825372 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:08.825298    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/007e502b-178a-4249-a138-f583cc7a4508-home\") pod \"premium-w3-108cf9-kserve-649d58889b-9pjvm\" (UID: \"007e502b-178a-4249-a138-f583cc7a4508\") " pod="e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm"
Nov 02 08:22:08.825504 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:08.825479    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/007e502b-178a-4249-a138-f583cc7a4508-tmp-dir\") pod \"premium-w3-108cf9-kserve-649d58889b-9pjvm\" (UID: \"007e502b-178a-4249-a138-f583cc7a4508\") " pod="e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm"
Nov 02 08:22:08.827234 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:08.827210    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/007e502b-178a-4249-a138-f583cc7a4508-dshm\") pod \"premium-w3-108cf9-kserve-649d58889b-9pjvm\" (UID: \"007e502b-178a-4249-a138-f583cc7a4508\") " pod="e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm"
Nov 02 08:22:08.827862 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:08.827838    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/007e502b-178a-4249-a138-f583cc7a4508-tls-certs\") pod \"premium-w3-108cf9-kserve-649d58889b-9pjvm\" (UID: \"007e502b-178a-4249-a138-f583cc7a4508\") " pod="e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm"
Nov 02 08:22:08.887827 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:08.884070    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw2m4\" (UniqueName: \"kubernetes.io/projected/007e502b-178a-4249-a138-f583cc7a4508-kube-api-access-lw2m4\") pod \"premium-w3-108cf9-kserve-649d58889b-9pjvm\" (UID: \"007e502b-178a-4249-a138-f583cc7a4508\") " pod="e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm"
Nov 02 08:22:09.151024 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:09.150943    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm"
Nov 02 08:22:09.516423 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:09.516244    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm"]
Nov 02 08:22:09.518863 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:22:09.518830    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod007e502b_178a_4249_a138_f583cc7a4508.slice/crio-2f24afbd19d20f248c13688e6bdf4fd3343826f24780df95082b3c9cff25e740 WatchSource:0}: Error finding container 2f24afbd19d20f248c13688e6bdf4fd3343826f24780df95082b3c9cff25e740: Status 404 returned error can't find the container with id 2f24afbd19d20f248c13688e6bdf4fd3343826f24780df95082b3c9cff25e740
Nov 02 08:22:09.578274 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:09.578246    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm" event={"ID":"007e502b-178a-4249-a138-f583cc7a4508","Type":"ContainerStarted","Data":"e7dd7dd969e81f62523731ca68477356ae42c250df5e5142ebd5609640f2b499"}
Nov 02 08:22:09.578561 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:09.578291    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm" event={"ID":"007e502b-178a-4249-a138-f583cc7a4508","Type":"ContainerStarted","Data":"2f24afbd19d20f248c13688e6bdf4fd3343826f24780df95082b3c9cff25e740"}
Nov 02 08:22:09.684847 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:09.684785    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm" podStartSLOduration=1.684771413 podStartE2EDuration="1.684771413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:22:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:22:09.683627478 +0000 UTC m=+919.442056209" watchObservedRunningTime="2026-11-02 08:22:09.684771413 +0000 UTC m=+919.443200144"
Nov 02 08:22:10.152039 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:10.152004    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm"
Nov 02 08:22:19.151483 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:19.151443    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm"
Nov 02 08:22:19.163839 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:19.163818    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm"
Nov 02 08:22:19.637896 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:19.637853    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm"
Nov 02 08:22:30.821964 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:22:30.821929    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:22:46.163005 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:46.162966    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"]
Nov 02 08:22:46.166845 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:46.166818    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"
Nov 02 08:22:46.216315 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:46.216286    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-096685-openshift-default-dockercfg-fcvv8\""
Nov 02 08:22:46.264175 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:46.264141    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"]
Nov 02 08:22:46.307050 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:46.307017    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a879a44-e608-4679-bb49-716d91dd10c7-istio-token\") pod \"e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb\" (UID: \"6a879a44-e608-4679-bb49-716d91dd10c7\") " pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"
Nov 02 08:22:46.307214 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:46.307056    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a879a44-e608-4679-bb49-716d91dd10c7-credential-socket\") pod \"e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb\" (UID: \"6a879a44-e608-4679-bb49-716d91dd10c7\") " pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"
Nov 02 08:22:46.307214 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:46.307191    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a879a44-e608-4679-bb49-716d91dd10c7-istio-podinfo\") pod \"e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb\" (UID: \"6a879a44-e608-4679-bb49-716d91dd10c7\") " pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"
Nov 02 08:22:46.307283 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:46.307225    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a879a44-e608-4679-bb49-716d91dd10c7-istiod-ca-cert\") pod \"e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb\" (UID: \"6a879a44-e608-4679-bb49-716d91dd10c7\") " pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"
Nov 02 08:22:46.307283 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:46.307255    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a879a44-e608-4679-bb49-716d91dd10c7-workload-socket\") pod \"e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb\" (UID: \"6a879a44-e608-4679-bb49-716d91dd10c7\") " pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"
Nov 02 08:22:46.307368 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:46.307354    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a879a44-e608-4679-bb49-716d91dd10c7-workload-certs\") pod \"e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb\" (UID: \"6a879a44-e608-4679-bb49-716d91dd10c7\") " pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"
Nov 02 08:22:46.307406 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:46.307381    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwhfs\" (UniqueName: \"kubernetes.io/projected/6a879a44-e608-4679-bb49-716d91dd10c7-kube-api-access-gwhfs\") pod \"e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb\" (UID: \"6a879a44-e608-4679-bb49-716d91dd10c7\") " pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"
Nov 02 08:22:46.307454 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:46.307439    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a879a44-e608-4679-bb49-716d91dd10c7-istio-data\") pod \"e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb\" (UID: \"6a879a44-e608-4679-bb49-716d91dd10c7\") " pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"
Nov 02 08:22:46.307513 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:46.307500    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a879a44-e608-4679-bb49-716d91dd10c7-istio-envoy\") pod \"e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb\" (UID: \"6a879a44-e608-4679-bb49-716d91dd10c7\") " pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"
Nov 02 08:22:46.408372 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:46.408336    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a879a44-e608-4679-bb49-716d91dd10c7-istio-podinfo\") pod \"e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb\" (UID: \"6a879a44-e608-4679-bb49-716d91dd10c7\") " pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"
Nov 02 08:22:46.408564 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:46.408380    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a879a44-e608-4679-bb49-716d91dd10c7-istiod-ca-cert\") pod \"e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb\" (UID: \"6a879a44-e608-4679-bb49-716d91dd10c7\") " pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"
Nov 02 08:22:46.408564 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:46.408408    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a879a44-e608-4679-bb49-716d91dd10c7-workload-socket\") pod \"e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb\" (UID: \"6a879a44-e608-4679-bb49-716d91dd10c7\") " pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"
Nov 02 08:22:46.408564 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:46.408466    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a879a44-e608-4679-bb49-716d91dd10c7-workload-certs\") pod \"e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb\" (UID: \"6a879a44-e608-4679-bb49-716d91dd10c7\") " pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"
Nov 02 08:22:46.408564 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:46.408488    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwhfs\" (UniqueName: \"kubernetes.io/projected/6a879a44-e608-4679-bb49-716d91dd10c7-kube-api-access-gwhfs\") pod \"e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb\" (UID: \"6a879a44-e608-4679-bb49-716d91dd10c7\") " pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"
Nov 02 08:22:46.408564 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:46.408513    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a879a44-e608-4679-bb49-716d91dd10c7-istio-data\") pod \"e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb\" (UID: \"6a879a44-e608-4679-bb49-716d91dd10c7\") " pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"
Nov 02 08:22:46.408564 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:46.408543    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a879a44-e608-4679-bb49-716d91dd10c7-istio-envoy\") pod \"e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb\" (UID: \"6a879a44-e608-4679-bb49-716d91dd10c7\") " pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"
Nov 02 08:22:46.408873 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:46.408596    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a879a44-e608-4679-bb49-716d91dd10c7-istio-token\") pod \"e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb\" (UID: \"6a879a44-e608-4679-bb49-716d91dd10c7\") " pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"
Nov 02 08:22:46.408873 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:46.408624    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a879a44-e608-4679-bb49-716d91dd10c7-credential-socket\") pod \"e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb\" (UID: \"6a879a44-e608-4679-bb49-716d91dd10c7\") " pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"
Nov 02 08:22:46.409020 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:46.408993    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a879a44-e608-4679-bb49-716d91dd10c7-workload-socket\") pod \"e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb\" (UID: \"6a879a44-e608-4679-bb49-716d91dd10c7\") " pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"
Nov 02 08:22:46.409116 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:46.409091    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a879a44-e608-4679-bb49-716d91dd10c7-credential-socket\") pod \"e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb\" (UID: \"6a879a44-e608-4679-bb49-716d91dd10c7\") " pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"
Nov 02 08:22:46.409284 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:46.409163    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a879a44-e608-4679-bb49-716d91dd10c7-istiod-ca-cert\") pod \"e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb\" (UID: \"6a879a44-e608-4679-bb49-716d91dd10c7\") " pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"
Nov 02 08:22:46.409404 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:46.409262    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a879a44-e608-4679-bb49-716d91dd10c7-istio-data\") pod \"e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb\" (UID: \"6a879a44-e608-4679-bb49-716d91dd10c7\") " pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"
Nov 02 08:22:46.409404 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:46.409272    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a879a44-e608-4679-bb49-716d91dd10c7-workload-certs\") pod \"e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb\" (UID: \"6a879a44-e608-4679-bb49-716d91dd10c7\") " pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"
Nov 02 08:22:46.410811 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:46.410787    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a879a44-e608-4679-bb49-716d91dd10c7-istio-envoy\") pod \"e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb\" (UID: \"6a879a44-e608-4679-bb49-716d91dd10c7\") " pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"
Nov 02 08:22:46.411075 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:46.411057    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a879a44-e608-4679-bb49-716d91dd10c7-istio-podinfo\") pod \"e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb\" (UID: \"6a879a44-e608-4679-bb49-716d91dd10c7\") " pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"
Nov 02 08:22:46.461822 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:46.461788    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a879a44-e608-4679-bb49-716d91dd10c7-istio-token\") pod \"e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb\" (UID: \"6a879a44-e608-4679-bb49-716d91dd10c7\") " pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"
Nov 02 08:22:46.461982 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:46.461958    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwhfs\" (UniqueName: \"kubernetes.io/projected/6a879a44-e608-4679-bb49-716d91dd10c7-kube-api-access-gwhfs\") pod \"e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb\" (UID: \"6a879a44-e608-4679-bb49-716d91dd10c7\") " pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"
Nov 02 08:22:46.480669 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:46.480646    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"
Nov 02 08:22:46.895228 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:46.895197    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"]
Nov 02 08:22:46.897896 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:22:46.897855    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a879a44_e608_4679_bb49_716d91dd10c7.slice/crio-2f575df8fc95fc9b9303727e238af710a777d222dbe343aab18b2b30b8ec60ca WatchSource:0}: Error finding container 2f575df8fc95fc9b9303727e238af710a777d222dbe343aab18b2b30b8ec60ca: Status 404 returned error can't find the container with id 2f575df8fc95fc9b9303727e238af710a777d222dbe343aab18b2b30b8ec60ca
Nov 02 08:22:46.900311 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:46.900275    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:22:46.900379 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:46.900348    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:22:46.900416 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:46.900377    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:22:47.770814 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:47.770780    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb" event={"ID":"6a879a44-e608-4679-bb49-716d91dd10c7","Type":"ContainerStarted","Data":"086089ffd3d94fe11b68b91a79a29e06cb0edf4f4381d8d56dc87c8faed21869"}
Nov 02 08:22:47.771218 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:47.770831    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb" event={"ID":"6a879a44-e608-4679-bb49-716d91dd10c7","Type":"ContainerStarted","Data":"2f575df8fc95fc9b9303727e238af710a777d222dbe343aab18b2b30b8ec60ca"}
Nov 02 08:22:47.931894 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:47.931818    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb" podStartSLOduration=1.931799468 podStartE2EDuration="1.931799468s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:22:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:22:47.928243679 +0000 UTC m=+957.686672411" watchObservedRunningTime="2026-11-02 08:22:47.931799468 +0000 UTC m=+957.690228201"
Nov 02 08:22:48.481545 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:48.481505    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"
Nov 02 08:22:48.483283 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:48.483258    6210 patch_prober.go:29] interesting pod/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Nov 02 08:22:48.483415 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:48.483314    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb" podUID="6a879a44-e608-4679-bb49-716d91dd10c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Nov 02 08:22:49.481308 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:49.481275    6210 patch_prober.go:29] interesting pod/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Nov 02 08:22:49.481680 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:49.481338    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb" podUID="6a879a44-e608-4679-bb49-716d91dd10c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Nov 02 08:22:50.483793 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:50.482845    6210 patch_prober.go:29] interesting pod/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Nov 02 08:22:50.483793 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:50.482937    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb" podUID="6a879a44-e608-4679-bb49-716d91dd10c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Nov 02 08:22:51.482001 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:51.481967    6210 patch_prober.go:29] interesting pod/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Nov 02 08:22:51.482182 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:51.482018    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb" podUID="6a879a44-e608-4679-bb49-716d91dd10c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Nov 02 08:22:52.481712 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:52.481677    6210 patch_prober.go:29] interesting pod/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Nov 02 08:22:52.482124 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:52.481729    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb" podUID="6a879a44-e608-4679-bb49-716d91dd10c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Nov 02 08:22:53.481826 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:53.481780    6210 patch_prober.go:29] interesting pod/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Nov 02 08:22:53.482374 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:53.481853    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb" podUID="6a879a44-e608-4679-bb49-716d91dd10c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Nov 02 08:22:54.703831 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:54.703800    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"
Nov 02 08:22:54.704348 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:54.704224    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"
Nov 02 08:22:54.704984 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:22:54.704963    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"
Nov 02 08:23:00.821232 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:23:00.821195    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:23:18.835891 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:23:18.835845    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98"]
Nov 02 08:23:18.839728 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:23:18.839707    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98"
Nov 02 08:23:18.937760 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:23:18.937730    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-9d77b6\"/\"distinct-w5-9d77b6-kserve-self-signed-certs\""
Nov 02 08:23:18.940854 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:23:18.940820    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98"]
Nov 02 08:23:18.993905 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:23:18.991204    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc856144-2439-489a-b4a8-c0a1ddd02cdf-dshm\") pod \"distinct-w5-9d77b6-kserve-85fc95b54c-4zx98\" (UID: \"dc856144-2439-489a-b4a8-c0a1ddd02cdf\") " pod="e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98"
Nov 02 08:23:18.993905 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:23:18.991315    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc856144-2439-489a-b4a8-c0a1ddd02cdf-tls-certs\") pod \"distinct-w5-9d77b6-kserve-85fc95b54c-4zx98\" (UID: \"dc856144-2439-489a-b4a8-c0a1ddd02cdf\") " pod="e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98"
Nov 02 08:23:18.993905 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:23:18.991358    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc856144-2439-489a-b4a8-c0a1ddd02cdf-home\") pod \"distinct-w5-9d77b6-kserve-85fc95b54c-4zx98\" (UID: \"dc856144-2439-489a-b4a8-c0a1ddd02cdf\") " pod="e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98"
Nov 02 08:23:18.993905 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:23:18.991423    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc856144-2439-489a-b4a8-c0a1ddd02cdf-model-cache\") pod \"distinct-w5-9d77b6-kserve-85fc95b54c-4zx98\" (UID: \"dc856144-2439-489a-b4a8-c0a1ddd02cdf\") " pod="e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98"
Nov 02 08:23:18.993905 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:23:18.991453    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc856144-2439-489a-b4a8-c0a1ddd02cdf-tmp-dir\") pod \"distinct-w5-9d77b6-kserve-85fc95b54c-4zx98\" (UID: \"dc856144-2439-489a-b4a8-c0a1ddd02cdf\") " pod="e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98"
Nov 02 08:23:18.993905 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:23:18.991484    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xv9w\" (UniqueName: \"kubernetes.io/projected/dc856144-2439-489a-b4a8-c0a1ddd02cdf-kube-api-access-5xv9w\") pod \"distinct-w5-9d77b6-kserve-85fc95b54c-4zx98\" (UID: \"dc856144-2439-489a-b4a8-c0a1ddd02cdf\") " pod="e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98"
Nov 02 08:23:19.092802 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:23:19.092698    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc856144-2439-489a-b4a8-c0a1ddd02cdf-home\") pod \"distinct-w5-9d77b6-kserve-85fc95b54c-4zx98\" (UID: \"dc856144-2439-489a-b4a8-c0a1ddd02cdf\") " pod="e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98"
Nov 02 08:23:19.092993 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:23:19.092793    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc856144-2439-489a-b4a8-c0a1ddd02cdf-model-cache\") pod \"distinct-w5-9d77b6-kserve-85fc95b54c-4zx98\" (UID: \"dc856144-2439-489a-b4a8-c0a1ddd02cdf\") " pod="e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98"
Nov 02 08:23:19.092993 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:23:19.092833    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc856144-2439-489a-b4a8-c0a1ddd02cdf-tmp-dir\") pod \"distinct-w5-9d77b6-kserve-85fc95b54c-4zx98\" (UID: \"dc856144-2439-489a-b4a8-c0a1ddd02cdf\") " pod="e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98"
Nov 02 08:23:19.092993 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:23:19.092865    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xv9w\" (UniqueName: \"kubernetes.io/projected/dc856144-2439-489a-b4a8-c0a1ddd02cdf-kube-api-access-5xv9w\") pod \"distinct-w5-9d77b6-kserve-85fc95b54c-4zx98\" (UID: \"dc856144-2439-489a-b4a8-c0a1ddd02cdf\") " pod="e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98"
Nov 02 08:23:19.093268 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:23:19.093246    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc856144-2439-489a-b4a8-c0a1ddd02cdf-tmp-dir\") pod \"distinct-w5-9d77b6-kserve-85fc95b54c-4zx98\" (UID: \"dc856144-2439-489a-b4a8-c0a1ddd02cdf\") " pod="e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98"
Nov 02 08:23:19.093356 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:23:19.093220    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc856144-2439-489a-b4a8-c0a1ddd02cdf-model-cache\") pod \"distinct-w5-9d77b6-kserve-85fc95b54c-4zx98\" (UID: \"dc856144-2439-489a-b4a8-c0a1ddd02cdf\") " pod="e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98"
Nov 02 08:23:19.093356 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:23:19.093154    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc856144-2439-489a-b4a8-c0a1ddd02cdf-home\") pod \"distinct-w5-9d77b6-kserve-85fc95b54c-4zx98\" (UID: \"dc856144-2439-489a-b4a8-c0a1ddd02cdf\") " pod="e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98"
Nov 02 08:23:19.093433 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:23:19.093371    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc856144-2439-489a-b4a8-c0a1ddd02cdf-dshm\") pod \"distinct-w5-9d77b6-kserve-85fc95b54c-4zx98\" (UID: \"dc856144-2439-489a-b4a8-c0a1ddd02cdf\") " pod="e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98"
Nov 02 08:23:19.093487 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:23:19.093469    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc856144-2439-489a-b4a8-c0a1ddd02cdf-tls-certs\") pod \"distinct-w5-9d77b6-kserve-85fc95b54c-4zx98\" (UID: \"dc856144-2439-489a-b4a8-c0a1ddd02cdf\") " pod="e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98"
Nov 02 08:23:19.095743 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:23:19.095712    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc856144-2439-489a-b4a8-c0a1ddd02cdf-dshm\") pod \"distinct-w5-9d77b6-kserve-85fc95b54c-4zx98\" (UID: \"dc856144-2439-489a-b4a8-c0a1ddd02cdf\") " pod="e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98"
Nov 02 08:23:19.095960 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:23:19.095943    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc856144-2439-489a-b4a8-c0a1ddd02cdf-tls-certs\") pod \"distinct-w5-9d77b6-kserve-85fc95b54c-4zx98\" (UID: \"dc856144-2439-489a-b4a8-c0a1ddd02cdf\") " pod="e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98"
Nov 02 08:23:19.145898 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:23:19.145856    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xv9w\" (UniqueName: \"kubernetes.io/projected/dc856144-2439-489a-b4a8-c0a1ddd02cdf-kube-api-access-5xv9w\") pod \"distinct-w5-9d77b6-kserve-85fc95b54c-4zx98\" (UID: \"dc856144-2439-489a-b4a8-c0a1ddd02cdf\") " pod="e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98"
Nov 02 08:23:19.164301 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:23:19.164269    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98"
Nov 02 08:23:19.603841 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:23:19.603816    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98"]
Nov 02 08:23:19.606088 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:23:19.606055    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc856144_2439_489a_b4a8_c0a1ddd02cdf.slice/crio-2e202b1ad9d34d9bc30c90230f058e8718f6f83e5873941743cd434eed7d5490 WatchSource:0}: Error finding container 2e202b1ad9d34d9bc30c90230f058e8718f6f83e5873941743cd434eed7d5490: Status 404 returned error can't find the container with id 2e202b1ad9d34d9bc30c90230f058e8718f6f83e5873941743cd434eed7d5490
Nov 02 08:23:19.956814 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:23:19.956782    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98" event={"ID":"dc856144-2439-489a-b4a8-c0a1ddd02cdf","Type":"ContainerStarted","Data":"338932fd77bd63f3f75318cdad691439752494232602f7d1f2d604a0853d0373"}
Nov 02 08:23:19.957203 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:23:19.956829    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98" event={"ID":"dc856144-2439-489a-b4a8-c0a1ddd02cdf","Type":"ContainerStarted","Data":"2e202b1ad9d34d9bc30c90230f058e8718f6f83e5873941743cd434eed7d5490"}
Nov 02 08:23:20.065262 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:23:20.065203    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98" podStartSLOduration=2.065185404 podStartE2EDuration="2.065185404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:23:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:23:20.063489062 +0000 UTC m=+989.821917794" watchObservedRunningTime="2026-11-02 08:23:20.065185404 +0000 UTC m=+989.823614135"
Nov 02 08:23:20.164355 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:23:20.164321    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98"
Nov 02 08:23:29.165228 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:23:29.165188    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98"
Nov 02 08:23:29.177645 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:23:29.177621    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98"
Nov 02 08:23:30.016974 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:23:30.016943    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98"
Nov 02 08:23:30.820020 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:23:30.819980    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:24:00.820720 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:24:00.820685    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:24:30.363731 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:30.363695    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g"]
Nov 02 08:24:30.367211 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:30.367187    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g"
Nov 02 08:24:30.462139 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:30.462103    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-d0628e\"/\"distinct-w1-d0628e-kserve-self-signed-certs\""
Nov 02 08:24:30.463777 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:30.463747    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g"]
Nov 02 08:24:30.493892 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:30.493858    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a8cfb24-093e-43c0-9e72-46f31a9d003a-tmp-dir\") pod \"distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g\" (UID: \"9a8cfb24-093e-43c0-9e72-46f31a9d003a\") " pod="e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g"
Nov 02 08:24:30.494051 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:30.493930    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chn6q\" (UniqueName: \"kubernetes.io/projected/9a8cfb24-093e-43c0-9e72-46f31a9d003a-kube-api-access-chn6q\") pod \"distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g\" (UID: \"9a8cfb24-093e-43c0-9e72-46f31a9d003a\") " pod="e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g"
Nov 02 08:24:30.494051 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:30.494041    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a8cfb24-093e-43c0-9e72-46f31a9d003a-tls-certs\") pod \"distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g\" (UID: \"9a8cfb24-093e-43c0-9e72-46f31a9d003a\") " pod="e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g"
Nov 02 08:24:30.494140 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:30.494062    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a8cfb24-093e-43c0-9e72-46f31a9d003a-dshm\") pod \"distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g\" (UID: \"9a8cfb24-093e-43c0-9e72-46f31a9d003a\") " pod="e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g"
Nov 02 08:24:30.494214 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:30.494192    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a8cfb24-093e-43c0-9e72-46f31a9d003a-home\") pod \"distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g\" (UID: \"9a8cfb24-093e-43c0-9e72-46f31a9d003a\") " pod="e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g"
Nov 02 08:24:30.494277 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:30.494248    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a8cfb24-093e-43c0-9e72-46f31a9d003a-model-cache\") pod \"distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g\" (UID: \"9a8cfb24-093e-43c0-9e72-46f31a9d003a\") " pod="e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g"
Nov 02 08:24:30.596164 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:30.596134    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a8cfb24-093e-43c0-9e72-46f31a9d003a-model-cache\") pod \"distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g\" (UID: \"9a8cfb24-093e-43c0-9e72-46f31a9d003a\") " pod="e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g"
Nov 02 08:24:30.596364 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:30.596195    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a8cfb24-093e-43c0-9e72-46f31a9d003a-tmp-dir\") pod \"distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g\" (UID: \"9a8cfb24-093e-43c0-9e72-46f31a9d003a\") " pod="e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g"
Nov 02 08:24:30.596364 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:30.596228    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chn6q\" (UniqueName: \"kubernetes.io/projected/9a8cfb24-093e-43c0-9e72-46f31a9d003a-kube-api-access-chn6q\") pod \"distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g\" (UID: \"9a8cfb24-093e-43c0-9e72-46f31a9d003a\") " pod="e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g"
Nov 02 08:24:30.596364 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:30.596271    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a8cfb24-093e-43c0-9e72-46f31a9d003a-tls-certs\") pod \"distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g\" (UID: \"9a8cfb24-093e-43c0-9e72-46f31a9d003a\") " pod="e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g"
Nov 02 08:24:30.596364 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:30.596301    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a8cfb24-093e-43c0-9e72-46f31a9d003a-dshm\") pod \"distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g\" (UID: \"9a8cfb24-093e-43c0-9e72-46f31a9d003a\") " pod="e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g"
Nov 02 08:24:30.596588 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:30.596382    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a8cfb24-093e-43c0-9e72-46f31a9d003a-home\") pod \"distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g\" (UID: \"9a8cfb24-093e-43c0-9e72-46f31a9d003a\") " pod="e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g"
Nov 02 08:24:30.596665 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:30.596634    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a8cfb24-093e-43c0-9e72-46f31a9d003a-model-cache\") pod \"distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g\" (UID: \"9a8cfb24-093e-43c0-9e72-46f31a9d003a\") " pod="e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g"
Nov 02 08:24:30.596786 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:30.596675    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a8cfb24-093e-43c0-9e72-46f31a9d003a-tmp-dir\") pod \"distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g\" (UID: \"9a8cfb24-093e-43c0-9e72-46f31a9d003a\") " pod="e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g"
Nov 02 08:24:30.596786 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:30.596692    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a8cfb24-093e-43c0-9e72-46f31a9d003a-home\") pod \"distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g\" (UID: \"9a8cfb24-093e-43c0-9e72-46f31a9d003a\") " pod="e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g"
Nov 02 08:24:30.598656 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:30.598630    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a8cfb24-093e-43c0-9e72-46f31a9d003a-dshm\") pod \"distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g\" (UID: \"9a8cfb24-093e-43c0-9e72-46f31a9d003a\") " pod="e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g"
Nov 02 08:24:30.598751 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:30.598730    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a8cfb24-093e-43c0-9e72-46f31a9d003a-tls-certs\") pod \"distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g\" (UID: \"9a8cfb24-093e-43c0-9e72-46f31a9d003a\") " pod="e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g"
Nov 02 08:24:30.649802 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:30.649727    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chn6q\" (UniqueName: \"kubernetes.io/projected/9a8cfb24-093e-43c0-9e72-46f31a9d003a-kube-api-access-chn6q\") pod \"distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g\" (UID: \"9a8cfb24-093e-43c0-9e72-46f31a9d003a\") " pod="e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g"
Nov 02 08:24:30.680271 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:30.680235    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g"
Nov 02 08:24:30.865892 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:24:30.865836    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:24:31.052442 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:31.052413    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g"]
Nov 02 08:24:31.055377 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:24:31.055346    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a8cfb24_093e_43c0_9e72_46f31a9d003a.slice/crio-979b69f0508f9b4dc2173f6bf82401cca2abef03ff28b2e665d1b7ef6ee88221 WatchSource:0}: Error finding container 979b69f0508f9b4dc2173f6bf82401cca2abef03ff28b2e665d1b7ef6ee88221: Status 404 returned error can't find the container with id 979b69f0508f9b4dc2173f6bf82401cca2abef03ff28b2e665d1b7ef6ee88221
Nov 02 08:24:31.318282 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:31.318187    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g" event={"ID":"9a8cfb24-093e-43c0-9e72-46f31a9d003a","Type":"ContainerStarted","Data":"64e6404e63f8ee109c54ab7f7acd3f4537144c83aa6a882e23fba6f7f830d5ad"}
Nov 02 08:24:31.318282 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:31.318239    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g" event={"ID":"9a8cfb24-093e-43c0-9e72-46f31a9d003a","Type":"ContainerStarted","Data":"979b69f0508f9b4dc2173f6bf82401cca2abef03ff28b2e665d1b7ef6ee88221"}
Nov 02 08:24:31.426803 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:31.426748    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g" podStartSLOduration=1.426732292 podStartE2EDuration="1.426732292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:24:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:24:31.425207491 +0000 UTC m=+1061.183636223" watchObservedRunningTime="2026-11-02 08:24:31.426732292 +0000 UTC m=+1061.185161023"
Nov 02 08:24:31.680906 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:31.680824    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g"
Nov 02 08:24:40.681119 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:40.681083    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g"
Nov 02 08:24:40.693589 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:40.693561    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g"
Nov 02 08:24:41.394794 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:41.394764    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g"
Nov 02 08:24:54.315111 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:54.315076    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"]
Nov 02 08:24:54.315513 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:54.315264    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd" podUID="3c39ad91-eb96-4108-ba21-2259f7f90371" containerName="istio-proxy" containerID="cri-o://9cde03c09b71ddbf71d4afca2cfc5337907c84360e01cf936cab90041cba1129" gracePeriod=30
Nov 02 08:24:59.163028 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.162991    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc"]
Nov 02 08:24:59.166820 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.166796    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc"
Nov 02 08:24:59.229894 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.229844    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bb9c875-1508-474c-bf31-34e2bacbe3bd-tls-certs\") pod \"distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc\" (UID: \"5bb9c875-1508-474c-bf31-34e2bacbe3bd\") " pod="e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc"
Nov 02 08:24:59.230080 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.229975    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bb9c875-1508-474c-bf31-34e2bacbe3bd-home\") pod \"distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc\" (UID: \"5bb9c875-1508-474c-bf31-34e2bacbe3bd\") " pod="e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc"
Nov 02 08:24:59.230080 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.230056    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69vr4\" (UniqueName: \"kubernetes.io/projected/5bb9c875-1508-474c-bf31-34e2bacbe3bd-kube-api-access-69vr4\") pod \"distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc\" (UID: \"5bb9c875-1508-474c-bf31-34e2bacbe3bd\") " pod="e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc"
Nov 02 08:24:59.230163 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.230112    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bb9c875-1508-474c-bf31-34e2bacbe3bd-tmp-dir\") pod \"distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc\" (UID: \"5bb9c875-1508-474c-bf31-34e2bacbe3bd\") " pod="e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc"
Nov 02 08:24:59.230250 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.230229    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bb9c875-1508-474c-bf31-34e2bacbe3bd-model-cache\") pod \"distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc\" (UID: \"5bb9c875-1508-474c-bf31-34e2bacbe3bd\") " pod="e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc"
Nov 02 08:24:59.230286 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.230264    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bb9c875-1508-474c-bf31-34e2bacbe3bd-dshm\") pod \"distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc\" (UID: \"5bb9c875-1508-474c-bf31-34e2bacbe3bd\") " pod="e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc"
Nov 02 08:24:59.261627 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.261593    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-9d77b6\"/\"distinct-2-w5-9d77b6-kserve-self-signed-certs\""
Nov 02 08:24:59.263363 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.263339    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc"]
Nov 02 08:24:59.331064 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.331022    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bb9c875-1508-474c-bf31-34e2bacbe3bd-tmp-dir\") pod \"distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc\" (UID: \"5bb9c875-1508-474c-bf31-34e2bacbe3bd\") " pod="e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc"
Nov 02 08:24:59.331386 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.331345    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bb9c875-1508-474c-bf31-34e2bacbe3bd-model-cache\") pod \"distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc\" (UID: \"5bb9c875-1508-474c-bf31-34e2bacbe3bd\") " pod="e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc"
Nov 02 08:24:59.331514 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.331392    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bb9c875-1508-474c-bf31-34e2bacbe3bd-dshm\") pod \"distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc\" (UID: \"5bb9c875-1508-474c-bf31-34e2bacbe3bd\") " pod="e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc"
Nov 02 08:24:59.331514 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.331470    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bb9c875-1508-474c-bf31-34e2bacbe3bd-tls-certs\") pod \"distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc\" (UID: \"5bb9c875-1508-474c-bf31-34e2bacbe3bd\") " pod="e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc"
Nov 02 08:24:59.331634 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.331584    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bb9c875-1508-474c-bf31-34e2bacbe3bd-home\") pod \"distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc\" (UID: \"5bb9c875-1508-474c-bf31-34e2bacbe3bd\") " pod="e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc"
Nov 02 08:24:59.331804 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.331776    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69vr4\" (UniqueName: \"kubernetes.io/projected/5bb9c875-1508-474c-bf31-34e2bacbe3bd-kube-api-access-69vr4\") pod \"distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc\" (UID: \"5bb9c875-1508-474c-bf31-34e2bacbe3bd\") " pod="e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc"
Nov 02 08:24:59.332788 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.332764    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bb9c875-1508-474c-bf31-34e2bacbe3bd-tmp-dir\") pod \"distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc\" (UID: \"5bb9c875-1508-474c-bf31-34e2bacbe3bd\") " pod="e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc"
Nov 02 08:24:59.333242 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.333215    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bb9c875-1508-474c-bf31-34e2bacbe3bd-home\") pod \"distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc\" (UID: \"5bb9c875-1508-474c-bf31-34e2bacbe3bd\") " pod="e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc"
Nov 02 08:24:59.333668 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.333563    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bb9c875-1508-474c-bf31-34e2bacbe3bd-model-cache\") pod \"distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc\" (UID: \"5bb9c875-1508-474c-bf31-34e2bacbe3bd\") " pod="e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc"
Nov 02 08:24:59.335521 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.335475    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bb9c875-1508-474c-bf31-34e2bacbe3bd-dshm\") pod \"distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc\" (UID: \"5bb9c875-1508-474c-bf31-34e2bacbe3bd\") " pod="e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc"
Nov 02 08:24:59.339313 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.339292    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bb9c875-1508-474c-bf31-34e2bacbe3bd-tls-certs\") pod \"distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc\" (UID: \"5bb9c875-1508-474c-bf31-34e2bacbe3bd\") " pod="e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc"
Nov 02 08:24:59.387187 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.387157    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69vr4\" (UniqueName: \"kubernetes.io/projected/5bb9c875-1508-474c-bf31-34e2bacbe3bd-kube-api-access-69vr4\") pod \"distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc\" (UID: \"5bb9c875-1508-474c-bf31-34e2bacbe3bd\") " pod="e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc"
Nov 02 08:24:59.481933 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.479959    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc"
Nov 02 08:24:59.487643 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.487606    6210 generic.go:356] "Generic (PLEG): container finished" podID="3c39ad91-eb96-4108-ba21-2259f7f90371" containerID="9cde03c09b71ddbf71d4afca2cfc5337907c84360e01cf936cab90041cba1129" exitCode=0
Nov 02 08:24:59.487791 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.487689    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd" event={"ID":"3c39ad91-eb96-4108-ba21-2259f7f90371","Type":"ContainerDied","Data":"9cde03c09b71ddbf71d4afca2cfc5337907c84360e01cf936cab90041cba1129"}
Nov 02 08:24:59.628318 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.623763    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"
Nov 02 08:24:59.750969 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.750939    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3c39ad91-eb96-4108-ba21-2259f7f90371-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c39ad91-eb96-4108-ba21-2259f7f90371-istio-envoy\") pod \"3c39ad91-eb96-4108-ba21-2259f7f90371\" (UID: \"3c39ad91-eb96-4108-ba21-2259f7f90371\") "
Nov 02 08:24:59.751155 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.750981    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3c39ad91-eb96-4108-ba21-2259f7f90371-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c39ad91-eb96-4108-ba21-2259f7f90371-istiod-ca-cert\") pod \"3c39ad91-eb96-4108-ba21-2259f7f90371\" (UID: \"3c39ad91-eb96-4108-ba21-2259f7f90371\") "
Nov 02 08:24:59.751155 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.751031    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3c39ad91-eb96-4108-ba21-2259f7f90371-kube-api-access-w6fch\" (UniqueName: \"kubernetes.io/projected/3c39ad91-eb96-4108-ba21-2259f7f90371-kube-api-access-w6fch\") pod \"3c39ad91-eb96-4108-ba21-2259f7f90371\" (UID: \"3c39ad91-eb96-4108-ba21-2259f7f90371\") "
Nov 02 08:24:59.751155 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.751085    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3c39ad91-eb96-4108-ba21-2259f7f90371-istio-token\" (UniqueName: \"kubernetes.io/projected/3c39ad91-eb96-4108-ba21-2259f7f90371-istio-token\") pod \"3c39ad91-eb96-4108-ba21-2259f7f90371\" (UID: \"3c39ad91-eb96-4108-ba21-2259f7f90371\") "
Nov 02 08:24:59.751385 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.751224    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3c39ad91-eb96-4108-ba21-2259f7f90371-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c39ad91-eb96-4108-ba21-2259f7f90371-workload-certs\") pod \"3c39ad91-eb96-4108-ba21-2259f7f90371\" (UID: \"3c39ad91-eb96-4108-ba21-2259f7f90371\") "
Nov 02 08:24:59.751385 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.751330    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3c39ad91-eb96-4108-ba21-2259f7f90371-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c39ad91-eb96-4108-ba21-2259f7f90371-istio-podinfo\") pod \"3c39ad91-eb96-4108-ba21-2259f7f90371\" (UID: \"3c39ad91-eb96-4108-ba21-2259f7f90371\") "
Nov 02 08:24:59.751385 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.751374    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3c39ad91-eb96-4108-ba21-2259f7f90371-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c39ad91-eb96-4108-ba21-2259f7f90371-workload-socket\") pod \"3c39ad91-eb96-4108-ba21-2259f7f90371\" (UID: \"3c39ad91-eb96-4108-ba21-2259f7f90371\") "
Nov 02 08:24:59.751537 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.751413    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3c39ad91-eb96-4108-ba21-2259f7f90371-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c39ad91-eb96-4108-ba21-2259f7f90371-credential-socket\") pod \"3c39ad91-eb96-4108-ba21-2259f7f90371\" (UID: \"3c39ad91-eb96-4108-ba21-2259f7f90371\") "
Nov 02 08:24:59.751537 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.751501    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3c39ad91-eb96-4108-ba21-2259f7f90371-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c39ad91-eb96-4108-ba21-2259f7f90371-istio-data\") pod \"3c39ad91-eb96-4108-ba21-2259f7f90371\" (UID: \"3c39ad91-eb96-4108-ba21-2259f7f90371\") "
Nov 02 08:24:59.751635 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.751573    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c39ad91-eb96-4108-ba21-2259f7f90371-istiod-ca-cert" pod "3c39ad91-eb96-4108-ba21-2259f7f90371" (UID: "3c39ad91-eb96-4108-ba21-2259f7f90371"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:24:59.752224 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.751946    6210 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c39ad91-eb96-4108-ba21-2259f7f90371-istiod-ca-cert\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:24:59.752224 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.752001    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c39ad91-eb96-4108-ba21-2259f7f90371-workload-certs" pod "3c39ad91-eb96-4108-ba21-2259f7f90371" (UID: "3c39ad91-eb96-4108-ba21-2259f7f90371"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:24:59.752224 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.752111    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c39ad91-eb96-4108-ba21-2259f7f90371-credential-socket" pod "3c39ad91-eb96-4108-ba21-2259f7f90371" (UID: "3c39ad91-eb96-4108-ba21-2259f7f90371"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:24:59.752224 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.752169    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c39ad91-eb96-4108-ba21-2259f7f90371-workload-socket" pod "3c39ad91-eb96-4108-ba21-2259f7f90371" (UID: "3c39ad91-eb96-4108-ba21-2259f7f90371"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:24:59.752224 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.752190    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c39ad91-eb96-4108-ba21-2259f7f90371-istio-data" pod "3c39ad91-eb96-4108-ba21-2259f7f90371" (UID: "3c39ad91-eb96-4108-ba21-2259f7f90371"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:24:59.753692 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.753654    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c39ad91-eb96-4108-ba21-2259f7f90371-istio-envoy" pod "3c39ad91-eb96-4108-ba21-2259f7f90371" (UID: "3c39ad91-eb96-4108-ba21-2259f7f90371"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:24:59.754574 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.753819    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c39ad91-eb96-4108-ba21-2259f7f90371-kube-api-access-w6fch" pod "3c39ad91-eb96-4108-ba21-2259f7f90371" (UID: "3c39ad91-eb96-4108-ba21-2259f7f90371"). InnerVolumeSpecName "kube-api-access-w6fch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:24:59.754574 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.754243    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c39ad91-eb96-4108-ba21-2259f7f90371-istio-token" pod "3c39ad91-eb96-4108-ba21-2259f7f90371" (UID: "3c39ad91-eb96-4108-ba21-2259f7f90371"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:24:59.754574 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.754335    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3c39ad91-eb96-4108-ba21-2259f7f90371-istio-podinfo" pod "3c39ad91-eb96-4108-ba21-2259f7f90371" (UID: "3c39ad91-eb96-4108-ba21-2259f7f90371"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 08:24:59.853594 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.853563    6210 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c39ad91-eb96-4108-ba21-2259f7f90371-istio-token\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:24:59.853594 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.853594    6210 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c39ad91-eb96-4108-ba21-2259f7f90371-workload-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:24:59.853594 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.853604    6210 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c39ad91-eb96-4108-ba21-2259f7f90371-istio-podinfo\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:24:59.853825 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.853612    6210 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c39ad91-eb96-4108-ba21-2259f7f90371-workload-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:24:59.853825 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.853623    6210 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c39ad91-eb96-4108-ba21-2259f7f90371-credential-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:24:59.853825 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.853631    6210 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c39ad91-eb96-4108-ba21-2259f7f90371-istio-data\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:24:59.853825 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.853639    6210 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c39ad91-eb96-4108-ba21-2259f7f90371-istio-envoy\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:24:59.853825 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.853648    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6fch\" (UniqueName: \"kubernetes.io/projected/3c39ad91-eb96-4108-ba21-2259f7f90371-kube-api-access-w6fch\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:24:59.909726 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:24:59.909707    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc"]
Nov 02 08:24:59.912039 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:24:59.912008    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5bb9c875_1508_474c_bf31_34e2bacbe3bd.slice/crio-31a3df6062f5c56ddc8494895b81b58014e41fb39f915f13685b1f8961455730 WatchSource:0}: Error finding container 31a3df6062f5c56ddc8494895b81b58014e41fb39f915f13685b1f8961455730: Status 404 returned error can't find the container with id 31a3df6062f5c56ddc8494895b81b58014e41fb39f915f13685b1f8961455730
Nov 02 08:25:00.493803 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:00.493751    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc" event={"ID":"5bb9c875-1508-474c-bf31-34e2bacbe3bd","Type":"ContainerStarted","Data":"accb0f79ca5064d59aa38ae086061dcbb1c80e9eeb447f52bc1a56dee618daa0"}
Nov 02 08:25:00.494279 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:00.493810    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc" event={"ID":"5bb9c875-1508-474c-bf31-34e2bacbe3bd","Type":"ContainerStarted","Data":"31a3df6062f5c56ddc8494895b81b58014e41fb39f915f13685b1f8961455730"}
Nov 02 08:25:00.495111 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:00.495090    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"
Nov 02 08:25:00.495237 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:00.495088    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd" event={"ID":"3c39ad91-eb96-4108-ba21-2259f7f90371","Type":"ContainerDied","Data":"fbc82dccfceaa57f4f7ca2b1f60e016476b486b670e19d39173803cb51bd558f"}
Nov 02 08:25:00.495283 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:00.495245    6210 scope.go:122] "RemoveContainer" containerID="9cde03c09b71ddbf71d4afca2cfc5337907c84360e01cf936cab90041cba1129"
Nov 02 08:25:00.601628 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:00.601519    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc" podStartSLOduration=1.601501812 podStartE2EDuration="1.601501812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:24:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:25:00.601174406 +0000 UTC m=+1090.359603138" watchObservedRunningTime="2026-11-02 08:25:00.601501812 +0000 UTC m=+1090.359930546"
Nov 02 08:25:00.705814 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:00.705780    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"]
Nov 02 08:25:00.751362 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:00.751330    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd"]
Nov 02 08:25:00.820338 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:25:00.820304    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:25:01.480651 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:01.480577    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc"
Nov 02 08:25:02.352864 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:02.352830    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3c39ad91-eb96-4108-ba21-2259f7f90371" path="/var/lib/kubelet/pods/3c39ad91-eb96-4108-ba21-2259f7f90371/volumes"
Nov 02 08:25:05.089099 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.089065    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"]
Nov 02 08:25:05.089525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.089513    6210 cpu_manager.go:414] "containerMap: removing container" podUID="3c39ad91-eb96-4108-ba21-2259f7f90371" containerName="istio-proxy"
Nov 02 08:25:05.089593 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.089526    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3c39ad91-eb96-4108-ba21-2259f7f90371" containerName="istio-proxy"
Nov 02 08:25:05.089593 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.089590    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="3c39ad91-eb96-4108-ba21-2259f7f90371" containerName="istio-proxy"
Nov 02 08:25:05.094053 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.094031    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"
Nov 02 08:25:05.148742 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.148700    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-10d2fb-openshift-default-dockercfg-hh68x\""
Nov 02 08:25:05.196844 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.196803    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"]
Nov 02 08:25:05.207910 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.207863    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/971a4292-217b-4588-bd75-09f4a5edf852-workload-certs\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4\" (UID: \"971a4292-217b-4588-bd75-09f4a5edf852\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"
Nov 02 08:25:05.208087 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.207934    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/971a4292-217b-4588-bd75-09f4a5edf852-istio-data\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4\" (UID: \"971a4292-217b-4588-bd75-09f4a5edf852\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"
Nov 02 08:25:05.208087 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.208009    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/971a4292-217b-4588-bd75-09f4a5edf852-credential-socket\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4\" (UID: \"971a4292-217b-4588-bd75-09f4a5edf852\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"
Nov 02 08:25:05.208087 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.208062    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/971a4292-217b-4588-bd75-09f4a5edf852-workload-socket\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4\" (UID: \"971a4292-217b-4588-bd75-09f4a5edf852\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"
Nov 02 08:25:05.208242 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.208150    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/971a4292-217b-4588-bd75-09f4a5edf852-istio-token\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4\" (UID: \"971a4292-217b-4588-bd75-09f4a5edf852\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"
Nov 02 08:25:05.208242 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.208199    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/971a4292-217b-4588-bd75-09f4a5edf852-istio-envoy\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4\" (UID: \"971a4292-217b-4588-bd75-09f4a5edf852\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"
Nov 02 08:25:05.208242 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.208219    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dss94\" (UniqueName: \"kubernetes.io/projected/971a4292-217b-4588-bd75-09f4a5edf852-kube-api-access-dss94\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4\" (UID: \"971a4292-217b-4588-bd75-09f4a5edf852\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"
Nov 02 08:25:05.208389 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.208250    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/971a4292-217b-4588-bd75-09f4a5edf852-istio-podinfo\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4\" (UID: \"971a4292-217b-4588-bd75-09f4a5edf852\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"
Nov 02 08:25:05.208389 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.208326    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/971a4292-217b-4588-bd75-09f4a5edf852-istiod-ca-cert\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4\" (UID: \"971a4292-217b-4588-bd75-09f4a5edf852\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"
Nov 02 08:25:05.310019 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.309979    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/971a4292-217b-4588-bd75-09f4a5edf852-istio-data\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4\" (UID: \"971a4292-217b-4588-bd75-09f4a5edf852\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"
Nov 02 08:25:05.310019 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.310026    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/971a4292-217b-4588-bd75-09f4a5edf852-credential-socket\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4\" (UID: \"971a4292-217b-4588-bd75-09f4a5edf852\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"
Nov 02 08:25:05.310230 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.310057    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/971a4292-217b-4588-bd75-09f4a5edf852-workload-socket\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4\" (UID: \"971a4292-217b-4588-bd75-09f4a5edf852\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"
Nov 02 08:25:05.310230 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.310083    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/971a4292-217b-4588-bd75-09f4a5edf852-istio-token\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4\" (UID: \"971a4292-217b-4588-bd75-09f4a5edf852\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"
Nov 02 08:25:05.310230 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.310129    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/971a4292-217b-4588-bd75-09f4a5edf852-istio-envoy\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4\" (UID: \"971a4292-217b-4588-bd75-09f4a5edf852\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"
Nov 02 08:25:05.310372 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.310256    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dss94\" (UniqueName: \"kubernetes.io/projected/971a4292-217b-4588-bd75-09f4a5edf852-kube-api-access-dss94\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4\" (UID: \"971a4292-217b-4588-bd75-09f4a5edf852\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"
Nov 02 08:25:05.310372 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.310317    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/971a4292-217b-4588-bd75-09f4a5edf852-istio-podinfo\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4\" (UID: \"971a4292-217b-4588-bd75-09f4a5edf852\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"
Nov 02 08:25:05.310372 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.310356    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/971a4292-217b-4588-bd75-09f4a5edf852-istiod-ca-cert\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4\" (UID: \"971a4292-217b-4588-bd75-09f4a5edf852\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"
Nov 02 08:25:05.310521 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.310456    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/971a4292-217b-4588-bd75-09f4a5edf852-istio-data\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4\" (UID: \"971a4292-217b-4588-bd75-09f4a5edf852\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"
Nov 02 08:25:05.310521 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.310475    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/971a4292-217b-4588-bd75-09f4a5edf852-credential-socket\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4\" (UID: \"971a4292-217b-4588-bd75-09f4a5edf852\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"
Nov 02 08:25:05.310521 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.310462    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/971a4292-217b-4588-bd75-09f4a5edf852-workload-certs\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4\" (UID: \"971a4292-217b-4588-bd75-09f4a5edf852\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"
Nov 02 08:25:05.310666 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.310522    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/971a4292-217b-4588-bd75-09f4a5edf852-workload-socket\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4\" (UID: \"971a4292-217b-4588-bd75-09f4a5edf852\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"
Nov 02 08:25:05.310746 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.310721    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/971a4292-217b-4588-bd75-09f4a5edf852-workload-certs\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4\" (UID: \"971a4292-217b-4588-bd75-09f4a5edf852\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"
Nov 02 08:25:05.311051 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.311033    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/971a4292-217b-4588-bd75-09f4a5edf852-istiod-ca-cert\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4\" (UID: \"971a4292-217b-4588-bd75-09f4a5edf852\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"
Nov 02 08:25:05.312339 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.312315    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/971a4292-217b-4588-bd75-09f4a5edf852-istio-envoy\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4\" (UID: \"971a4292-217b-4588-bd75-09f4a5edf852\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"
Nov 02 08:25:05.312765 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.312747    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/971a4292-217b-4588-bd75-09f4a5edf852-istio-podinfo\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4\" (UID: \"971a4292-217b-4588-bd75-09f4a5edf852\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"
Nov 02 08:25:05.364143 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.364071    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/971a4292-217b-4588-bd75-09f4a5edf852-istio-token\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4\" (UID: \"971a4292-217b-4588-bd75-09f4a5edf852\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"
Nov 02 08:25:05.364277 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.364165    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dss94\" (UniqueName: \"kubernetes.io/projected/971a4292-217b-4588-bd75-09f4a5edf852-kube-api-access-dss94\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4\" (UID: \"971a4292-217b-4588-bd75-09f4a5edf852\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"
Nov 02 08:25:05.407584 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.407547    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"
Nov 02 08:25:05.824967 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.824900    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"]
Nov 02 08:25:05.827559 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:25:05.827533    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod971a4292_217b_4588_bd75_09f4a5edf852.slice/crio-cfaa71e35ad277400b4dd2148a0e004134e05b476896b4b837287d6cac2eff17 WatchSource:0}: Error finding container cfaa71e35ad277400b4dd2148a0e004134e05b476896b4b837287d6cac2eff17: Status 404 returned error can't find the container with id cfaa71e35ad277400b4dd2148a0e004134e05b476896b4b837287d6cac2eff17
Nov 02 08:25:05.829786 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.829753    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:25:05.829855 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.829821    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:25:05.829855 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:05.829850    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:25:06.532529 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:06.532495    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4" event={"ID":"971a4292-217b-4588-bd75-09f4a5edf852","Type":"ContainerStarted","Data":"29dc33a18112904fd9f6deca68b0917e671574c0328841f0ff7abb54b0be4855"}
Nov 02 08:25:06.532966 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:06.532546    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4" event={"ID":"971a4292-217b-4588-bd75-09f4a5edf852","Type":"ContainerStarted","Data":"cfaa71e35ad277400b4dd2148a0e004134e05b476896b4b837287d6cac2eff17"}
Nov 02 08:25:06.691781 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:06.691717    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4" podStartSLOduration=1.691697048 podStartE2EDuration="1.691697048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:25:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:25:06.69108758 +0000 UTC m=+1096.449516315" watchObservedRunningTime="2026-11-02 08:25:06.691697048 +0000 UTC m=+1096.450125781"
Nov 02 08:25:07.414905 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:07.413969    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"
Nov 02 08:25:07.414905 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:07.414134    6210 patch_prober.go:29] interesting pod/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Nov 02 08:25:07.414905 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:07.414181    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4" podUID="971a4292-217b-4588-bd75-09f4a5edf852" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Nov 02 08:25:08.419904 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:08.419603    6210 patch_prober.go:29] interesting pod/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Nov 02 08:25:08.419904 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:08.419664    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4" podUID="971a4292-217b-4588-bd75-09f4a5edf852" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Nov 02 08:25:09.409255 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:09.409220    6210 patch_prober.go:29] interesting pod/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Nov 02 08:25:09.409533 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:09.409502    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4" podUID="971a4292-217b-4588-bd75-09f4a5edf852" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Nov 02 08:25:09.481095 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:09.481064    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc"
Nov 02 08:25:09.493788 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:09.493762    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc"
Nov 02 08:25:09.566498 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:09.566468    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc"
Nov 02 08:25:10.411905 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:10.411216    6210 patch_prober.go:29] interesting pod/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Nov 02 08:25:10.411905 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:10.411289    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4" podUID="971a4292-217b-4588-bd75-09f4a5edf852" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Nov 02 08:25:11.416903 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:11.415965    6210 patch_prober.go:29] interesting pod/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Nov 02 08:25:11.416903 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:11.416024    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4" podUID="971a4292-217b-4588-bd75-09f4a5edf852" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Nov 02 08:25:12.408946 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:12.408907    6210 patch_prober.go:29] interesting pod/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Nov 02 08:25:12.409213 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:12.408985    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4" podUID="971a4292-217b-4588-bd75-09f4a5edf852" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Nov 02 08:25:13.413027 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:13.412998    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"
Nov 02 08:25:13.413516 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:13.413366    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"
Nov 02 08:25:13.413986 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:13.413966    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"
Nov 02 08:25:13.679654 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:13.679569    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j"]
Nov 02 08:25:13.682732 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:13.682709    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j"
Nov 02 08:25:13.705463 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:13.705414    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d4395c6-343b-4ed5-97f5-7bb40dec980b-home\") pod \"distinct-w3-108cf9-kserve-67dffb9475-wqd4j\" (UID: \"5d4395c6-343b-4ed5-97f5-7bb40dec980b\") " pod="e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j"
Nov 02 08:25:13.705608 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:13.705466    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l225n\" (UniqueName: \"kubernetes.io/projected/5d4395c6-343b-4ed5-97f5-7bb40dec980b-kube-api-access-l225n\") pod \"distinct-w3-108cf9-kserve-67dffb9475-wqd4j\" (UID: \"5d4395c6-343b-4ed5-97f5-7bb40dec980b\") " pod="e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j"
Nov 02 08:25:13.705608 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:13.705581    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d4395c6-343b-4ed5-97f5-7bb40dec980b-tmp-dir\") pod \"distinct-w3-108cf9-kserve-67dffb9475-wqd4j\" (UID: \"5d4395c6-343b-4ed5-97f5-7bb40dec980b\") " pod="e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j"
Nov 02 08:25:13.705769 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:13.705732    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d4395c6-343b-4ed5-97f5-7bb40dec980b-dshm\") pod \"distinct-w3-108cf9-kserve-67dffb9475-wqd4j\" (UID: \"5d4395c6-343b-4ed5-97f5-7bb40dec980b\") " pod="e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j"
Nov 02 08:25:13.706085 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:13.705790    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d4395c6-343b-4ed5-97f5-7bb40dec980b-tls-certs\") pod \"distinct-w3-108cf9-kserve-67dffb9475-wqd4j\" (UID: \"5d4395c6-343b-4ed5-97f5-7bb40dec980b\") " pod="e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j"
Nov 02 08:25:13.706085 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:13.705834    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d4395c6-343b-4ed5-97f5-7bb40dec980b-model-cache\") pod \"distinct-w3-108cf9-kserve-67dffb9475-wqd4j\" (UID: \"5d4395c6-343b-4ed5-97f5-7bb40dec980b\") " pod="e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j"
Nov 02 08:25:13.731550 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:13.731520    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-108cf9\"/\"distinct-w3-108cf9-kserve-self-signed-certs\""
Nov 02 08:25:13.739834 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:13.739800    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j"]
Nov 02 08:25:13.806700 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:13.806662    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d4395c6-343b-4ed5-97f5-7bb40dec980b-home\") pod \"distinct-w3-108cf9-kserve-67dffb9475-wqd4j\" (UID: \"5d4395c6-343b-4ed5-97f5-7bb40dec980b\") " pod="e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j"
Nov 02 08:25:13.806914 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:13.806706    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l225n\" (UniqueName: \"kubernetes.io/projected/5d4395c6-343b-4ed5-97f5-7bb40dec980b-kube-api-access-l225n\") pod \"distinct-w3-108cf9-kserve-67dffb9475-wqd4j\" (UID: \"5d4395c6-343b-4ed5-97f5-7bb40dec980b\") " pod="e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j"
Nov 02 08:25:13.806914 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:13.806759    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d4395c6-343b-4ed5-97f5-7bb40dec980b-tmp-dir\") pod \"distinct-w3-108cf9-kserve-67dffb9475-wqd4j\" (UID: \"5d4395c6-343b-4ed5-97f5-7bb40dec980b\") " pod="e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j"
Nov 02 08:25:13.806914 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:13.806798    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d4395c6-343b-4ed5-97f5-7bb40dec980b-dshm\") pod \"distinct-w3-108cf9-kserve-67dffb9475-wqd4j\" (UID: \"5d4395c6-343b-4ed5-97f5-7bb40dec980b\") " pod="e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j"
Nov 02 08:25:13.806914 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:13.806828    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d4395c6-343b-4ed5-97f5-7bb40dec980b-tls-certs\") pod \"distinct-w3-108cf9-kserve-67dffb9475-wqd4j\" (UID: \"5d4395c6-343b-4ed5-97f5-7bb40dec980b\") " pod="e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j"
Nov 02 08:25:13.806914 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:13.806864    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d4395c6-343b-4ed5-97f5-7bb40dec980b-model-cache\") pod \"distinct-w3-108cf9-kserve-67dffb9475-wqd4j\" (UID: \"5d4395c6-343b-4ed5-97f5-7bb40dec980b\") " pod="e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j"
Nov 02 08:25:13.807164 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:13.807143    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d4395c6-343b-4ed5-97f5-7bb40dec980b-home\") pod \"distinct-w3-108cf9-kserve-67dffb9475-wqd4j\" (UID: \"5d4395c6-343b-4ed5-97f5-7bb40dec980b\") " pod="e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j"
Nov 02 08:25:13.807217 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:13.807196    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d4395c6-343b-4ed5-97f5-7bb40dec980b-tmp-dir\") pod \"distinct-w3-108cf9-kserve-67dffb9475-wqd4j\" (UID: \"5d4395c6-343b-4ed5-97f5-7bb40dec980b\") " pod="e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j"
Nov 02 08:25:13.807296 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:13.807278    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d4395c6-343b-4ed5-97f5-7bb40dec980b-model-cache\") pod \"distinct-w3-108cf9-kserve-67dffb9475-wqd4j\" (UID: \"5d4395c6-343b-4ed5-97f5-7bb40dec980b\") " pod="e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j"
Nov 02 08:25:13.809029 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:13.809006    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d4395c6-343b-4ed5-97f5-7bb40dec980b-dshm\") pod \"distinct-w3-108cf9-kserve-67dffb9475-wqd4j\" (UID: \"5d4395c6-343b-4ed5-97f5-7bb40dec980b\") " pod="e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j"
Nov 02 08:25:13.809352 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:13.809181    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d4395c6-343b-4ed5-97f5-7bb40dec980b-tls-certs\") pod \"distinct-w3-108cf9-kserve-67dffb9475-wqd4j\" (UID: \"5d4395c6-343b-4ed5-97f5-7bb40dec980b\") " pod="e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j"
Nov 02 08:25:13.882591 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:13.882550    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l225n\" (UniqueName: \"kubernetes.io/projected/5d4395c6-343b-4ed5-97f5-7bb40dec980b-kube-api-access-l225n\") pod \"distinct-w3-108cf9-kserve-67dffb9475-wqd4j\" (UID: \"5d4395c6-343b-4ed5-97f5-7bb40dec980b\") " pod="e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j"
Nov 02 08:25:13.994678 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:13.994646    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j"
Nov 02 08:25:14.394296 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:14.394273    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j"]
Nov 02 08:25:14.396393 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:25:14.396357    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d4395c6_343b_4ed5_97f5_7bb40dec980b.slice/crio-4bea384162346df3328b8da16fa69ffa3b4ff3146e6c3eb4fc74b40fc82aefcb WatchSource:0}: Error finding container 4bea384162346df3328b8da16fa69ffa3b4ff3146e6c3eb4fc74b40fc82aefcb: Status 404 returned error can't find the container with id 4bea384162346df3328b8da16fa69ffa3b4ff3146e6c3eb4fc74b40fc82aefcb
Nov 02 08:25:14.576843 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:14.576808    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j" event={"ID":"5d4395c6-343b-4ed5-97f5-7bb40dec980b","Type":"ContainerStarted","Data":"cf04a5a17cc494bdd45a048937cfbde46d3db3b86ce8ebf18ad33a1527087c0d"}
Nov 02 08:25:14.577236 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:14.576857    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j" event={"ID":"5d4395c6-343b-4ed5-97f5-7bb40dec980b","Type":"ContainerStarted","Data":"4bea384162346df3328b8da16fa69ffa3b4ff3146e6c3eb4fc74b40fc82aefcb"}
Nov 02 08:25:14.685256 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:14.685148    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j" podStartSLOduration=1.685133419 podStartE2EDuration="1.685133419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:25:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:25:14.683961164 +0000 UTC m=+1104.442389897" watchObservedRunningTime="2026-11-02 08:25:14.685133419 +0000 UTC m=+1104.443562192"
Nov 02 08:25:14.995659 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:14.995624    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j"
Nov 02 08:25:23.995403 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:23.995365    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j"
Nov 02 08:25:24.007853 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:24.007828    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j"
Nov 02 08:25:24.647808 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:25:24.647778    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j"
Nov 02 08:25:30.821673 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:25:30.821627    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:26:00.822710 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:26:00.822679    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:26:09.697409 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:09.697376    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb"]
Nov 02 08:26:09.700917 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:09.700898    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb"
Nov 02 08:26:09.749618 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:09.749587    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-096685\"/\"openshift-service-ca.crt\""
Nov 02 08:26:09.749792 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:09.749776    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-096685\"/\"kube-root-ca.crt\""
Nov 02 08:26:09.749908 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:09.749863    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-096685\"/\"distinct-2-w6-096685-kserve-self-signed-certs\""
Nov 02 08:26:09.795897 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:09.795860    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-096685\"/\"default-dockercfg-rqt6f\""
Nov 02 08:26:09.797839 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:09.797816    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb"]
Nov 02 08:26:09.819446 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:09.819411    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4cqn\" (UniqueName: \"kubernetes.io/projected/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-kube-api-access-q4cqn\") pod \"distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb\" (UID: \"aec294ed-60a8-4af4-ba50-faf7cfc61f6e\") " pod="e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb"
Nov 02 08:26:09.819585 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:09.819482    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-model-cache\") pod \"distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb\" (UID: \"aec294ed-60a8-4af4-ba50-faf7cfc61f6e\") " pod="e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb"
Nov 02 08:26:09.819585 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:09.819530    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-dshm\") pod \"distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb\" (UID: \"aec294ed-60a8-4af4-ba50-faf7cfc61f6e\") " pod="e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb"
Nov 02 08:26:09.819710 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:09.819665    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-home\") pod \"distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb\" (UID: \"aec294ed-60a8-4af4-ba50-faf7cfc61f6e\") " pod="e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb"
Nov 02 08:26:09.819710 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:09.819693    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-tmp-dir\") pod \"distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb\" (UID: \"aec294ed-60a8-4af4-ba50-faf7cfc61f6e\") " pod="e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb"
Nov 02 08:26:09.819825 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:09.819810    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-tls-certs\") pod \"distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb\" (UID: \"aec294ed-60a8-4af4-ba50-faf7cfc61f6e\") " pod="e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb"
Nov 02 08:26:09.921519 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:09.921479    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-dshm\") pod \"distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb\" (UID: \"aec294ed-60a8-4af4-ba50-faf7cfc61f6e\") " pod="e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb"
Nov 02 08:26:09.921710 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:09.921589    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-home\") pod \"distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb\" (UID: \"aec294ed-60a8-4af4-ba50-faf7cfc61f6e\") " pod="e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb"
Nov 02 08:26:09.921710 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:09.921612    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-tmp-dir\") pod \"distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb\" (UID: \"aec294ed-60a8-4af4-ba50-faf7cfc61f6e\") " pod="e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb"
Nov 02 08:26:09.921710 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:09.921686    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-tls-certs\") pod \"distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb\" (UID: \"aec294ed-60a8-4af4-ba50-faf7cfc61f6e\") " pod="e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb"
Nov 02 08:26:09.921861 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:09.921758    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4cqn\" (UniqueName: \"kubernetes.io/projected/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-kube-api-access-q4cqn\") pod \"distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb\" (UID: \"aec294ed-60a8-4af4-ba50-faf7cfc61f6e\") " pod="e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb"
Nov 02 08:26:09.921861 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:09.921822    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-model-cache\") pod \"distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb\" (UID: \"aec294ed-60a8-4af4-ba50-faf7cfc61f6e\") " pod="e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb"
Nov 02 08:26:09.922308 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:09.922142    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-tmp-dir\") pod \"distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb\" (UID: \"aec294ed-60a8-4af4-ba50-faf7cfc61f6e\") " pod="e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb"
Nov 02 08:26:09.922308 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:09.922180    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-model-cache\") pod \"distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb\" (UID: \"aec294ed-60a8-4af4-ba50-faf7cfc61f6e\") " pod="e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb"
Nov 02 08:26:09.922468 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:09.922417    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-home\") pod \"distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb\" (UID: \"aec294ed-60a8-4af4-ba50-faf7cfc61f6e\") " pod="e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb"
Nov 02 08:26:09.924447 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:09.924420    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-dshm\") pod \"distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb\" (UID: \"aec294ed-60a8-4af4-ba50-faf7cfc61f6e\") " pod="e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb"
Nov 02 08:26:09.924831 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:09.924810    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-tls-certs\") pod \"distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb\" (UID: \"aec294ed-60a8-4af4-ba50-faf7cfc61f6e\") " pod="e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb"
Nov 02 08:26:09.975361 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:09.975330    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4cqn\" (UniqueName: \"kubernetes.io/projected/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-kube-api-access-q4cqn\") pod \"distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb\" (UID: \"aec294ed-60a8-4af4-ba50-faf7cfc61f6e\") " pod="e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb"
Nov 02 08:26:10.012531 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:10.012491    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb"
Nov 02 08:26:10.446647 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:10.446625    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb"]
Nov 02 08:26:10.449055 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:26:10.449019    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaec294ed_60a8_4af4_ba50_faf7cfc61f6e.slice/crio-2ceb9686e422e17afd3bfe4b5e2ff554efdf7fbbd0c8ff92e8a60cad620a6106 WatchSource:0}: Error finding container 2ceb9686e422e17afd3bfe4b5e2ff554efdf7fbbd0c8ff92e8a60cad620a6106: Status 404 returned error can't find the container with id 2ceb9686e422e17afd3bfe4b5e2ff554efdf7fbbd0c8ff92e8a60cad620a6106
Nov 02 08:26:10.878959 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:10.878916    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb" event={"ID":"aec294ed-60a8-4af4-ba50-faf7cfc61f6e","Type":"ContainerStarted","Data":"bbe1eb751a8cf0fbc2fc85961f96b42d591b0d6b0577930c1b95746db00da08c"}
Nov 02 08:26:10.879366 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:10.878970    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb" event={"ID":"aec294ed-60a8-4af4-ba50-faf7cfc61f6e","Type":"ContainerStarted","Data":"2ceb9686e422e17afd3bfe4b5e2ff554efdf7fbbd0c8ff92e8a60cad620a6106"}
Nov 02 08:26:10.988476 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:10.988422    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb" podStartSLOduration=1.988408385 podStartE2EDuration="1.988408385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:26:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:26:10.986728438 +0000 UTC m=+1160.745157183" watchObservedRunningTime="2026-11-02 08:26:10.988408385 +0000 UTC m=+1160.746837170"
Nov 02 08:26:11.013481 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:11.013449    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb"
Nov 02 08:26:20.013503 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:20.013467    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb"
Nov 02 08:26:20.026545 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:20.026515    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb"
Nov 02 08:26:20.948015 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:20.947981    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb"
Nov 02 08:26:30.840221 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:26:30.840161    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:26:50.471172 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:50.471143    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q_f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae/extract/0.log"
Nov 02 08:26:50.474130 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:50.474109    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q_f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae/extract/0.log"
Nov 02 08:26:50.484753 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:50.484730    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb77f_3e7ae74c-fcd8-4820-a8b7-769a5fff9f15/ovn-acl-logging/0.log"
Nov 02 08:26:50.488497 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:26:50.488480    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb77f_3e7ae74c-fcd8-4820-a8b7-769a5fff9f15/ovn-acl-logging/0.log"
Nov 02 08:27:00.823290 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:27:00.823256    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:27:28.763743 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:28.763713    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b"]
Nov 02 08:27:28.767286 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:28.767263    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b"
Nov 02 08:27:28.855386 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:28.855346    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d95e342b-b6a4-47cb-9fa2-eadccc09a579-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b\" (UID: \"d95e342b-b6a4-47cb-9fa2-eadccc09a579\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b"
Nov 02 08:27:28.855542 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:28.855491    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz6pf\" (UniqueName: \"kubernetes.io/projected/d95e342b-b6a4-47cb-9fa2-eadccc09a579-kube-api-access-wz6pf\") pod \"payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b\" (UID: \"d95e342b-b6a4-47cb-9fa2-eadccc09a579\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b"
Nov 02 08:27:28.866092 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:28.866068    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-cba6f9af-dockercfg-2s9tv\""
Nov 02 08:27:28.866358 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:28.866341    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-cba6f9af\""
Nov 02 08:27:28.867889 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:28.867859    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b"]
Nov 02 08:27:28.956178 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:28.956144    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz6pf\" (UniqueName: \"kubernetes.io/projected/d95e342b-b6a4-47cb-9fa2-eadccc09a579-kube-api-access-wz6pf\") pod \"payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b\" (UID: \"d95e342b-b6a4-47cb-9fa2-eadccc09a579\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b"
Nov 02 08:27:28.956341 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:28.956281    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d95e342b-b6a4-47cb-9fa2-eadccc09a579-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b\" (UID: \"d95e342b-b6a4-47cb-9fa2-eadccc09a579\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b"
Nov 02 08:27:28.956960 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:28.956942    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d95e342b-b6a4-47cb-9fa2-eadccc09a579-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b\" (UID: \"d95e342b-b6a4-47cb-9fa2-eadccc09a579\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b"
Nov 02 08:27:29.009668 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:29.009636    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz6pf\" (UniqueName: \"kubernetes.io/projected/d95e342b-b6a4-47cb-9fa2-eadccc09a579-kube-api-access-wz6pf\") pod \"payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b\" (UID: \"d95e342b-b6a4-47cb-9fa2-eadccc09a579\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b"
Nov 02 08:27:29.080653 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:29.080579    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b"
Nov 02 08:27:29.441108 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:29.441085    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b"]
Nov 02 08:27:29.443099 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:27:29.443063    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd95e342b_b6a4_47cb_9fa2_eadccc09a579.slice/crio-9a0ef64ce53d2b4575eb137632ab8436ec28085de0ba8c21667ea770ca4c8317 WatchSource:0}: Error finding container 9a0ef64ce53d2b4575eb137632ab8436ec28085de0ba8c21667ea770ca4c8317: Status 404 returned error can't find the container with id 9a0ef64ce53d2b4575eb137632ab8436ec28085de0ba8c21667ea770ca4c8317
Nov 02 08:27:30.320744 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:30.320712    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b" event={"ID":"d95e342b-b6a4-47cb-9fa2-eadccc09a579","Type":"ContainerStarted","Data":"1dfaad8db248ff10b745cc31db6f8b68a7926d840c791d2669f38dee18a047f2"}
Nov 02 08:27:30.321268 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:30.320763    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b" event={"ID":"d95e342b-b6a4-47cb-9fa2-eadccc09a579","Type":"ContainerStarted","Data":"9a0ef64ce53d2b4575eb137632ab8436ec28085de0ba8c21667ea770ca4c8317"}
Nov 02 08:27:30.321268 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:30.320862    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b"
Nov 02 08:27:30.431725 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:30.431668    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b" podStartSLOduration=2.431651763 podStartE2EDuration="2.431651763s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:27:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:27:30.429265654 +0000 UTC m=+1240.187694386" watchObservedRunningTime="2026-11-02 08:27:30.431651763 +0000 UTC m=+1240.190080496"
Nov 02 08:27:30.822420 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:27:30.822385    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:27:41.330387 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:41.330353    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b"
Nov 02 08:27:48.007562 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:48.007525    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp"]
Nov 02 08:27:48.011546 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:48.011522    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp"
Nov 02 08:27:48.067073 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:48.067038    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-8e6407\"/\"kube-root-ca.crt\""
Nov 02 08:27:48.097416 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:48.094561    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b0898b2-a56c-4884-bbac-95d071b8bc00-model-cache\") pod \"distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp\" (UID: \"1b0898b2-a56c-4884-bbac-95d071b8bc00\") " pod="e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp"
Nov 02 08:27:48.097416 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:48.094683    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsq7n\" (UniqueName: \"kubernetes.io/projected/1b0898b2-a56c-4884-bbac-95d071b8bc00-kube-api-access-lsq7n\") pod \"distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp\" (UID: \"1b0898b2-a56c-4884-bbac-95d071b8bc00\") " pod="e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp"
Nov 02 08:27:48.097416 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:48.094722    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b0898b2-a56c-4884-bbac-95d071b8bc00-dshm\") pod \"distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp\" (UID: \"1b0898b2-a56c-4884-bbac-95d071b8bc00\") " pod="e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp"
Nov 02 08:27:48.097416 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:48.094793    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b0898b2-a56c-4884-bbac-95d071b8bc00-home\") pod \"distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp\" (UID: \"1b0898b2-a56c-4884-bbac-95d071b8bc00\") " pod="e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp"
Nov 02 08:27:48.097416 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:48.094851    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b0898b2-a56c-4884-bbac-95d071b8bc00-tmp-dir\") pod \"distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp\" (UID: \"1b0898b2-a56c-4884-bbac-95d071b8bc00\") " pod="e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp"
Nov 02 08:27:48.097416 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:48.094916    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b0898b2-a56c-4884-bbac-95d071b8bc00-tls-certs\") pod \"distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp\" (UID: \"1b0898b2-a56c-4884-bbac-95d071b8bc00\") " pod="e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp"
Nov 02 08:27:48.106821 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:48.106794    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-8e6407\"/\"openshift-service-ca.crt\""
Nov 02 08:27:48.106963 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:48.106930    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-8e6407\"/\"default-dockercfg-zz4bc\""
Nov 02 08:27:48.107040 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:48.107023    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-8e6407\"/\"distinct-2-w4-8e6407-kserve-self-signed-certs\""
Nov 02 08:27:48.109033 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:48.109015    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp"]
Nov 02 08:27:48.196468 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:48.196436    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsq7n\" (UniqueName: \"kubernetes.io/projected/1b0898b2-a56c-4884-bbac-95d071b8bc00-kube-api-access-lsq7n\") pod \"distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp\" (UID: \"1b0898b2-a56c-4884-bbac-95d071b8bc00\") " pod="e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp"
Nov 02 08:27:48.196631 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:48.196473    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b0898b2-a56c-4884-bbac-95d071b8bc00-dshm\") pod \"distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp\" (UID: \"1b0898b2-a56c-4884-bbac-95d071b8bc00\") " pod="e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp"
Nov 02 08:27:48.196721 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:48.196623    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b0898b2-a56c-4884-bbac-95d071b8bc00-home\") pod \"distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp\" (UID: \"1b0898b2-a56c-4884-bbac-95d071b8bc00\") " pod="e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp"
Nov 02 08:27:48.196721 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:48.196694    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b0898b2-a56c-4884-bbac-95d071b8bc00-tmp-dir\") pod \"distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp\" (UID: \"1b0898b2-a56c-4884-bbac-95d071b8bc00\") " pod="e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp"
Nov 02 08:27:48.196835 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:48.196746    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b0898b2-a56c-4884-bbac-95d071b8bc00-tls-certs\") pod \"distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp\" (UID: \"1b0898b2-a56c-4884-bbac-95d071b8bc00\") " pod="e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp"
Nov 02 08:27:48.196901 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:48.196833    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b0898b2-a56c-4884-bbac-95d071b8bc00-model-cache\") pod \"distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp\" (UID: \"1b0898b2-a56c-4884-bbac-95d071b8bc00\") " pod="e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp"
Nov 02 08:27:48.197111 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:48.197091    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b0898b2-a56c-4884-bbac-95d071b8bc00-tmp-dir\") pod \"distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp\" (UID: \"1b0898b2-a56c-4884-bbac-95d071b8bc00\") " pod="e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp"
Nov 02 08:27:48.197208 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:48.197144    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b0898b2-a56c-4884-bbac-95d071b8bc00-home\") pod \"distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp\" (UID: \"1b0898b2-a56c-4884-bbac-95d071b8bc00\") " pod="e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp"
Nov 02 08:27:48.197208 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:48.197190    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b0898b2-a56c-4884-bbac-95d071b8bc00-model-cache\") pod \"distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp\" (UID: \"1b0898b2-a56c-4884-bbac-95d071b8bc00\") " pod="e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp"
Nov 02 08:27:48.199106 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:48.199081    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b0898b2-a56c-4884-bbac-95d071b8bc00-dshm\") pod \"distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp\" (UID: \"1b0898b2-a56c-4884-bbac-95d071b8bc00\") " pod="e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp"
Nov 02 08:27:48.199252 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:48.199236    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b0898b2-a56c-4884-bbac-95d071b8bc00-tls-certs\") pod \"distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp\" (UID: \"1b0898b2-a56c-4884-bbac-95d071b8bc00\") " pod="e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp"
Nov 02 08:27:48.252770 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:48.252744    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsq7n\" (UniqueName: \"kubernetes.io/projected/1b0898b2-a56c-4884-bbac-95d071b8bc00-kube-api-access-lsq7n\") pod \"distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp\" (UID: \"1b0898b2-a56c-4884-bbac-95d071b8bc00\") " pod="e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp"
Nov 02 08:27:48.323701 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:48.323620    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp"
Nov 02 08:27:48.757200 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:48.757168    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp"]
Nov 02 08:27:48.760774 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:27:48.760737    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b0898b2_a56c_4884_bbac_95d071b8bc00.slice/crio-edb0ffa22e49fa8d55cf680b75b0d1ec3d60604333f21a4be3b4f2dd25341e77 WatchSource:0}: Error finding container edb0ffa22e49fa8d55cf680b75b0d1ec3d60604333f21a4be3b4f2dd25341e77: Status 404 returned error can't find the container with id edb0ffa22e49fa8d55cf680b75b0d1ec3d60604333f21a4be3b4f2dd25341e77
Nov 02 08:27:49.432944 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:49.432902    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp" event={"ID":"1b0898b2-a56c-4884-bbac-95d071b8bc00","Type":"ContainerStarted","Data":"c9b0e424017c602562834b9ac6ef2a658c32709de7ab3629b63a92e8cfaba6ea"}
Nov 02 08:27:49.433422 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:49.432962    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp" event={"ID":"1b0898b2-a56c-4884-bbac-95d071b8bc00","Type":"ContainerStarted","Data":"edb0ffa22e49fa8d55cf680b75b0d1ec3d60604333f21a4be3b4f2dd25341e77"}
Nov 02 08:27:49.542866 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:49.542817    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp" podStartSLOduration=2.542803925 podStartE2EDuration="2.542803925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:27:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:27:49.542164205 +0000 UTC m=+1259.300592937" watchObservedRunningTime="2026-11-02 08:27:49.542803925 +0000 UTC m=+1259.301232657"
Nov 02 08:27:50.324610 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:50.324581    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp"
Nov 02 08:27:58.325122 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:58.325088    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp"
Nov 02 08:27:58.337815 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:58.337788    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp"
Nov 02 08:27:58.498551 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:27:58.498518    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp"
Nov 02 08:28:00.823122 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:28:00.823086    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:28:02.073453 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:02.073403    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7"]
Nov 02 08:28:02.085381 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:02.085344    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7"
Nov 02 08:28:02.178951 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:02.178909    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b41d3a86-c6af-4e00-9efa-5607bab05e94-maas-api-tls\") pod \"maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7\" (UID: \"b41d3a86-c6af-4e00-9efa-5607bab05e94\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7"
Nov 02 08:28:02.179142 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:02.179026    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b41d3a86-c6af-4e00-9efa-5607bab05e94-openshift-service-ca\") pod \"maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7\" (UID: \"b41d3a86-c6af-4e00-9efa-5607bab05e94\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7"
Nov 02 08:28:02.179142 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:02.179076    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b41d3a86-c6af-4e00-9efa-5607bab05e94-metrics-certs\") pod \"maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7\" (UID: \"b41d3a86-c6af-4e00-9efa-5607bab05e94\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7"
Nov 02 08:28:02.179268 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:02.179242    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75h45\" (UniqueName: \"kubernetes.io/projected/b41d3a86-c6af-4e00-9efa-5607bab05e94-kube-api-access-75h45\") pod \"maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7\" (UID: \"b41d3a86-c6af-4e00-9efa-5607bab05e94\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7"
Nov 02 08:28:02.180672 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:02.180656    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-cba6f9af-serving-cert\""
Nov 02 08:28:02.182536 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:02.182512    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7"]
Nov 02 08:28:02.280893 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:02.280848    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75h45\" (UniqueName: \"kubernetes.io/projected/b41d3a86-c6af-4e00-9efa-5607bab05e94-kube-api-access-75h45\") pod \"maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7\" (UID: \"b41d3a86-c6af-4e00-9efa-5607bab05e94\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7"
Nov 02 08:28:02.281097 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:02.280948    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b41d3a86-c6af-4e00-9efa-5607bab05e94-maas-api-tls\") pod \"maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7\" (UID: \"b41d3a86-c6af-4e00-9efa-5607bab05e94\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7"
Nov 02 08:28:02.281097 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:02.280988    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b41d3a86-c6af-4e00-9efa-5607bab05e94-openshift-service-ca\") pod \"maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7\" (UID: \"b41d3a86-c6af-4e00-9efa-5607bab05e94\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7"
Nov 02 08:28:02.281097 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:02.281017    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b41d3a86-c6af-4e00-9efa-5607bab05e94-metrics-certs\") pod \"maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7\" (UID: \"b41d3a86-c6af-4e00-9efa-5607bab05e94\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7"
Nov 02 08:28:02.281279 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:28:02.281108    6210 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-serving-cert: secret "maas-api-e2e-mt-cba6f9af-serving-cert" not found
Nov 02 08:28:02.281279 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:28:02.281186    6210 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b41d3a86-c6af-4e00-9efa-5607bab05e94-maas-api-tls podName:b41d3a86-c6af-4e00-9efa-5607bab05e94 nodeName:}" failed. No retries permitted until 2026-11-02 08:28:02.781165368 +0000 UTC m=+1272.539594092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b41d3a86-c6af-4e00-9efa-5607bab05e94-maas-api-tls") pod "maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7" (UID: "b41d3a86-c6af-4e00-9efa-5607bab05e94") : secret "maas-api-e2e-mt-cba6f9af-serving-cert" not found
Nov 02 08:28:02.281645 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:02.281624    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b41d3a86-c6af-4e00-9efa-5607bab05e94-openshift-service-ca\") pod \"maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7\" (UID: \"b41d3a86-c6af-4e00-9efa-5607bab05e94\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7"
Nov 02 08:28:02.283445 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:02.283423    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b41d3a86-c6af-4e00-9efa-5607bab05e94-metrics-certs\") pod \"maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7\" (UID: \"b41d3a86-c6af-4e00-9efa-5607bab05e94\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7"
Nov 02 08:28:02.344247 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:02.344150    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75h45\" (UniqueName: \"kubernetes.io/projected/b41d3a86-c6af-4e00-9efa-5607bab05e94-kube-api-access-75h45\") pod \"maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7\" (UID: \"b41d3a86-c6af-4e00-9efa-5607bab05e94\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7"
Nov 02 08:28:02.795304 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:02.795264    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b41d3a86-c6af-4e00-9efa-5607bab05e94-maas-api-tls\") pod \"maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7\" (UID: \"b41d3a86-c6af-4e00-9efa-5607bab05e94\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7"
Nov 02 08:28:02.797726 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:02.797696    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b41d3a86-c6af-4e00-9efa-5607bab05e94-maas-api-tls\") pod \"maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7\" (UID: \"b41d3a86-c6af-4e00-9efa-5607bab05e94\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7"
Nov 02 08:28:02.998975 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:02.998936    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7"
Nov 02 08:28:03.366554 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:03.366523    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7"]
Nov 02 08:28:03.369241 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:28:03.369198    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb41d3a86_c6af_4e00_9efa_5607bab05e94.slice/crio-5a110577567648b2446fa46c324282c7f849618c230c6facfa51204cc3128efc WatchSource:0}: Error finding container 5a110577567648b2446fa46c324282c7f849618c230c6facfa51204cc3128efc: Status 404 returned error can't find the container with id 5a110577567648b2446fa46c324282c7f849618c230c6facfa51204cc3128efc
Nov 02 08:28:03.370731 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:03.370714    6210 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 02 08:28:03.523731 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:03.523686    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7" event={"ID":"b41d3a86-c6af-4e00-9efa-5607bab05e94","Type":"ContainerStarted","Data":"5a110577567648b2446fa46c324282c7f849618c230c6facfa51204cc3128efc"}
Nov 02 08:28:04.531895 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:04.531837    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7" event={"ID":"b41d3a86-c6af-4e00-9efa-5607bab05e94","Type":"ContainerStarted","Data":"56c1cc8f55f56ef1d5f299c934d0f96b25ce97aeb591f36a7a4a7a22e14eec2c"}
Nov 02 08:28:04.532286 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:04.531990    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7"
Nov 02 08:28:04.644349 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:04.644252    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7" podStartSLOduration=1.659465409 podStartE2EDuration="2.644239737s" totalImagesPullingTime="984.774328ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:28:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:28:04.64179092 +0000 UTC m=+1274.400219652" watchObservedRunningTime="2026-11-02 08:28:04.644239737 +0000 UTC m=+1274.402668470"
Nov 02 08:28:10.548737 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:10.548704    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7"
Nov 02 08:28:11.759975 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:11.759931    6210 prober.go:122] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.us-west-2.compute.internal" podUID="5efd6818a2d6de09c2e33ba0444837d8" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 08:28:21.066154 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:21.066122    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"]
Nov 02 08:28:21.070261 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:21.070239    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"
Nov 02 08:28:21.126130 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:21.126097    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-8e6407-openshift-default-dockercfg-lcnm5\""
Nov 02 08:28:21.155471 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:21.155434    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/437a1d86-4301-4d66-864a-2bcb6efae04c-credential-socket\") pod \"e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt\" (UID: \"437a1d86-4301-4d66-864a-2bcb6efae04c\") " pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"
Nov 02 08:28:21.155471 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:21.155474    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtr6d\" (UniqueName: \"kubernetes.io/projected/437a1d86-4301-4d66-864a-2bcb6efae04c-kube-api-access-rtr6d\") pod \"e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt\" (UID: \"437a1d86-4301-4d66-864a-2bcb6efae04c\") " pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"
Nov 02 08:28:21.155664 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:21.155515    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/437a1d86-4301-4d66-864a-2bcb6efae04c-istiod-ca-cert\") pod \"e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt\" (UID: \"437a1d86-4301-4d66-864a-2bcb6efae04c\") " pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"
Nov 02 08:28:21.155664 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:21.155621    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/437a1d86-4301-4d66-864a-2bcb6efae04c-istio-podinfo\") pod \"e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt\" (UID: \"437a1d86-4301-4d66-864a-2bcb6efae04c\") " pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"
Nov 02 08:28:21.155736 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:21.155675    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/437a1d86-4301-4d66-864a-2bcb6efae04c-workload-certs\") pod \"e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt\" (UID: \"437a1d86-4301-4d66-864a-2bcb6efae04c\") " pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"
Nov 02 08:28:21.155736 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:21.155721    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/437a1d86-4301-4d66-864a-2bcb6efae04c-istio-data\") pod \"e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt\" (UID: \"437a1d86-4301-4d66-864a-2bcb6efae04c\") " pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"
Nov 02 08:28:21.155840 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:21.155825    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/437a1d86-4301-4d66-864a-2bcb6efae04c-istio-envoy\") pod \"e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt\" (UID: \"437a1d86-4301-4d66-864a-2bcb6efae04c\") " pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"
Nov 02 08:28:21.155909 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:21.155871    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/437a1d86-4301-4d66-864a-2bcb6efae04c-workload-socket\") pod \"e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt\" (UID: \"437a1d86-4301-4d66-864a-2bcb6efae04c\") " pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"
Nov 02 08:28:21.155965 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:21.155915    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/437a1d86-4301-4d66-864a-2bcb6efae04c-istio-token\") pod \"e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt\" (UID: \"437a1d86-4301-4d66-864a-2bcb6efae04c\") " pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"
Nov 02 08:28:21.171175 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:21.171148    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"]
Nov 02 08:28:21.256538 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:21.256502    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/437a1d86-4301-4d66-864a-2bcb6efae04c-istio-token\") pod \"e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt\" (UID: \"437a1d86-4301-4d66-864a-2bcb6efae04c\") " pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"
Nov 02 08:28:21.256746 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:21.256557    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/437a1d86-4301-4d66-864a-2bcb6efae04c-credential-socket\") pod \"e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt\" (UID: \"437a1d86-4301-4d66-864a-2bcb6efae04c\") " pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"
Nov 02 08:28:21.256746 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:21.256669    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtr6d\" (UniqueName: \"kubernetes.io/projected/437a1d86-4301-4d66-864a-2bcb6efae04c-kube-api-access-rtr6d\") pod \"e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt\" (UID: \"437a1d86-4301-4d66-864a-2bcb6efae04c\") " pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"
Nov 02 08:28:21.256746 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:21.256741    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/437a1d86-4301-4d66-864a-2bcb6efae04c-istiod-ca-cert\") pod \"e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt\" (UID: \"437a1d86-4301-4d66-864a-2bcb6efae04c\") " pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"
Nov 02 08:28:21.256980 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:21.256787    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/437a1d86-4301-4d66-864a-2bcb6efae04c-istio-podinfo\") pod \"e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt\" (UID: \"437a1d86-4301-4d66-864a-2bcb6efae04c\") " pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"
Nov 02 08:28:21.256980 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:21.256815    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/437a1d86-4301-4d66-864a-2bcb6efae04c-workload-certs\") pod \"e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt\" (UID: \"437a1d86-4301-4d66-864a-2bcb6efae04c\") " pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"
Nov 02 08:28:21.256980 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:21.256916    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/437a1d86-4301-4d66-864a-2bcb6efae04c-istio-data\") pod \"e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt\" (UID: \"437a1d86-4301-4d66-864a-2bcb6efae04c\") " pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"
Nov 02 08:28:21.257145 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:21.256993    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/437a1d86-4301-4d66-864a-2bcb6efae04c-istio-envoy\") pod \"e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt\" (UID: \"437a1d86-4301-4d66-864a-2bcb6efae04c\") " pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"
Nov 02 08:28:21.257145 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:21.257006    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/437a1d86-4301-4d66-864a-2bcb6efae04c-credential-socket\") pod \"e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt\" (UID: \"437a1d86-4301-4d66-864a-2bcb6efae04c\") " pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"
Nov 02 08:28:21.257145 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:21.257078    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/437a1d86-4301-4d66-864a-2bcb6efae04c-workload-socket\") pod \"e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt\" (UID: \"437a1d86-4301-4d66-864a-2bcb6efae04c\") " pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"
Nov 02 08:28:21.257308 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:21.257264    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/437a1d86-4301-4d66-864a-2bcb6efae04c-workload-certs\") pod \"e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt\" (UID: \"437a1d86-4301-4d66-864a-2bcb6efae04c\") " pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"
Nov 02 08:28:21.257368 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:21.257349    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/437a1d86-4301-4d66-864a-2bcb6efae04c-istio-data\") pod \"e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt\" (UID: \"437a1d86-4301-4d66-864a-2bcb6efae04c\") " pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"
Nov 02 08:28:21.257428 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:21.257384    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/437a1d86-4301-4d66-864a-2bcb6efae04c-workload-socket\") pod \"e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt\" (UID: \"437a1d86-4301-4d66-864a-2bcb6efae04c\") " pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"
Nov 02 08:28:21.257603 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:21.257576    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/437a1d86-4301-4d66-864a-2bcb6efae04c-istiod-ca-cert\") pod \"e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt\" (UID: \"437a1d86-4301-4d66-864a-2bcb6efae04c\") " pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"
Nov 02 08:28:21.259250 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:21.259218    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/437a1d86-4301-4d66-864a-2bcb6efae04c-istio-envoy\") pod \"e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt\" (UID: \"437a1d86-4301-4d66-864a-2bcb6efae04c\") " pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"
Nov 02 08:28:21.259643 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:21.259624    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/437a1d86-4301-4d66-864a-2bcb6efae04c-istio-podinfo\") pod \"e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt\" (UID: \"437a1d86-4301-4d66-864a-2bcb6efae04c\") " pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"
Nov 02 08:28:21.318092 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:21.318020    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/437a1d86-4301-4d66-864a-2bcb6efae04c-istio-token\") pod \"e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt\" (UID: \"437a1d86-4301-4d66-864a-2bcb6efae04c\") " pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"
Nov 02 08:28:21.318092 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:21.318079    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtr6d\" (UniqueName: \"kubernetes.io/projected/437a1d86-4301-4d66-864a-2bcb6efae04c-kube-api-access-rtr6d\") pod \"e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt\" (UID: \"437a1d86-4301-4d66-864a-2bcb6efae04c\") " pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"
Nov 02 08:28:21.383729 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:21.383694    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"
Nov 02 08:28:21.807241 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:21.807215    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"]
Nov 02 08:28:21.809336 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:28:21.809303    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod437a1d86_4301_4d66_864a_2bcb6efae04c.slice/crio-ed077eab93287435e7f97ffceee33988cdcdbcf6e76d4aeb1d712f2db122f6d8 WatchSource:0}: Error finding container ed077eab93287435e7f97ffceee33988cdcdbcf6e76d4aeb1d712f2db122f6d8: Status 404 returned error can't find the container with id ed077eab93287435e7f97ffceee33988cdcdbcf6e76d4aeb1d712f2db122f6d8
Nov 02 08:28:21.811754 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:21.811721    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:28:21.811830 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:21.811785    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:28:21.811830 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:21.811810    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:28:22.650455 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:22.650423    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt" event={"ID":"437a1d86-4301-4d66-864a-2bcb6efae04c","Type":"ContainerStarted","Data":"9ac203f0a4deb418bb03e9f086d8d696f44778932cd085fa5fe63f5522666f22"}
Nov 02 08:28:22.650825 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:22.650483    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt" event={"ID":"437a1d86-4301-4d66-864a-2bcb6efae04c","Type":"ContainerStarted","Data":"ed077eab93287435e7f97ffceee33988cdcdbcf6e76d4aeb1d712f2db122f6d8"}
Nov 02 08:28:22.855157 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:22.855109    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt" podStartSLOduration=1.855095575 podStartE2EDuration="1.855095575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:28:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:28:22.810316741 +0000 UTC m=+1292.568745474" watchObservedRunningTime="2026-11-02 08:28:22.855095575 +0000 UTC m=+1292.613524309"
Nov 02 08:28:23.384074 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:23.384040    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"
Nov 02 08:28:23.385539 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:23.385518    6210 patch_prober.go:29] interesting pod/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Nov 02 08:28:23.385603 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:23.385562    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt" podUID="437a1d86-4301-4d66-864a-2bcb6efae04c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Nov 02 08:28:24.384125 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:24.384042    6210 patch_prober.go:29] interesting pod/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Nov 02 08:28:24.384125 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:24.384104    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt" podUID="437a1d86-4301-4d66-864a-2bcb6efae04c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Nov 02 08:28:25.384142 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:25.384101    6210 patch_prober.go:29] interesting pod/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Nov 02 08:28:25.384529 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:25.384168    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt" podUID="437a1d86-4301-4d66-864a-2bcb6efae04c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Nov 02 08:28:25.870492 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:25.870456    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"]
Nov 02 08:28:25.874669 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:25.874647    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"
Nov 02 08:28:25.924391 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:25.924354    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-zmgsp\""
Nov 02 08:28:25.973869 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:25.973730    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"]
Nov 02 08:28:26.032285 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:26.032249    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84913035-795c-471e-8c5f-c9d23a3703ab-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-fkv8m\" (UID: \"84913035-795c-471e-8c5f-c9d23a3703ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"
Nov 02 08:28:26.032285 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:26.032293    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9l5w\" (UniqueName: \"kubernetes.io/projected/84913035-795c-471e-8c5f-c9d23a3703ab-kube-api-access-l9l5w\") pod \"maas-default-gateway-openshift-default-769df7846c-fkv8m\" (UID: \"84913035-795c-471e-8c5f-c9d23a3703ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"
Nov 02 08:28:26.032558 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:26.032324    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84913035-795c-471e-8c5f-c9d23a3703ab-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-fkv8m\" (UID: \"84913035-795c-471e-8c5f-c9d23a3703ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"
Nov 02 08:28:26.032558 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:26.032479    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84913035-795c-471e-8c5f-c9d23a3703ab-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-fkv8m\" (UID: \"84913035-795c-471e-8c5f-c9d23a3703ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"
Nov 02 08:28:26.032558 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:26.032503    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84913035-795c-471e-8c5f-c9d23a3703ab-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-fkv8m\" (UID: \"84913035-795c-471e-8c5f-c9d23a3703ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"
Nov 02 08:28:26.032712 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:26.032600    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84913035-795c-471e-8c5f-c9d23a3703ab-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-fkv8m\" (UID: \"84913035-795c-471e-8c5f-c9d23a3703ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"
Nov 02 08:28:26.032764 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:26.032712    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84913035-795c-471e-8c5f-c9d23a3703ab-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-fkv8m\" (UID: \"84913035-795c-471e-8c5f-c9d23a3703ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"
Nov 02 08:28:26.032815 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:26.032785    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84913035-795c-471e-8c5f-c9d23a3703ab-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-fkv8m\" (UID: \"84913035-795c-471e-8c5f-c9d23a3703ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"
Nov 02 08:28:26.032873 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:26.032830    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84913035-795c-471e-8c5f-c9d23a3703ab-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-fkv8m\" (UID: \"84913035-795c-471e-8c5f-c9d23a3703ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"
Nov 02 08:28:26.133834 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:26.133742    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84913035-795c-471e-8c5f-c9d23a3703ab-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-fkv8m\" (UID: \"84913035-795c-471e-8c5f-c9d23a3703ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"
Nov 02 08:28:26.134057 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:26.133843    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84913035-795c-471e-8c5f-c9d23a3703ab-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-fkv8m\" (UID: \"84913035-795c-471e-8c5f-c9d23a3703ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"
Nov 02 08:28:26.134057 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:26.133929    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84913035-795c-471e-8c5f-c9d23a3703ab-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-fkv8m\" (UID: \"84913035-795c-471e-8c5f-c9d23a3703ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"
Nov 02 08:28:26.134057 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:26.133982    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84913035-795c-471e-8c5f-c9d23a3703ab-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-fkv8m\" (UID: \"84913035-795c-471e-8c5f-c9d23a3703ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"
Nov 02 08:28:26.134057 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:26.134016    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9l5w\" (UniqueName: \"kubernetes.io/projected/84913035-795c-471e-8c5f-c9d23a3703ab-kube-api-access-l9l5w\") pod \"maas-default-gateway-openshift-default-769df7846c-fkv8m\" (UID: \"84913035-795c-471e-8c5f-c9d23a3703ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"
Nov 02 08:28:26.134057 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:26.134045    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84913035-795c-471e-8c5f-c9d23a3703ab-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-fkv8m\" (UID: \"84913035-795c-471e-8c5f-c9d23a3703ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"
Nov 02 08:28:26.134321 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:26.134105    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84913035-795c-471e-8c5f-c9d23a3703ab-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-fkv8m\" (UID: \"84913035-795c-471e-8c5f-c9d23a3703ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"
Nov 02 08:28:26.134321 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:26.134135    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84913035-795c-471e-8c5f-c9d23a3703ab-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-fkv8m\" (UID: \"84913035-795c-471e-8c5f-c9d23a3703ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"
Nov 02 08:28:26.134321 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:26.134165    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84913035-795c-471e-8c5f-c9d23a3703ab-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-fkv8m\" (UID: \"84913035-795c-471e-8c5f-c9d23a3703ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"
Nov 02 08:28:26.134321 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:26.134202    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84913035-795c-471e-8c5f-c9d23a3703ab-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-fkv8m\" (UID: \"84913035-795c-471e-8c5f-c9d23a3703ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"
Nov 02 08:28:26.134528 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:26.134341    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84913035-795c-471e-8c5f-c9d23a3703ab-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-fkv8m\" (UID: \"84913035-795c-471e-8c5f-c9d23a3703ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"
Nov 02 08:28:26.134528 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:26.134513    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84913035-795c-471e-8c5f-c9d23a3703ab-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-fkv8m\" (UID: \"84913035-795c-471e-8c5f-c9d23a3703ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"
Nov 02 08:28:26.134636 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:26.134572    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84913035-795c-471e-8c5f-c9d23a3703ab-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-fkv8m\" (UID: \"84913035-795c-471e-8c5f-c9d23a3703ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"
Nov 02 08:28:26.134817 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:26.134794    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84913035-795c-471e-8c5f-c9d23a3703ab-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-fkv8m\" (UID: \"84913035-795c-471e-8c5f-c9d23a3703ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"
Nov 02 08:28:26.136373 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:26.136346    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84913035-795c-471e-8c5f-c9d23a3703ab-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-fkv8m\" (UID: \"84913035-795c-471e-8c5f-c9d23a3703ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"
Nov 02 08:28:26.136499 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:26.136480    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84913035-795c-471e-8c5f-c9d23a3703ab-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-fkv8m\" (UID: \"84913035-795c-471e-8c5f-c9d23a3703ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"
Nov 02 08:28:26.187743 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:26.187708    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84913035-795c-471e-8c5f-c9d23a3703ab-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-fkv8m\" (UID: \"84913035-795c-471e-8c5f-c9d23a3703ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"
Nov 02 08:28:26.187894 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:26.187865    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9l5w\" (UniqueName: \"kubernetes.io/projected/84913035-795c-471e-8c5f-c9d23a3703ab-kube-api-access-l9l5w\") pod \"maas-default-gateway-openshift-default-769df7846c-fkv8m\" (UID: \"84913035-795c-471e-8c5f-c9d23a3703ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"
Nov 02 08:28:26.384690 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:26.384590    6210 patch_prober.go:29] interesting pod/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Nov 02 08:28:26.384690 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:26.384655    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt" podUID="437a1d86-4301-4d66-864a-2bcb6efae04c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Nov 02 08:28:26.488196 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:26.488165    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"
Nov 02 08:28:26.934307 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:26.934276    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"]
Nov 02 08:28:26.971773 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:28:26.971744    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84913035_795c_471e_8c5f_c9d23a3703ab.slice/crio-9bc80c0103cc15ec0fc54fbba0c7e3d7ac063fe109786a7c949ca16ccd301318 WatchSource:0}: Error finding container 9bc80c0103cc15ec0fc54fbba0c7e3d7ac063fe109786a7c949ca16ccd301318: Status 404 returned error can't find the container with id 9bc80c0103cc15ec0fc54fbba0c7e3d7ac063fe109786a7c949ca16ccd301318
Nov 02 08:28:26.974348 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:26.974314    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:28:26.974416 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:26.974388    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:28:26.974453 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:26.974419    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:28:27.384583 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:27.384541    6210 patch_prober.go:29] interesting pod/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Nov 02 08:28:27.384763 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:27.384601    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt" podUID="437a1d86-4301-4d66-864a-2bcb6efae04c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Nov 02 08:28:27.681404 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:27.681304    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m" event={"ID":"84913035-795c-471e-8c5f-c9d23a3703ab","Type":"ContainerStarted","Data":"21f1528b1a8b8f722bd529e8418b4a98aeb32432e871af09652ab33697d8e5fc"}
Nov 02 08:28:27.681404 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:27.681382    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m" event={"ID":"84913035-795c-471e-8c5f-c9d23a3703ab","Type":"ContainerStarted","Data":"9bc80c0103cc15ec0fc54fbba0c7e3d7ac063fe109786a7c949ca16ccd301318"}
Nov 02 08:28:27.895002 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:27.894944    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m" podStartSLOduration=2.8949303730000002 podStartE2EDuration="2.894930373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:28:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:28:27.84829449 +0000 UTC m=+1297.606723226" watchObservedRunningTime="2026-11-02 08:28:27.894930373 +0000 UTC m=+1297.653359104"
Nov 02 08:28:28.384109 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:28.384070    6210 patch_prober.go:29] interesting pod/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Nov 02 08:28:28.384272 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:28.384135    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt" podUID="437a1d86-4301-4d66-864a-2bcb6efae04c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Nov 02 08:28:28.488424 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:28.488388    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"
Nov 02 08:28:28.489735 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:28.489703    6210 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-fkv8m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Nov 02 08:28:28.489861 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:28.489758    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m" podUID="84913035-795c-471e-8c5f-c9d23a3703ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Nov 02 08:28:29.389757 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:29.389727    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"
Nov 02 08:28:29.390102 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:29.390073    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"
Nov 02 08:28:29.390894 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:29.390858    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"
Nov 02 08:28:29.488429 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:29.488400    6210 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-fkv8m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Nov 02 08:28:29.488597 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:29.488457    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m" podUID="84913035-795c-471e-8c5f-c9d23a3703ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Nov 02 08:28:30.488494 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:30.488460    6210 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-fkv8m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Nov 02 08:28:30.488652 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:30.488525    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m" podUID="84913035-795c-471e-8c5f-c9d23a3703ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Nov 02 08:28:30.853624 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:28:30.853538    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:28:31.488953 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:31.488912    6210 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-fkv8m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Nov 02 08:28:31.489440 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:31.488971    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m" podUID="84913035-795c-471e-8c5f-c9d23a3703ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Nov 02 08:28:32.488530 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:32.488489    6210 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-fkv8m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Nov 02 08:28:32.488820 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:32.488545    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m" podUID="84913035-795c-471e-8c5f-c9d23a3703ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Nov 02 08:28:33.488561 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:33.488520    6210 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-fkv8m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Nov 02 08:28:33.489016 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:33.488578    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m" podUID="84913035-795c-471e-8c5f-c9d23a3703ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Nov 02 08:28:34.488868 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:34.488818    6210 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-fkv8m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Nov 02 08:28:34.489265 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:34.488912    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m" podUID="84913035-795c-471e-8c5f-c9d23a3703ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Nov 02 08:28:36.373189 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:36.373155    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"
Nov 02 08:28:36.374070 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:36.374045    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"
Nov 02 08:28:36.374973 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:36.374944    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"
Nov 02 08:28:39.507935 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:39.507898    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"]
Nov 02 08:28:39.511925 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:39.511901    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"
Nov 02 08:28:39.560548 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:39.560514    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-108cf9-openshift-default-dockercfg-gprcr\""
Nov 02 08:28:39.610080 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:39.610051    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"]
Nov 02 08:28:39.616967 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:39.616935    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d4b6238-1d69-4655-b56b-1ea82f38910e-istiod-ca-cert\") pod \"e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss\" (UID: \"0d4b6238-1d69-4655-b56b-1ea82f38910e\") " pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"
Nov 02 08:28:39.617118 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:39.617096    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spmhr\" (UniqueName: \"kubernetes.io/projected/0d4b6238-1d69-4655-b56b-1ea82f38910e-kube-api-access-spmhr\") pod \"e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss\" (UID: \"0d4b6238-1d69-4655-b56b-1ea82f38910e\") " pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"
Nov 02 08:28:39.617190 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:39.617141    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d4b6238-1d69-4655-b56b-1ea82f38910e-istio-podinfo\") pod \"e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss\" (UID: \"0d4b6238-1d69-4655-b56b-1ea82f38910e\") " pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"
Nov 02 08:28:39.617256 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:39.617235    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d4b6238-1d69-4655-b56b-1ea82f38910e-istio-envoy\") pod \"e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss\" (UID: \"0d4b6238-1d69-4655-b56b-1ea82f38910e\") " pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"
Nov 02 08:28:39.617298 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:39.617281    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d4b6238-1d69-4655-b56b-1ea82f38910e-istio-token\") pod \"e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss\" (UID: \"0d4b6238-1d69-4655-b56b-1ea82f38910e\") " pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"
Nov 02 08:28:39.617401 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:39.617385    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d4b6238-1d69-4655-b56b-1ea82f38910e-workload-certs\") pod \"e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss\" (UID: \"0d4b6238-1d69-4655-b56b-1ea82f38910e\") " pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"
Nov 02 08:28:39.617462 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:39.617423    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d4b6238-1d69-4655-b56b-1ea82f38910e-istio-data\") pod \"e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss\" (UID: \"0d4b6238-1d69-4655-b56b-1ea82f38910e\") " pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"
Nov 02 08:28:39.617520 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:39.617509    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d4b6238-1d69-4655-b56b-1ea82f38910e-workload-socket\") pod \"e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss\" (UID: \"0d4b6238-1d69-4655-b56b-1ea82f38910e\") " pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"
Nov 02 08:28:39.617561 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:39.617540    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d4b6238-1d69-4655-b56b-1ea82f38910e-credential-socket\") pod \"e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss\" (UID: \"0d4b6238-1d69-4655-b56b-1ea82f38910e\") " pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"
Nov 02 08:28:39.718198 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:39.718171    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d4b6238-1d69-4655-b56b-1ea82f38910e-istio-envoy\") pod \"e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss\" (UID: \"0d4b6238-1d69-4655-b56b-1ea82f38910e\") " pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"
Nov 02 08:28:39.718374 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:39.718214    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d4b6238-1d69-4655-b56b-1ea82f38910e-istio-token\") pod \"e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss\" (UID: \"0d4b6238-1d69-4655-b56b-1ea82f38910e\") " pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"
Nov 02 08:28:39.718374 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:39.718253    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d4b6238-1d69-4655-b56b-1ea82f38910e-workload-certs\") pod \"e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss\" (UID: \"0d4b6238-1d69-4655-b56b-1ea82f38910e\") " pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"
Nov 02 08:28:39.718374 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:39.718273    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d4b6238-1d69-4655-b56b-1ea82f38910e-istio-data\") pod \"e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss\" (UID: \"0d4b6238-1d69-4655-b56b-1ea82f38910e\") " pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"
Nov 02 08:28:39.718374 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:39.718300    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d4b6238-1d69-4655-b56b-1ea82f38910e-workload-socket\") pod \"e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss\" (UID: \"0d4b6238-1d69-4655-b56b-1ea82f38910e\") " pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"
Nov 02 08:28:39.718374 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:39.718316    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d4b6238-1d69-4655-b56b-1ea82f38910e-credential-socket\") pod \"e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss\" (UID: \"0d4b6238-1d69-4655-b56b-1ea82f38910e\") " pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"
Nov 02 08:28:39.718658 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:39.718409    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d4b6238-1d69-4655-b56b-1ea82f38910e-istiod-ca-cert\") pod \"e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss\" (UID: \"0d4b6238-1d69-4655-b56b-1ea82f38910e\") " pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"
Nov 02 08:28:39.718658 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:39.718467    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spmhr\" (UniqueName: \"kubernetes.io/projected/0d4b6238-1d69-4655-b56b-1ea82f38910e-kube-api-access-spmhr\") pod \"e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss\" (UID: \"0d4b6238-1d69-4655-b56b-1ea82f38910e\") " pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"
Nov 02 08:28:39.718658 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:39.718490    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d4b6238-1d69-4655-b56b-1ea82f38910e-istio-podinfo\") pod \"e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss\" (UID: \"0d4b6238-1d69-4655-b56b-1ea82f38910e\") " pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"
Nov 02 08:28:39.718816 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:39.718692    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d4b6238-1d69-4655-b56b-1ea82f38910e-workload-certs\") pod \"e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss\" (UID: \"0d4b6238-1d69-4655-b56b-1ea82f38910e\") " pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"
Nov 02 08:28:39.718816 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:39.718729    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d4b6238-1d69-4655-b56b-1ea82f38910e-istio-data\") pod \"e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss\" (UID: \"0d4b6238-1d69-4655-b56b-1ea82f38910e\") " pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"
Nov 02 08:28:39.718944 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:39.718815    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d4b6238-1d69-4655-b56b-1ea82f38910e-credential-socket\") pod \"e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss\" (UID: \"0d4b6238-1d69-4655-b56b-1ea82f38910e\") " pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"
Nov 02 08:28:39.718944 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:39.718858    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d4b6238-1d69-4655-b56b-1ea82f38910e-workload-socket\") pod \"e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss\" (UID: \"0d4b6238-1d69-4655-b56b-1ea82f38910e\") " pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"
Nov 02 08:28:39.719181 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:39.719163    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d4b6238-1d69-4655-b56b-1ea82f38910e-istiod-ca-cert\") pod \"e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss\" (UID: \"0d4b6238-1d69-4655-b56b-1ea82f38910e\") " pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"
Nov 02 08:28:39.720439 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:39.720419    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d4b6238-1d69-4655-b56b-1ea82f38910e-istio-envoy\") pod \"e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss\" (UID: \"0d4b6238-1d69-4655-b56b-1ea82f38910e\") " pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"
Nov 02 08:28:39.720974 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:39.720955    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d4b6238-1d69-4655-b56b-1ea82f38910e-istio-podinfo\") pod \"e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss\" (UID: \"0d4b6238-1d69-4655-b56b-1ea82f38910e\") " pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"
Nov 02 08:28:39.771627 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:39.771562    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d4b6238-1d69-4655-b56b-1ea82f38910e-istio-token\") pod \"e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss\" (UID: \"0d4b6238-1d69-4655-b56b-1ea82f38910e\") " pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"
Nov 02 08:28:39.771917 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:39.771872    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spmhr\" (UniqueName: \"kubernetes.io/projected/0d4b6238-1d69-4655-b56b-1ea82f38910e-kube-api-access-spmhr\") pod \"e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss\" (UID: \"0d4b6238-1d69-4655-b56b-1ea82f38910e\") " pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"
Nov 02 08:28:39.826156 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:39.826126    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"
Nov 02 08:28:40.282470 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:40.282448    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"]
Nov 02 08:28:40.284331 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:28:40.284301    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d4b6238_1d69_4655_b56b_1ea82f38910e.slice/crio-f2ae726905a90a25ff8dbd5bc175aeff5ce44dc51931bef8408486b59e15fba6 WatchSource:0}: Error finding container f2ae726905a90a25ff8dbd5bc175aeff5ce44dc51931bef8408486b59e15fba6: Status 404 returned error can't find the container with id f2ae726905a90a25ff8dbd5bc175aeff5ce44dc51931bef8408486b59e15fba6
Nov 02 08:28:40.286815 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:40.286779    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:28:40.286921 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:40.286846    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:28:40.286921 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:40.286905    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:28:40.836286 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:40.836251    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss" event={"ID":"0d4b6238-1d69-4655-b56b-1ea82f38910e","Type":"ContainerStarted","Data":"431528b82dbb4c48e3ce2fdde3bd1b21c74f4db164080af02b485958277fb954"}
Nov 02 08:28:40.836655 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:40.836330    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss" event={"ID":"0d4b6238-1d69-4655-b56b-1ea82f38910e","Type":"ContainerStarted","Data":"f2ae726905a90a25ff8dbd5bc175aeff5ce44dc51931bef8408486b59e15fba6"}
Nov 02 08:28:40.948151 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:40.948101    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss" podStartSLOduration=1.948084884 podStartE2EDuration="1.948084884s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:28:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:28:40.946073924 +0000 UTC m=+1310.704502658" watchObservedRunningTime="2026-11-02 08:28:40.948084884 +0000 UTC m=+1310.706513617"
Nov 02 08:28:41.827225 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:41.827178    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"
Nov 02 08:28:41.828793 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:41.828771    6210 patch_prober.go:29] interesting pod/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Nov 02 08:28:41.828866 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:41.828817    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss" podUID="0d4b6238-1d69-4655-b56b-1ea82f38910e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Nov 02 08:28:42.827497 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:42.827460    6210 patch_prober.go:29] interesting pod/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Nov 02 08:28:42.827933 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:42.827511    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss" podUID="0d4b6238-1d69-4655-b56b-1ea82f38910e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Nov 02 08:28:43.826650 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:43.826574    6210 patch_prober.go:29] interesting pod/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Nov 02 08:28:43.826650 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:43.826635    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss" podUID="0d4b6238-1d69-4655-b56b-1ea82f38910e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Nov 02 08:28:44.198466 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:44.198379    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"]
Nov 02 08:28:44.232191 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:44.232155    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"
Nov 02 08:28:44.262123 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:44.262092    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"]
Nov 02 08:28:44.276456 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:44.276424    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-istiod-ca-cert\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk\" (UID: \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"
Nov 02 08:28:44.276716 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:44.276685    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-istio-podinfo\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk\" (UID: \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"
Nov 02 08:28:44.276825 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:44.276747    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-istio-token\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk\" (UID: \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"
Nov 02 08:28:44.277023 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:44.276996    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9ncz\" (UniqueName: \"kubernetes.io/projected/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-kube-api-access-r9ncz\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk\" (UID: \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"
Nov 02 08:28:44.277088 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:44.277056    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-workload-socket\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk\" (UID: \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"
Nov 02 08:28:44.277146 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:44.277129    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-istio-envoy\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk\" (UID: \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"
Nov 02 08:28:44.277187 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:44.277173    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-istio-data\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk\" (UID: \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"
Nov 02 08:28:44.277270 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:44.277250    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-credential-socket\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk\" (UID: \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"
Nov 02 08:28:44.277468 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:44.277443    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-workload-certs\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk\" (UID: \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"
Nov 02 08:28:44.378466 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:44.378428    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-workload-socket\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk\" (UID: \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"
Nov 02 08:28:44.378651 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:44.378477    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-istio-envoy\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk\" (UID: \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"
Nov 02 08:28:44.378651 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:44.378510    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-istio-data\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk\" (UID: \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"
Nov 02 08:28:44.378651 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:44.378592    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-credential-socket\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk\" (UID: \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"
Nov 02 08:28:44.378651 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:44.378635    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-workload-certs\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk\" (UID: \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"
Nov 02 08:28:44.378856 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:44.378700    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-istiod-ca-cert\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk\" (UID: \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"
Nov 02 08:28:44.378856 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:44.378755    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-istio-podinfo\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk\" (UID: \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"
Nov 02 08:28:44.378856 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:44.378778    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-istio-token\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk\" (UID: \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"
Nov 02 08:28:44.379026 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:44.378873    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-workload-socket\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk\" (UID: \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"
Nov 02 08:28:44.379026 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:44.378915    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9ncz\" (UniqueName: \"kubernetes.io/projected/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-kube-api-access-r9ncz\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk\" (UID: \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"
Nov 02 08:28:44.379384 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:44.379244    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-workload-certs\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk\" (UID: \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"
Nov 02 08:28:44.379384 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:44.379361    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-istio-data\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk\" (UID: \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"
Nov 02 08:28:44.379503 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:44.379483    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-credential-socket\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk\" (UID: \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"
Nov 02 08:28:44.379561 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:44.379546    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-istiod-ca-cert\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk\" (UID: \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"
Nov 02 08:28:44.380785 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:44.380766    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-istio-envoy\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk\" (UID: \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"
Nov 02 08:28:44.381272 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:44.381252    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-istio-podinfo\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk\" (UID: \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"
Nov 02 08:28:44.443727 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:44.443697    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-istio-token\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk\" (UID: \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"
Nov 02 08:28:44.445360 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:44.445340    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9ncz\" (UniqueName: \"kubernetes.io/projected/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-kube-api-access-r9ncz\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk\" (UID: \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"
Nov 02 08:28:44.549688 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:44.549648    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"
Nov 02 08:28:44.826579 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:44.826489    6210 patch_prober.go:29] interesting pod/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Nov 02 08:28:44.826579 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:44.826548    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss" podUID="0d4b6238-1d69-4655-b56b-1ea82f38910e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Nov 02 08:28:44.982183 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:44.982150    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"]
Nov 02 08:28:44.985464 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:28:44.985436    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b188ece_fdd4_4d3c_b641_85e1c19ec1a5.slice/crio-b002aba74db473d2755531f372c1f98931ad34d2f7b02baeb47ba1cc205fd603 WatchSource:0}: Error finding container b002aba74db473d2755531f372c1f98931ad34d2f7b02baeb47ba1cc205fd603: Status 404 returned error can't find the container with id b002aba74db473d2755531f372c1f98931ad34d2f7b02baeb47ba1cc205fd603
Nov 02 08:28:44.987849 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:44.987816    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:28:44.987959 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:44.987909    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:28:44.988028 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:44.987959    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:28:45.827477 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:45.827445    6210 patch_prober.go:29] interesting pod/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Nov 02 08:28:45.827955 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:45.827501    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss" podUID="0d4b6238-1d69-4655-b56b-1ea82f38910e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Nov 02 08:28:45.867361 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:45.867321    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk" event={"ID":"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5","Type":"ContainerStarted","Data":"3cea9139971c6c6f15efb52b3fc540c0a6127bfb36a124c15d6120db3f8a2116"}
Nov 02 08:28:45.867514 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:45.867378    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk" event={"ID":"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5","Type":"ContainerStarted","Data":"b002aba74db473d2755531f372c1f98931ad34d2f7b02baeb47ba1cc205fd603"}
Nov 02 08:28:45.993495 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:45.993434    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk" podStartSLOduration=1.993420566 podStartE2EDuration="1.993420566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:28:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:28:45.992500066 +0000 UTC m=+1315.750928799" watchObservedRunningTime="2026-11-02 08:28:45.993420566 +0000 UTC m=+1315.751849297"
Nov 02 08:28:46.549965 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:46.549930    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"
Nov 02 08:28:46.551696 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:46.551671    6210 patch_prober.go:29] interesting pod/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Nov 02 08:28:46.551815 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:46.551725    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk" podUID="7b188ece-fdd4-4d3c-b641-85e1c19ec1a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Nov 02 08:28:46.835370 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:46.835275    6210 patch_prober.go:29] interesting pod/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Nov 02 08:28:46.836821 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:46.836778    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss" podUID="0d4b6238-1d69-4655-b56b-1ea82f38910e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Nov 02 08:28:47.558902 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:47.554662    6210 patch_prober.go:29] interesting pod/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Nov 02 08:28:47.558902 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:47.554718    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk" podUID="7b188ece-fdd4-4d3c-b641-85e1c19ec1a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Nov 02 08:28:48.211289 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:48.211246    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"
Nov 02 08:28:48.219026 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:48.218992    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"
Nov 02 08:28:48.230448 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:48.230417    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"
Nov 02 08:28:48.550184 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:48.550058    6210 patch_prober.go:29] interesting pod/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Nov 02 08:28:48.550347 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:48.550168    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk" podUID="7b188ece-fdd4-4d3c-b641-85e1c19ec1a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Nov 02 08:28:49.550024 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:49.549993    6210 patch_prober.go:29] interesting pod/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Nov 02 08:28:49.550426 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:49.550053    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk" podUID="7b188ece-fdd4-4d3c-b641-85e1c19ec1a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Nov 02 08:28:50.550148 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:50.550116    6210 patch_prober.go:29] interesting pod/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Nov 02 08:28:50.550570 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:50.550168    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk" podUID="7b188ece-fdd4-4d3c-b641-85e1c19ec1a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Nov 02 08:28:51.555388 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:51.555341    6210 patch_prober.go:29] interesting pod/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Nov 02 08:28:51.555814 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:51.555423    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk" podUID="7b188ece-fdd4-4d3c-b641-85e1c19ec1a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Nov 02 08:28:52.970327 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:52.970293    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"
Nov 02 08:28:52.970822 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:52.970774    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"
Nov 02 08:28:52.971778 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:52.971754    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"
Nov 02 08:28:59.295252 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:59.295204    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"]
Nov 02 08:28:59.300276 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:59.300254    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"
Nov 02 08:28:59.398610 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:59.398580    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"]
Nov 02 08:28:59.450281 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:59.450249    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cbcc23b-e29d-4a1c-9905-17f483872413-workload-certs\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt\" (UID: \"0cbcc23b-e29d-4a1c-9905-17f483872413\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"
Nov 02 08:28:59.450441 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:59.450295    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cbcc23b-e29d-4a1c-9905-17f483872413-credential-socket\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt\" (UID: \"0cbcc23b-e29d-4a1c-9905-17f483872413\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"
Nov 02 08:28:59.450441 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:59.450401    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cbcc23b-e29d-4a1c-9905-17f483872413-istio-token\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt\" (UID: \"0cbcc23b-e29d-4a1c-9905-17f483872413\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"
Nov 02 08:28:59.450518 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:59.450438    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cbcc23b-e29d-4a1c-9905-17f483872413-istio-podinfo\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt\" (UID: \"0cbcc23b-e29d-4a1c-9905-17f483872413\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"
Nov 02 08:28:59.450518 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:59.450459    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cbcc23b-e29d-4a1c-9905-17f483872413-workload-socket\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt\" (UID: \"0cbcc23b-e29d-4a1c-9905-17f483872413\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"
Nov 02 08:28:59.450590 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:59.450560    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cbcc23b-e29d-4a1c-9905-17f483872413-istio-envoy\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt\" (UID: \"0cbcc23b-e29d-4a1c-9905-17f483872413\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"
Nov 02 08:28:59.450631 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:59.450602    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kch6j\" (UniqueName: \"kubernetes.io/projected/0cbcc23b-e29d-4a1c-9905-17f483872413-kube-api-access-kch6j\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt\" (UID: \"0cbcc23b-e29d-4a1c-9905-17f483872413\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"
Nov 02 08:28:59.450674 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:59.450653    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cbcc23b-e29d-4a1c-9905-17f483872413-istiod-ca-cert\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt\" (UID: \"0cbcc23b-e29d-4a1c-9905-17f483872413\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"
Nov 02 08:28:59.450712 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:59.450685    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cbcc23b-e29d-4a1c-9905-17f483872413-istio-data\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt\" (UID: \"0cbcc23b-e29d-4a1c-9905-17f483872413\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"
Nov 02 08:28:59.552255 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:59.552176    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cbcc23b-e29d-4a1c-9905-17f483872413-istiod-ca-cert\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt\" (UID: \"0cbcc23b-e29d-4a1c-9905-17f483872413\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"
Nov 02 08:28:59.552255 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:59.552213    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cbcc23b-e29d-4a1c-9905-17f483872413-istio-data\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt\" (UID: \"0cbcc23b-e29d-4a1c-9905-17f483872413\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"
Nov 02 08:28:59.552494 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:59.552287    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cbcc23b-e29d-4a1c-9905-17f483872413-workload-certs\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt\" (UID: \"0cbcc23b-e29d-4a1c-9905-17f483872413\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"
Nov 02 08:28:59.552494 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:59.552312    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cbcc23b-e29d-4a1c-9905-17f483872413-credential-socket\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt\" (UID: \"0cbcc23b-e29d-4a1c-9905-17f483872413\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"
Nov 02 08:28:59.552494 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:59.552348    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cbcc23b-e29d-4a1c-9905-17f483872413-istio-token\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt\" (UID: \"0cbcc23b-e29d-4a1c-9905-17f483872413\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"
Nov 02 08:28:59.552494 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:59.552369    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cbcc23b-e29d-4a1c-9905-17f483872413-istio-podinfo\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt\" (UID: \"0cbcc23b-e29d-4a1c-9905-17f483872413\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"
Nov 02 08:28:59.552494 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:59.552386    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cbcc23b-e29d-4a1c-9905-17f483872413-workload-socket\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt\" (UID: \"0cbcc23b-e29d-4a1c-9905-17f483872413\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"
Nov 02 08:28:59.553146 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:59.552755    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cbcc23b-e29d-4a1c-9905-17f483872413-istio-envoy\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt\" (UID: \"0cbcc23b-e29d-4a1c-9905-17f483872413\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"
Nov 02 08:28:59.553146 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:59.552804    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kch6j\" (UniqueName: \"kubernetes.io/projected/0cbcc23b-e29d-4a1c-9905-17f483872413-kube-api-access-kch6j\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt\" (UID: \"0cbcc23b-e29d-4a1c-9905-17f483872413\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"
Nov 02 08:28:59.553146 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:59.552850    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cbcc23b-e29d-4a1c-9905-17f483872413-workload-certs\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt\" (UID: \"0cbcc23b-e29d-4a1c-9905-17f483872413\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"
Nov 02 08:28:59.553146 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:59.553043    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cbcc23b-e29d-4a1c-9905-17f483872413-istiod-ca-cert\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt\" (UID: \"0cbcc23b-e29d-4a1c-9905-17f483872413\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"
Nov 02 08:28:59.553502 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:59.553474    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cbcc23b-e29d-4a1c-9905-17f483872413-credential-socket\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt\" (UID: \"0cbcc23b-e29d-4a1c-9905-17f483872413\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"
Nov 02 08:28:59.553502 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:59.553496    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cbcc23b-e29d-4a1c-9905-17f483872413-istio-data\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt\" (UID: \"0cbcc23b-e29d-4a1c-9905-17f483872413\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"
Nov 02 08:28:59.553665 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:59.553578    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cbcc23b-e29d-4a1c-9905-17f483872413-workload-socket\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt\" (UID: \"0cbcc23b-e29d-4a1c-9905-17f483872413\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"
Nov 02 08:28:59.555265 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:59.555242    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cbcc23b-e29d-4a1c-9905-17f483872413-istio-podinfo\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt\" (UID: \"0cbcc23b-e29d-4a1c-9905-17f483872413\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"
Nov 02 08:28:59.555540 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:59.555514    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cbcc23b-e29d-4a1c-9905-17f483872413-istio-envoy\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt\" (UID: \"0cbcc23b-e29d-4a1c-9905-17f483872413\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"
Nov 02 08:28:59.605987 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:59.605965    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cbcc23b-e29d-4a1c-9905-17f483872413-istio-token\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt\" (UID: \"0cbcc23b-e29d-4a1c-9905-17f483872413\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"
Nov 02 08:28:59.606148 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:59.606131    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kch6j\" (UniqueName: \"kubernetes.io/projected/0cbcc23b-e29d-4a1c-9905-17f483872413-kube-api-access-kch6j\") pod \"e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt\" (UID: \"0cbcc23b-e29d-4a1c-9905-17f483872413\") " pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"
Nov 02 08:28:59.613982 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:28:59.613953    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"
Nov 02 08:29:00.038625 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:00.033961    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"]
Nov 02 08:29:00.040760 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:00.040728    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:29:00.040865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:00.040793    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:29:00.040865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:00.040828    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:29:00.065965 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:00.065935    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt" event={"ID":"0cbcc23b-e29d-4a1c-9905-17f483872413","Type":"ContainerStarted","Data":"427afce910df838967cce573e8f0f95c1b51c0be2f149e68876cbf322a6304a6"}
Nov 02 08:29:00.846569 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:29:00.846530    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:29:01.073314 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:01.073278    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt" event={"ID":"0cbcc23b-e29d-4a1c-9905-17f483872413","Type":"ContainerStarted","Data":"238c03fdbe4115758547685b8aa5ff49a2d28e3d12725f17cb8e1dc89ae01e2c"}
Nov 02 08:29:01.243332 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:01.243269    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt" podStartSLOduration=2.243249172 podStartE2EDuration="2.243249172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:28:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:29:01.242396809 +0000 UTC m=+1331.000825545" watchObservedRunningTime="2026-11-02 08:29:01.243249172 +0000 UTC m=+1331.001677904"
Nov 02 08:29:01.624955 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:01.621947    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"
Nov 02 08:29:01.624955 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:01.623992    6210 patch_prober.go:29] interesting pod/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Nov 02 08:29:01.624955 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:01.624038    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt" podUID="0cbcc23b-e29d-4a1c-9905-17f483872413" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Nov 02 08:29:02.616902 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:02.616267    6210 patch_prober.go:29] interesting pod/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Nov 02 08:29:02.616902 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:02.616332    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt" podUID="0cbcc23b-e29d-4a1c-9905-17f483872413" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Nov 02 08:29:03.617903 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:03.616320    6210 patch_prober.go:29] interesting pod/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Nov 02 08:29:03.617903 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:03.616399    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt" podUID="0cbcc23b-e29d-4a1c-9905-17f483872413" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Nov 02 08:29:04.623937 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:04.621281    6210 patch_prober.go:29] interesting pod/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Nov 02 08:29:04.623937 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:04.621357    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt" podUID="0cbcc23b-e29d-4a1c-9905-17f483872413" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Nov 02 08:29:05.615903 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:05.615227    6210 patch_prober.go:29] interesting pod/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Nov 02 08:29:05.615903 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:05.615287    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt" podUID="0cbcc23b-e29d-4a1c-9905-17f483872413" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Nov 02 08:29:06.615224 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:06.615189    6210 patch_prober.go:29] interesting pod/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Nov 02 08:29:06.615711 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:06.615249    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt" podUID="0cbcc23b-e29d-4a1c-9905-17f483872413" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Nov 02 08:29:07.619584 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:07.619555    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"
Nov 02 08:29:07.619994 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:07.619980    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"
Nov 02 08:29:07.620686 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:07.620668    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"
Nov 02 08:29:30.821586 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:29:30.821549    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:29:32.462813 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:32.462781    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k"]
Nov 02 08:29:32.466925 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:32.466897    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k"
Nov 02 08:29:32.515726 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:32.515701    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-b26f03-serving-cert\""
Nov 02 08:29:32.565811 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:32.565779    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k"]
Nov 02 08:29:32.567750 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:32.567728    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs86m\" (UniqueName: \"kubernetes.io/projected/c0c5f4a3-f303-4dcb-96e7-302bacfee1ab-kube-api-access-vs86m\") pod \"maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k\" (UID: \"c0c5f4a3-f303-4dcb-96e7-302bacfee1ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k"
Nov 02 08:29:32.567844 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:32.567794    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0c5f4a3-f303-4dcb-96e7-302bacfee1ab-openshift-service-ca\") pod \"maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k\" (UID: \"c0c5f4a3-f303-4dcb-96e7-302bacfee1ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k"
Nov 02 08:29:32.567948 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:32.567936    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0c5f4a3-f303-4dcb-96e7-302bacfee1ab-maas-api-tls\") pod \"maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k\" (UID: \"c0c5f4a3-f303-4dcb-96e7-302bacfee1ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k"
Nov 02 08:29:32.567998 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:32.567965    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0c5f4a3-f303-4dcb-96e7-302bacfee1ab-metrics-certs\") pod \"maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k\" (UID: \"c0c5f4a3-f303-4dcb-96e7-302bacfee1ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k"
Nov 02 08:29:32.669586 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:32.669551    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0c5f4a3-f303-4dcb-96e7-302bacfee1ab-maas-api-tls\") pod \"maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k\" (UID: \"c0c5f4a3-f303-4dcb-96e7-302bacfee1ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k"
Nov 02 08:29:32.669790 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:32.669608    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0c5f4a3-f303-4dcb-96e7-302bacfee1ab-metrics-certs\") pod \"maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k\" (UID: \"c0c5f4a3-f303-4dcb-96e7-302bacfee1ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k"
Nov 02 08:29:32.669790 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:32.669686    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs86m\" (UniqueName: \"kubernetes.io/projected/c0c5f4a3-f303-4dcb-96e7-302bacfee1ab-kube-api-access-vs86m\") pod \"maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k\" (UID: \"c0c5f4a3-f303-4dcb-96e7-302bacfee1ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k"
Nov 02 08:29:32.669790 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:29:32.669716    6210 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-b26f03-serving-cert: secret "maas-api-e2e-api-a-b26f03-serving-cert" not found
Nov 02 08:29:32.669790 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:32.669771    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0c5f4a3-f303-4dcb-96e7-302bacfee1ab-openshift-service-ca\") pod \"maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k\" (UID: \"c0c5f4a3-f303-4dcb-96e7-302bacfee1ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k"
Nov 02 08:29:32.670014 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:29:32.669793    6210 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c5f4a3-f303-4dcb-96e7-302bacfee1ab-maas-api-tls podName:c0c5f4a3-f303-4dcb-96e7-302bacfee1ab nodeName:}" failed. No retries permitted until 2026-11-02 08:29:33.169770575 +0000 UTC m=+1362.928199308 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c0c5f4a3-f303-4dcb-96e7-302bacfee1ab-maas-api-tls") pod "maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k" (UID: "c0c5f4a3-f303-4dcb-96e7-302bacfee1ab") : secret "maas-api-e2e-api-a-b26f03-serving-cert" not found
Nov 02 08:29:32.670452 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:32.670430    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0c5f4a3-f303-4dcb-96e7-302bacfee1ab-openshift-service-ca\") pod \"maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k\" (UID: \"c0c5f4a3-f303-4dcb-96e7-302bacfee1ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k"
Nov 02 08:29:32.672115 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:32.672096    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0c5f4a3-f303-4dcb-96e7-302bacfee1ab-metrics-certs\") pod \"maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k\" (UID: \"c0c5f4a3-f303-4dcb-96e7-302bacfee1ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k"
Nov 02 08:29:32.724186 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:32.724117    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs86m\" (UniqueName: \"kubernetes.io/projected/c0c5f4a3-f303-4dcb-96e7-302bacfee1ab-kube-api-access-vs86m\") pod \"maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k\" (UID: \"c0c5f4a3-f303-4dcb-96e7-302bacfee1ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k"
Nov 02 08:29:33.178018 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:33.177929    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0c5f4a3-f303-4dcb-96e7-302bacfee1ab-maas-api-tls\") pod \"maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k\" (UID: \"c0c5f4a3-f303-4dcb-96e7-302bacfee1ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k"
Nov 02 08:29:33.180244 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:33.180224    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0c5f4a3-f303-4dcb-96e7-302bacfee1ab-maas-api-tls\") pod \"maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k\" (UID: \"c0c5f4a3-f303-4dcb-96e7-302bacfee1ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k"
Nov 02 08:29:33.380482 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:33.380447    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k"
Nov 02 08:29:33.750206 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:33.750182    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k"]
Nov 02 08:29:33.753112 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:29:33.753080    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0c5f4a3_f303_4dcb_96e7_302bacfee1ab.slice/crio-f2753c9a12f13c3a86eb80896071670a56c80e2093af401bbba39fadc118f4ad WatchSource:0}: Error finding container f2753c9a12f13c3a86eb80896071670a56c80e2093af401bbba39fadc118f4ad: Status 404 returned error can't find the container with id f2753c9a12f13c3a86eb80896071670a56c80e2093af401bbba39fadc118f4ad
Nov 02 08:29:34.380517 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:34.380487    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k" event={"ID":"c0c5f4a3-f303-4dcb-96e7-302bacfee1ab","Type":"ContainerStarted","Data":"f2753c9a12f13c3a86eb80896071670a56c80e2093af401bbba39fadc118f4ad"}
Nov 02 08:29:35.388093 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:35.388061    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k" event={"ID":"c0c5f4a3-f303-4dcb-96e7-302bacfee1ab","Type":"ContainerStarted","Data":"dae4bd4f189feb8ee0811840064356775b73b0edc04d0bfa083a9ff35169d68b"}
Nov 02 08:29:35.388493 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:35.388177    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k"
Nov 02 08:29:35.500160 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:35.500111    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k" podStartSLOduration=2.587793989 podStartE2EDuration="3.500097093s" totalImagesPullingTime="912.303104ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:29:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:29:35.499195656 +0000 UTC m=+1365.257624388" watchObservedRunningTime="2026-11-02 08:29:35.500097093 +0000 UTC m=+1365.258525825"
Nov 02 08:29:37.072367 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.072332    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"]
Nov 02 08:29:37.076646 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.076626    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"
Nov 02 08:29:37.119139 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.119104    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"]
Nov 02 08:29:37.123295 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.123277    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"
Nov 02 08:29:37.135746 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.135719    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f4322fc-b832-434a-a118-20f92c9469d6-credential-socket\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx\" (UID: \"5f4322fc-b832-434a-a118-20f92c9469d6\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"
Nov 02 08:29:37.135853 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.135751    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f4322fc-b832-434a-a118-20f92c9469d6-istio-token\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx\" (UID: \"5f4322fc-b832-434a-a118-20f92c9469d6\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"
Nov 02 08:29:37.135853 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.135772    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f4322fc-b832-434a-a118-20f92c9469d6-workload-certs\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx\" (UID: \"5f4322fc-b832-434a-a118-20f92c9469d6\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"
Nov 02 08:29:37.135980 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.135957    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f4322fc-b832-434a-a118-20f92c9469d6-istiod-ca-cert\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx\" (UID: \"5f4322fc-b832-434a-a118-20f92c9469d6\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"
Nov 02 08:29:37.136058 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.136045    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxdf7\" (UniqueName: \"kubernetes.io/projected/5f4322fc-b832-434a-a118-20f92c9469d6-kube-api-access-rxdf7\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx\" (UID: \"5f4322fc-b832-434a-a118-20f92c9469d6\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"
Nov 02 08:29:37.136101 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.136081    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f4322fc-b832-434a-a118-20f92c9469d6-istio-data\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx\" (UID: \"5f4322fc-b832-434a-a118-20f92c9469d6\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"
Nov 02 08:29:37.136150 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.136132    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f4322fc-b832-434a-a118-20f92c9469d6-istio-envoy\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx\" (UID: \"5f4322fc-b832-434a-a118-20f92c9469d6\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"
Nov 02 08:29:37.136217 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.136200    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f4322fc-b832-434a-a118-20f92c9469d6-workload-socket\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx\" (UID: \"5f4322fc-b832-434a-a118-20f92c9469d6\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"
Nov 02 08:29:37.136252 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.136243    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f4322fc-b832-434a-a118-20f92c9469d6-istio-podinfo\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx\" (UID: \"5f4322fc-b832-434a-a118-20f92c9469d6\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"
Nov 02 08:29:37.175294 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.175269    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"]
Nov 02 08:29:37.224515 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.224479    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"]
Nov 02 08:29:37.237147 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.237116    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f4322fc-b832-434a-a118-20f92c9469d6-credential-socket\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx\" (UID: \"5f4322fc-b832-434a-a118-20f92c9469d6\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"
Nov 02 08:29:37.237147 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.237150    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f4322fc-b832-434a-a118-20f92c9469d6-istio-token\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx\" (UID: \"5f4322fc-b832-434a-a118-20f92c9469d6\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"
Nov 02 08:29:37.237377 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.237170    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f4322fc-b832-434a-a118-20f92c9469d6-workload-certs\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx\" (UID: \"5f4322fc-b832-434a-a118-20f92c9469d6\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"
Nov 02 08:29:37.237377 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.237201    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkqcn\" (UniqueName: \"kubernetes.io/projected/66da0bd1-7419-4297-ba9e-aadc1e834ebe-kube-api-access-rkqcn\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt\" (UID: \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"
Nov 02 08:29:37.237496 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.237369    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66da0bd1-7419-4297-ba9e-aadc1e834ebe-istio-envoy\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt\" (UID: \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"
Nov 02 08:29:37.237555 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.237497    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66da0bd1-7419-4297-ba9e-aadc1e834ebe-credential-socket\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt\" (UID: \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"
Nov 02 08:29:37.237614 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.237549    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f4322fc-b832-434a-a118-20f92c9469d6-credential-socket\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx\" (UID: \"5f4322fc-b832-434a-a118-20f92c9469d6\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"
Nov 02 08:29:37.237614 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.237575    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f4322fc-b832-434a-a118-20f92c9469d6-istiod-ca-cert\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx\" (UID: \"5f4322fc-b832-434a-a118-20f92c9469d6\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"
Nov 02 08:29:37.237614 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.237596    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f4322fc-b832-434a-a118-20f92c9469d6-workload-certs\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx\" (UID: \"5f4322fc-b832-434a-a118-20f92c9469d6\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"
Nov 02 08:29:37.237735 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.237678    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66da0bd1-7419-4297-ba9e-aadc1e834ebe-workload-socket\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt\" (UID: \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"
Nov 02 08:29:37.237735 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.237720    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66da0bd1-7419-4297-ba9e-aadc1e834ebe-workload-certs\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt\" (UID: \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"
Nov 02 08:29:37.237819 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.237747    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66da0bd1-7419-4297-ba9e-aadc1e834ebe-istio-data\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt\" (UID: \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"
Nov 02 08:29:37.237819 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.237782    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxdf7\" (UniqueName: \"kubernetes.io/projected/5f4322fc-b832-434a-a118-20f92c9469d6-kube-api-access-rxdf7\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx\" (UID: \"5f4322fc-b832-434a-a118-20f92c9469d6\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"
Nov 02 08:29:37.237945 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.237915    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f4322fc-b832-434a-a118-20f92c9469d6-istio-data\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx\" (UID: \"5f4322fc-b832-434a-a118-20f92c9469d6\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"
Nov 02 08:29:37.238003 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.237955    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f4322fc-b832-434a-a118-20f92c9469d6-istio-envoy\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx\" (UID: \"5f4322fc-b832-434a-a118-20f92c9469d6\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"
Nov 02 08:29:37.238003 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.237982    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66da0bd1-7419-4297-ba9e-aadc1e834ebe-istio-token\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt\" (UID: \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"
Nov 02 08:29:37.238103 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.238031    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f4322fc-b832-434a-a118-20f92c9469d6-workload-socket\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx\" (UID: \"5f4322fc-b832-434a-a118-20f92c9469d6\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"
Nov 02 08:29:37.238103 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.238074    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66da0bd1-7419-4297-ba9e-aadc1e834ebe-istiod-ca-cert\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt\" (UID: \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"
Nov 02 08:29:37.238191 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.238112    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66da0bd1-7419-4297-ba9e-aadc1e834ebe-istio-podinfo\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt\" (UID: \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"
Nov 02 08:29:37.238241 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.238205    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f4322fc-b832-434a-a118-20f92c9469d6-istio-podinfo\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx\" (UID: \"5f4322fc-b832-434a-a118-20f92c9469d6\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"
Nov 02 08:29:37.238298 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.238275    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f4322fc-b832-434a-a118-20f92c9469d6-istiod-ca-cert\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx\" (UID: \"5f4322fc-b832-434a-a118-20f92c9469d6\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"
Nov 02 08:29:37.238401 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.238382    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f4322fc-b832-434a-a118-20f92c9469d6-workload-socket\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx\" (UID: \"5f4322fc-b832-434a-a118-20f92c9469d6\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"
Nov 02 08:29:37.238552 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.238530    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f4322fc-b832-434a-a118-20f92c9469d6-istio-data\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx\" (UID: \"5f4322fc-b832-434a-a118-20f92c9469d6\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"
Nov 02 08:29:37.240495 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.240468    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f4322fc-b832-434a-a118-20f92c9469d6-istio-podinfo\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx\" (UID: \"5f4322fc-b832-434a-a118-20f92c9469d6\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"
Nov 02 08:29:37.240597 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.240580    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f4322fc-b832-434a-a118-20f92c9469d6-istio-envoy\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx\" (UID: \"5f4322fc-b832-434a-a118-20f92c9469d6\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"
Nov 02 08:29:37.291385 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.291348    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f4322fc-b832-434a-a118-20f92c9469d6-istio-token\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx\" (UID: \"5f4322fc-b832-434a-a118-20f92c9469d6\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"
Nov 02 08:29:37.291530 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.291425    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxdf7\" (UniqueName: \"kubernetes.io/projected/5f4322fc-b832-434a-a118-20f92c9469d6-kube-api-access-rxdf7\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx\" (UID: \"5f4322fc-b832-434a-a118-20f92c9469d6\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"
Nov 02 08:29:37.339573 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.339491    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66da0bd1-7419-4297-ba9e-aadc1e834ebe-credential-socket\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt\" (UID: \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"
Nov 02 08:29:37.339573 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.339566    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66da0bd1-7419-4297-ba9e-aadc1e834ebe-workload-socket\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt\" (UID: \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"
Nov 02 08:29:37.339800 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.339619    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66da0bd1-7419-4297-ba9e-aadc1e834ebe-workload-certs\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt\" (UID: \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"
Nov 02 08:29:37.339800 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.339654    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66da0bd1-7419-4297-ba9e-aadc1e834ebe-istio-data\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt\" (UID: \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"
Nov 02 08:29:37.339800 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.339728    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66da0bd1-7419-4297-ba9e-aadc1e834ebe-istio-token\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt\" (UID: \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"
Nov 02 08:29:37.339800 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.339771    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66da0bd1-7419-4297-ba9e-aadc1e834ebe-istiod-ca-cert\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt\" (UID: \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"
Nov 02 08:29:37.340026 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.339820    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66da0bd1-7419-4297-ba9e-aadc1e834ebe-istio-podinfo\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt\" (UID: \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"
Nov 02 08:29:37.340026 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.339942    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkqcn\" (UniqueName: \"kubernetes.io/projected/66da0bd1-7419-4297-ba9e-aadc1e834ebe-kube-api-access-rkqcn\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt\" (UID: \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"
Nov 02 08:29:37.340026 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.339953    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66da0bd1-7419-4297-ba9e-aadc1e834ebe-credential-socket\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt\" (UID: \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"
Nov 02 08:29:37.340026 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.339982    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66da0bd1-7419-4297-ba9e-aadc1e834ebe-workload-socket\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt\" (UID: \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"
Nov 02 08:29:37.340230 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.340024    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66da0bd1-7419-4297-ba9e-aadc1e834ebe-istio-envoy\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt\" (UID: \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"
Nov 02 08:29:37.340230 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.340186    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66da0bd1-7419-4297-ba9e-aadc1e834ebe-istio-data\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt\" (UID: \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"
Nov 02 08:29:37.340340 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.340256    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66da0bd1-7419-4297-ba9e-aadc1e834ebe-workload-certs\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt\" (UID: \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"
Nov 02 08:29:37.340684 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.340665    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66da0bd1-7419-4297-ba9e-aadc1e834ebe-istiod-ca-cert\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt\" (UID: \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"
Nov 02 08:29:37.342321 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.342299    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66da0bd1-7419-4297-ba9e-aadc1e834ebe-istio-envoy\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt\" (UID: \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"
Nov 02 08:29:37.342427 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.342391    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66da0bd1-7419-4297-ba9e-aadc1e834ebe-istio-podinfo\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt\" (UID: \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"
Nov 02 08:29:37.390511 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.390480    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"
Nov 02 08:29:37.392871 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.392849    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66da0bd1-7419-4297-ba9e-aadc1e834ebe-istio-token\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt\" (UID: \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"
Nov 02 08:29:37.393068 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.393048    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkqcn\" (UniqueName: \"kubernetes.io/projected/66da0bd1-7419-4297-ba9e-aadc1e834ebe-kube-api-access-rkqcn\") pod \"e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt\" (UID: \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\") " pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"
Nov 02 08:29:37.437558 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.437529    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"
Nov 02 08:29:37.819462 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.818498    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"]
Nov 02 08:29:37.848203 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:29:37.848162    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f4322fc_b832_434a_a118_20f92c9469d6.slice/crio-8f5d3b1edf4e89e0bec5c3c6b1d6b670ae947b1db54ac9fb1825fe357b7d3204 WatchSource:0}: Error finding container 8f5d3b1edf4e89e0bec5c3c6b1d6b670ae947b1db54ac9fb1825fe357b7d3204: Status 404 returned error can't find the container with id 8f5d3b1edf4e89e0bec5c3c6b1d6b670ae947b1db54ac9fb1825fe357b7d3204
Nov 02 08:29:37.851190 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.851153    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:29:37.851275 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.851225    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:29:37.851275 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.851253    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:29:37.860321 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.860301    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"]
Nov 02 08:29:37.862479 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:29:37.862442    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66da0bd1_7419_4297_ba9e_aadc1e834ebe.slice/crio-881f133800ce3dd6e388e6c56f5081aab8bffacc5a2755239e8425ff81c7fdce WatchSource:0}: Error finding container 881f133800ce3dd6e388e6c56f5081aab8bffacc5a2755239e8425ff81c7fdce: Status 404 returned error can't find the container with id 881f133800ce3dd6e388e6c56f5081aab8bffacc5a2755239e8425ff81c7fdce
Nov 02 08:29:37.864788 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.864758    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:29:37.864902 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.864850    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:29:37.864963 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:37.864920    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:29:38.423901 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:38.421824    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx" event={"ID":"5f4322fc-b832-434a-a118-20f92c9469d6","Type":"ContainerStarted","Data":"ef6febb2ec4deaf5fecefc5632dd077c8802174afacb173b13a8e096875c0fda"}
Nov 02 08:29:38.423901 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:38.421957    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx" event={"ID":"5f4322fc-b832-434a-a118-20f92c9469d6","Type":"ContainerStarted","Data":"8f5d3b1edf4e89e0bec5c3c6b1d6b670ae947b1db54ac9fb1825fe357b7d3204"}
Nov 02 08:29:38.434901 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:38.428656    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt" event={"ID":"66da0bd1-7419-4297-ba9e-aadc1e834ebe","Type":"ContainerStarted","Data":"dadef0c46f5a58de244e08d01e7021394110b2e8d076ab1e8fdab8e78d02124a"}
Nov 02 08:29:38.434901 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:38.428720    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt" event={"ID":"66da0bd1-7419-4297-ba9e-aadc1e834ebe","Type":"ContainerStarted","Data":"881f133800ce3dd6e388e6c56f5081aab8bffacc5a2755239e8425ff81c7fdce"}
Nov 02 08:29:38.441904 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:38.438729    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"
Nov 02 08:29:38.445901 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:38.443056    6210 patch_prober.go:29] interesting pod/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Nov 02 08:29:38.445901 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:38.443134    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt" podUID="66da0bd1-7419-4297-ba9e-aadc1e834ebe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Nov 02 08:29:38.542151 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:38.540762    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx" podStartSLOduration=1.540741626 podStartE2EDuration="1.540741626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:29:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:29:38.535252776 +0000 UTC m=+1368.293681512" watchObservedRunningTime="2026-11-02 08:29:38.540741626 +0000 UTC m=+1368.299170359"
Nov 02 08:29:38.653941 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:38.653852    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt" podStartSLOduration=1.653830825 podStartE2EDuration="1.653830825s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:29:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:29:38.649687398 +0000 UTC m=+1368.408116132" watchObservedRunningTime="2026-11-02 08:29:38.653830825 +0000 UTC m=+1368.412259557"
Nov 02 08:29:39.391695 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:39.391658    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"
Nov 02 08:29:39.392894 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:39.392855    6210 patch_prober.go:29] interesting pod/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Nov 02 08:29:39.392966 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:39.392921    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx" podUID="5f4322fc-b832-434a-a118-20f92c9469d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Nov 02 08:29:39.454329 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:39.454299    6210 patch_prober.go:29] interesting pod/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Nov 02 08:29:39.454864 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:39.454837    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt" podUID="66da0bd1-7419-4297-ba9e-aadc1e834ebe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Nov 02 08:29:40.391318 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:40.391288    6210 patch_prober.go:29] interesting pod/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Nov 02 08:29:40.391490 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:40.391341    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx" podUID="5f4322fc-b832-434a-a118-20f92c9469d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Nov 02 08:29:40.441375 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:40.441253    6210 patch_prober.go:29] interesting pod/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Nov 02 08:29:40.441375 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:40.441319    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt" podUID="66da0bd1-7419-4297-ba9e-aadc1e834ebe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Nov 02 08:29:41.391019 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:41.390983    6210 patch_prober.go:29] interesting pod/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Nov 02 08:29:41.391492 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:41.391047    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx" podUID="5f4322fc-b832-434a-a118-20f92c9469d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Nov 02 08:29:41.421090 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:41.421056    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k"
Nov 02 08:29:41.444852 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:41.444808    6210 patch_prober.go:29] interesting pod/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Nov 02 08:29:41.445167 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:41.445134    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt" podUID="66da0bd1-7419-4297-ba9e-aadc1e834ebe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Nov 02 08:29:42.391238 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:42.391203    6210 patch_prober.go:29] interesting pod/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Nov 02 08:29:42.391633 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:42.391264    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx" podUID="5f4322fc-b832-434a-a118-20f92c9469d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Nov 02 08:29:42.438484 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:42.438447    6210 patch_prober.go:29] interesting pod/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Nov 02 08:29:42.438797 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:42.438755    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt" podUID="66da0bd1-7419-4297-ba9e-aadc1e834ebe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Nov 02 08:29:43.391326 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:43.391286    6210 patch_prober.go:29] interesting pod/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Nov 02 08:29:43.391705 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:43.391368    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx" podUID="5f4322fc-b832-434a-a118-20f92c9469d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Nov 02 08:29:43.444903 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:43.440446    6210 patch_prober.go:29] interesting pod/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Nov 02 08:29:43.444903 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:43.440543    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt" podUID="66da0bd1-7419-4297-ba9e-aadc1e834ebe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Nov 02 08:29:44.390790 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:44.390755    6210 patch_prober.go:29] interesting pod/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Nov 02 08:29:44.391139 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:44.391086    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx" podUID="5f4322fc-b832-434a-a118-20f92c9469d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Nov 02 08:29:44.438636 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:44.438606    6210 patch_prober.go:29] interesting pod/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Nov 02 08:29:44.439094 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:44.438662    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt" podUID="66da0bd1-7419-4297-ba9e-aadc1e834ebe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Nov 02 08:29:45.395760 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:45.395728    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"
Nov 02 08:29:45.396105 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:45.396077    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"
Nov 02 08:29:45.396795 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:45.396778    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"
Nov 02 08:29:45.442481 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:45.442453    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"
Nov 02 08:29:45.442864 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:45.442728    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"
Nov 02 08:29:45.443521 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:29:45.443505    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"
Nov 02 08:30:00.176476 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:00.176442    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-8e6407-29893470-r9wtg"]
Nov 02 08:30:00.180970 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:00.180944    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-8e6407-29893470-r9wtg"
Nov 02 08:30:00.185700 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:00.185668    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cba6f9af-29893470-zqnlx"]
Nov 02 08:30:00.190052 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:00.190029    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29893470-q659r"]
Nov 02 08:30:00.190297 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:00.190133    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cba6f9af-29893470-zqnlx"
Nov 02 08:30:00.195676 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:00.195659    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29893470-q659r"
Nov 02 08:30:00.309834 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:00.309798    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29893470-q659r"]
Nov 02 08:30:00.325985 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:00.325954    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7s74\" (UniqueName: \"kubernetes.io/projected/f7b7b5e7-bac8-498d-93c1-717ab8e93a89-kube-api-access-l7s74\") pod \"maas-api-key-cleanup-e2e-worker-w4-8e6407-29893470-r9wtg\" (UID: \"f7b7b5e7-bac8-498d-93c1-717ab8e93a89\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-8e6407-29893470-r9wtg"
Nov 02 08:30:00.326153 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:00.326080    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/121c8d2c-a869-4d3e-abd2-2f66ac8738ab-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-mt-cba6f9af-29893470-zqnlx\" (UID: \"121c8d2c-a869-4d3e-abd2-2f66ac8738ab\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cba6f9af-29893470-zqnlx"
Nov 02 08:30:00.326153 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:00.326104    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk9xg\" (UniqueName: \"kubernetes.io/projected/121c8d2c-a869-4d3e-abd2-2f66ac8738ab-kube-api-access-nk9xg\") pod \"maas-api-key-cleanup-e2e-mt-cba6f9af-29893470-zqnlx\" (UID: \"121c8d2c-a869-4d3e-abd2-2f66ac8738ab\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cba6f9af-29893470-zqnlx"
Nov 02 08:30:00.326264 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:00.326150    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nb2l\" (UniqueName: \"kubernetes.io/projected/e8e87668-3205-4177-a130-030095f6fca5-kube-api-access-8nb2l\") pod \"maas-api-key-cleanup-29893470-q659r\" (UID: \"e8e87668-3205-4177-a130-030095f6fca5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29893470-q659r"
Nov 02 08:30:00.326362 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:00.326333    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e87668-3205-4177-a130-030095f6fca5-maas-api-service-ca\") pod \"maas-api-key-cleanup-29893470-q659r\" (UID: \"e8e87668-3205-4177-a130-030095f6fca5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29893470-q659r"
Nov 02 08:30:00.326470 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:00.326449    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7b7b5e7-bac8-498d-93c1-717ab8e93a89-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-8e6407-29893470-r9wtg\" (UID: \"f7b7b5e7-bac8-498d-93c1-717ab8e93a89\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-8e6407-29893470-r9wtg"
Nov 02 08:30:00.331615 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:00.331590    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4p9nt\""
Nov 02 08:30:00.374866 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:00.374834    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cba6f9af-29893470-zqnlx"]
Nov 02 08:30:00.375034 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:00.374918    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-8e6407-29893470-r9wtg"]
Nov 02 08:30:00.427358 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:00.427289    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e87668-3205-4177-a130-030095f6fca5-maas-api-service-ca\") pod \"maas-api-key-cleanup-29893470-q659r\" (UID: \"e8e87668-3205-4177-a130-030095f6fca5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29893470-q659r"
Nov 02 08:30:00.427506 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:00.427363    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7b7b5e7-bac8-498d-93c1-717ab8e93a89-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-8e6407-29893470-r9wtg\" (UID: \"f7b7b5e7-bac8-498d-93c1-717ab8e93a89\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-8e6407-29893470-r9wtg"
Nov 02 08:30:00.427506 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:00.427411    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7s74\" (UniqueName: \"kubernetes.io/projected/f7b7b5e7-bac8-498d-93c1-717ab8e93a89-kube-api-access-l7s74\") pod \"maas-api-key-cleanup-e2e-worker-w4-8e6407-29893470-r9wtg\" (UID: \"f7b7b5e7-bac8-498d-93c1-717ab8e93a89\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-8e6407-29893470-r9wtg"
Nov 02 08:30:00.427630 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:00.427513    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/121c8d2c-a869-4d3e-abd2-2f66ac8738ab-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-mt-cba6f9af-29893470-zqnlx\" (UID: \"121c8d2c-a869-4d3e-abd2-2f66ac8738ab\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cba6f9af-29893470-zqnlx"
Nov 02 08:30:00.427630 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:00.427536    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk9xg\" (UniqueName: \"kubernetes.io/projected/121c8d2c-a869-4d3e-abd2-2f66ac8738ab-kube-api-access-nk9xg\") pod \"maas-api-key-cleanup-e2e-mt-cba6f9af-29893470-zqnlx\" (UID: \"121c8d2c-a869-4d3e-abd2-2f66ac8738ab\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cba6f9af-29893470-zqnlx"
Nov 02 08:30:00.427630 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:00.427590    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nb2l\" (UniqueName: \"kubernetes.io/projected/e8e87668-3205-4177-a130-030095f6fca5-kube-api-access-8nb2l\") pod \"maas-api-key-cleanup-29893470-q659r\" (UID: \"e8e87668-3205-4177-a130-030095f6fca5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29893470-q659r"
Nov 02 08:30:00.428087 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:00.428064    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e87668-3205-4177-a130-030095f6fca5-maas-api-service-ca\") pod \"maas-api-key-cleanup-29893470-q659r\" (UID: \"e8e87668-3205-4177-a130-030095f6fca5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29893470-q659r"
Nov 02 08:30:00.428216 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:00.428191    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7b7b5e7-bac8-498d-93c1-717ab8e93a89-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-8e6407-29893470-r9wtg\" (UID: \"f7b7b5e7-bac8-498d-93c1-717ab8e93a89\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-8e6407-29893470-r9wtg"
Nov 02 08:30:00.428257 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:00.428233    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/121c8d2c-a869-4d3e-abd2-2f66ac8738ab-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-mt-cba6f9af-29893470-zqnlx\" (UID: \"121c8d2c-a869-4d3e-abd2-2f66ac8738ab\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cba6f9af-29893470-zqnlx"
Nov 02 08:30:00.481660 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:00.481633    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk9xg\" (UniqueName: \"kubernetes.io/projected/121c8d2c-a869-4d3e-abd2-2f66ac8738ab-kube-api-access-nk9xg\") pod \"maas-api-key-cleanup-e2e-mt-cba6f9af-29893470-zqnlx\" (UID: \"121c8d2c-a869-4d3e-abd2-2f66ac8738ab\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cba6f9af-29893470-zqnlx"
Nov 02 08:30:00.481790 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:00.481705    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7s74\" (UniqueName: \"kubernetes.io/projected/f7b7b5e7-bac8-498d-93c1-717ab8e93a89-kube-api-access-l7s74\") pod \"maas-api-key-cleanup-e2e-worker-w4-8e6407-29893470-r9wtg\" (UID: \"f7b7b5e7-bac8-498d-93c1-717ab8e93a89\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-8e6407-29893470-r9wtg"
Nov 02 08:30:00.481790 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:00.481750    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nb2l\" (UniqueName: \"kubernetes.io/projected/e8e87668-3205-4177-a130-030095f6fca5-kube-api-access-8nb2l\") pod \"maas-api-key-cleanup-29893470-q659r\" (UID: \"e8e87668-3205-4177-a130-030095f6fca5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29893470-q659r"
Nov 02 08:30:00.497797 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:00.497770    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-8e6407-29893470-r9wtg"
Nov 02 08:30:00.507012 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:00.506991    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cba6f9af-29893470-zqnlx"
Nov 02 08:30:00.513185 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:00.513162    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29893470-q659r"
Nov 02 08:30:00.822361 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:30:00.822319    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:30:00.892120 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:00.892095    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cba6f9af-29893470-zqnlx"]
Nov 02 08:30:00.893327 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:30:00.893298    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod121c8d2c_a869_4d3e_abd2_2f66ac8738ab.slice/crio-eefc31cf22729a86bf122b31c91d9c44b577ff5964cc40e8d8d0d9d3b49cfff1 WatchSource:0}: Error finding container eefc31cf22729a86bf122b31c91d9c44b577ff5964cc40e8d8d0d9d3b49cfff1: Status 404 returned error can't find the container with id eefc31cf22729a86bf122b31c91d9c44b577ff5964cc40e8d8d0d9d3b49cfff1
Nov 02 08:30:00.937362 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:00.937340    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29893470-q659r"]
Nov 02 08:30:00.939529 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:30:00.939501    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8e87668_3205_4177_a130_030095f6fca5.slice/crio-2c5e9bea33501545772e49870d4adbadd158a71966c2e7871dc85f97f6e5c4bd WatchSource:0}: Error finding container 2c5e9bea33501545772e49870d4adbadd158a71966c2e7871dc85f97f6e5c4bd: Status 404 returned error can't find the container with id 2c5e9bea33501545772e49870d4adbadd158a71966c2e7871dc85f97f6e5c4bd
Nov 02 08:30:00.940356 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:30:00.940332    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7b7b5e7_bac8_498d_93c1_717ab8e93a89.slice/crio-87f047c61d5556dfe2a94b57c32ec63312d0875d63717340807d54e8a5e4ef7c WatchSource:0}: Error finding container 87f047c61d5556dfe2a94b57c32ec63312d0875d63717340807d54e8a5e4ef7c: Status 404 returned error can't find the container with id 87f047c61d5556dfe2a94b57c32ec63312d0875d63717340807d54e8a5e4ef7c
Nov 02 08:30:00.940554 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:00.940529    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-8e6407-29893470-r9wtg"]
Nov 02 08:30:01.652570 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:01.652537    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29893470-q659r" event={"ID":"e8e87668-3205-4177-a130-030095f6fca5","Type":"ContainerStarted","Data":"2c5e9bea33501545772e49870d4adbadd158a71966c2e7871dc85f97f6e5c4bd"}
Nov 02 08:30:01.653846 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:01.653819    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cba6f9af-29893470-zqnlx" event={"ID":"121c8d2c-a869-4d3e-abd2-2f66ac8738ab","Type":"ContainerStarted","Data":"eefc31cf22729a86bf122b31c91d9c44b577ff5964cc40e8d8d0d9d3b49cfff1"}
Nov 02 08:30:01.654978 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:01.654957    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-8e6407-29893470-r9wtg" event={"ID":"f7b7b5e7-bac8-498d-93c1-717ab8e93a89","Type":"ContainerStarted","Data":"87f047c61d5556dfe2a94b57c32ec63312d0875d63717340807d54e8a5e4ef7c"}
Nov 02 08:30:08.703647 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:08.703595    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-8e6407-29893470-r9wtg" event={"ID":"f7b7b5e7-bac8-498d-93c1-717ab8e93a89","Type":"ContainerStarted","Data":"b7edb34fb84532c084266994b40ae3d7ca0555feafbe0f6a35f5d516aef58a30"}
Nov 02 08:30:08.705536 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:08.705504    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29893470-q659r" event={"ID":"e8e87668-3205-4177-a130-030095f6fca5","Type":"ContainerStarted","Data":"aa54f5de0dc09f34fbb59eda4dd3cf4fb8ed2f318f8c9423c028e7fcbe99f936"}
Nov 02 08:30:08.813940 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:08.813870    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-8e6407-29893470-r9wtg" podStartSLOduration=1.9415827509999999 podStartE2EDuration="8.813856492s" totalImagesPullingTime="6.872273741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:30:08.810869395 +0000 UTC m=+1398.569298126" watchObservedRunningTime="2026-11-02 08:30:08.813856492 +0000 UTC m=+1398.572285221"
Nov 02 08:30:08.917409 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:08.917359    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29893470-q659r" podStartSLOduration=1.5263902360000001 podStartE2EDuration="8.917342803s" totalImagesPullingTime="7.390952567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:30:08.917318379 +0000 UTC m=+1398.675747111" watchObservedRunningTime="2026-11-02 08:30:08.917342803 +0000 UTC m=+1398.675771529"
Nov 02 08:30:09.712820 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:09.712789    6210 generic.go:356] "Generic (PLEG): container finished" podID="121c8d2c-a869-4d3e-abd2-2f66ac8738ab" containerID="ae2eca1b8909e6dea6928a2a2067a84433b50c4d3b406dbad19f5988a888e139" exitCode=60
Nov 02 08:30:09.713288 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:09.712901    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cba6f9af-29893470-zqnlx" event={"ID":"121c8d2c-a869-4d3e-abd2-2f66ac8738ab","Type":"ContainerDied","Data":"ae2eca1b8909e6dea6928a2a2067a84433b50c4d3b406dbad19f5988a888e139"}
Nov 02 08:30:09.713288 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:09.713177    6210 scope.go:122] "RemoveContainer" containerID="ae2eca1b8909e6dea6928a2a2067a84433b50c4d3b406dbad19f5988a888e139"
Nov 02 08:30:09.714672 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:09.714646    6210 generic.go:356] "Generic (PLEG): container finished" podID="f7b7b5e7-bac8-498d-93c1-717ab8e93a89" containerID="b7edb34fb84532c084266994b40ae3d7ca0555feafbe0f6a35f5d516aef58a30" exitCode=60
Nov 02 08:30:09.714786 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:09.714707    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-8e6407-29893470-r9wtg" event={"ID":"f7b7b5e7-bac8-498d-93c1-717ab8e93a89","Type":"ContainerDied","Data":"b7edb34fb84532c084266994b40ae3d7ca0555feafbe0f6a35f5d516aef58a30"}
Nov 02 08:30:09.715024 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:09.715009    6210 scope.go:122] "RemoveContainer" containerID="b7edb34fb84532c084266994b40ae3d7ca0555feafbe0f6a35f5d516aef58a30"
Nov 02 08:30:09.716433 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:09.716398    6210 generic.go:356] "Generic (PLEG): container finished" podID="e8e87668-3205-4177-a130-030095f6fca5" containerID="aa54f5de0dc09f34fbb59eda4dd3cf4fb8ed2f318f8c9423c028e7fcbe99f936" exitCode=60
Nov 02 08:30:09.716541 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:09.716445    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29893470-q659r" event={"ID":"e8e87668-3205-4177-a130-030095f6fca5","Type":"ContainerDied","Data":"aa54f5de0dc09f34fbb59eda4dd3cf4fb8ed2f318f8c9423c028e7fcbe99f936"}
Nov 02 08:30:09.716686 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:09.716671    6210 scope.go:122] "RemoveContainer" containerID="aa54f5de0dc09f34fbb59eda4dd3cf4fb8ed2f318f8c9423c028e7fcbe99f936"
Nov 02 08:30:10.729071 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:10.729042    6210 generic.go:356] "Generic (PLEG): container finished" podID="121c8d2c-a869-4d3e-abd2-2f66ac8738ab" containerID="162ffba5751396784f9bb29e62dff254c6e51656807054139137d797ac6f282a" exitCode=60
Nov 02 08:30:10.729410 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:10.729121    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cba6f9af-29893470-zqnlx" event={"ID":"121c8d2c-a869-4d3e-abd2-2f66ac8738ab","Type":"ContainerDied","Data":"162ffba5751396784f9bb29e62dff254c6e51656807054139137d797ac6f282a"}
Nov 02 08:30:10.729410 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:10.729182    6210 scope.go:122] "RemoveContainer" containerID="ae2eca1b8909e6dea6928a2a2067a84433b50c4d3b406dbad19f5988a888e139"
Nov 02 08:30:10.729491 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:10.729477    6210 scope.go:122] "RemoveContainer" containerID="162ffba5751396784f9bb29e62dff254c6e51656807054139137d797ac6f282a"
Nov 02 08:30:10.729862 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:30:10.729840    6210 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-mt-cba6f9af-29893470-zqnlx_odh-ai-gateway-infra(121c8d2c-a869-4d3e-abd2-2f66ac8738ab)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cba6f9af-29893470-zqnlx" podUID="121c8d2c-a869-4d3e-abd2-2f66ac8738ab"
Nov 02 08:30:10.731725 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:10.731702    6210 generic.go:356] "Generic (PLEG): container finished" podID="f7b7b5e7-bac8-498d-93c1-717ab8e93a89" containerID="c54e6d314a22a0e7c0921b85cee2a92e033aeedf28064b3eee546f57ff620f0d" exitCode=60
Nov 02 08:30:10.731821 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:10.731797    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-8e6407-29893470-r9wtg" event={"ID":"f7b7b5e7-bac8-498d-93c1-717ab8e93a89","Type":"ContainerDied","Data":"c54e6d314a22a0e7c0921b85cee2a92e033aeedf28064b3eee546f57ff620f0d"}
Nov 02 08:30:10.732767 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:10.732751    6210 scope.go:122] "RemoveContainer" containerID="c54e6d314a22a0e7c0921b85cee2a92e033aeedf28064b3eee546f57ff620f0d"
Nov 02 08:30:10.733044 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:30:10.733025    6210 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-8e6407-29893470-r9wtg_odh-ai-gateway-infra(f7b7b5e7-bac8-498d-93c1-717ab8e93a89)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-8e6407-29893470-r9wtg" podUID="f7b7b5e7-bac8-498d-93c1-717ab8e93a89"
Nov 02 08:30:10.733907 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:10.733870    6210 generic.go:356] "Generic (PLEG): container finished" podID="e8e87668-3205-4177-a130-030095f6fca5" containerID="f32aafb348488978911f699fcf0e53dbebcba19fe72e618f688542ea715f66ff" exitCode=60
Nov 02 08:30:10.734016 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:10.733975    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29893470-q659r" event={"ID":"e8e87668-3205-4177-a130-030095f6fca5","Type":"ContainerDied","Data":"f32aafb348488978911f699fcf0e53dbebcba19fe72e618f688542ea715f66ff"}
Nov 02 08:30:10.734227 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:10.734211    6210 scope.go:122] "RemoveContainer" containerID="f32aafb348488978911f699fcf0e53dbebcba19fe72e618f688542ea715f66ff"
Nov 02 08:30:10.734456 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:30:10.734436    6210 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29893470-q659r_odh-ai-gateway-infra(e8e87668-3205-4177-a130-030095f6fca5)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29893470-q659r" podUID="e8e87668-3205-4177-a130-030095f6fca5"
Nov 02 08:30:10.834522 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:10.834501    6210 scope.go:122] "RemoveContainer" containerID="b7edb34fb84532c084266994b40ae3d7ca0555feafbe0f6a35f5d516aef58a30"
Nov 02 08:30:10.850288 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:10.850260    6210 scope.go:122] "RemoveContainer" containerID="aa54f5de0dc09f34fbb59eda4dd3cf4fb8ed2f318f8c9423c028e7fcbe99f936"
Nov 02 08:30:11.741370 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:11.741341    6210 scope.go:122] "RemoveContainer" containerID="c54e6d314a22a0e7c0921b85cee2a92e033aeedf28064b3eee546f57ff620f0d"
Nov 02 08:30:11.741834 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:30:11.741670    6210 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-8e6407-29893470-r9wtg_odh-ai-gateway-infra(f7b7b5e7-bac8-498d-93c1-717ab8e93a89)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-8e6407-29893470-r9wtg" podUID="f7b7b5e7-bac8-498d-93c1-717ab8e93a89"
Nov 02 08:30:11.742991 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:11.742965    6210 scope.go:122] "RemoveContainer" containerID="f32aafb348488978911f699fcf0e53dbebcba19fe72e618f688542ea715f66ff"
Nov 02 08:30:11.743263 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:30:11.743242    6210 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29893470-q659r_odh-ai-gateway-infra(e8e87668-3205-4177-a130-030095f6fca5)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29893470-q659r" podUID="e8e87668-3205-4177-a130-030095f6fca5"
Nov 02 08:30:11.744601 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:11.744581    6210 scope.go:122] "RemoveContainer" containerID="162ffba5751396784f9bb29e62dff254c6e51656807054139137d797ac6f282a"
Nov 02 08:30:11.744807 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:30:11.744788    6210 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-mt-cba6f9af-29893470-zqnlx_odh-ai-gateway-infra(121c8d2c-a869-4d3e-abd2-2f66ac8738ab)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cba6f9af-29893470-zqnlx" podUID="121c8d2c-a869-4d3e-abd2-2f66ac8738ab"
Nov 02 08:30:16.927941 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:16.927903    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"]
Nov 02 08:30:16.933834 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:16.933797    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:30:16.963483 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:16.963453    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2b3bbf0-2054-45ee-b135-fbc431f02a09-workload-socket\") pod \"e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj\" (UID: \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\") " pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:30:16.963483 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:16.963487    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2b3bbf0-2054-45ee-b135-fbc431f02a09-istio-token\") pod \"e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj\" (UID: \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\") " pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:30:16.963720 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:16.963509    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2b3bbf0-2054-45ee-b135-fbc431f02a09-credential-socket\") pod \"e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj\" (UID: \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\") " pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:30:16.963720 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:16.963694    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2b3bbf0-2054-45ee-b135-fbc431f02a09-workload-certs\") pod \"e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj\" (UID: \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\") " pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:30:16.963826 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:16.963756    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2b3bbf0-2054-45ee-b135-fbc431f02a09-istiod-ca-cert\") pod \"e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj\" (UID: \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\") " pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:30:16.963826 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:16.963785    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfsqt\" (UniqueName: \"kubernetes.io/projected/d2b3bbf0-2054-45ee-b135-fbc431f02a09-kube-api-access-gfsqt\") pod \"e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj\" (UID: \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\") " pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:30:16.964015 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:16.963989    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2b3bbf0-2054-45ee-b135-fbc431f02a09-istio-data\") pod \"e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj\" (UID: \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\") " pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:30:16.964067 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:16.964051    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2b3bbf0-2054-45ee-b135-fbc431f02a09-istio-podinfo\") pod \"e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj\" (UID: \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\") " pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:30:16.964248 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:16.964227    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2b3bbf0-2054-45ee-b135-fbc431f02a09-istio-envoy\") pod \"e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj\" (UID: \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\") " pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:30:17.002710 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:17.002672    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"]
Nov 02 08:30:17.037804 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:17.037778    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-bca68b-openshift-default-dockercfg-5f2bt\""
Nov 02 08:30:17.067437 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:17.065319    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2b3bbf0-2054-45ee-b135-fbc431f02a09-credential-socket\") pod \"e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj\" (UID: \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\") " pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:30:17.067437 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:17.065426    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2b3bbf0-2054-45ee-b135-fbc431f02a09-workload-certs\") pod \"e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj\" (UID: \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\") " pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:30:17.067437 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:17.065469    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2b3bbf0-2054-45ee-b135-fbc431f02a09-istiod-ca-cert\") pod \"e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj\" (UID: \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\") " pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:30:17.067437 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:17.065509    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfsqt\" (UniqueName: \"kubernetes.io/projected/d2b3bbf0-2054-45ee-b135-fbc431f02a09-kube-api-access-gfsqt\") pod \"e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj\" (UID: \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\") " pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:30:17.067437 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:17.065581    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2b3bbf0-2054-45ee-b135-fbc431f02a09-istio-data\") pod \"e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj\" (UID: \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\") " pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:30:17.067437 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:17.065625    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2b3bbf0-2054-45ee-b135-fbc431f02a09-istio-podinfo\") pod \"e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj\" (UID: \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\") " pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:30:17.067437 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:17.065744    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2b3bbf0-2054-45ee-b135-fbc431f02a09-istio-envoy\") pod \"e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj\" (UID: \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\") " pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:30:17.067437 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:17.065801    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2b3bbf0-2054-45ee-b135-fbc431f02a09-workload-socket\") pod \"e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj\" (UID: \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\") " pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:30:17.067437 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:17.065823    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2b3bbf0-2054-45ee-b135-fbc431f02a09-istio-token\") pod \"e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj\" (UID: \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\") " pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:30:17.067437 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:17.067427    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2b3bbf0-2054-45ee-b135-fbc431f02a09-istio-data\") pod \"e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj\" (UID: \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\") " pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:30:17.077373 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:17.068106    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2b3bbf0-2054-45ee-b135-fbc431f02a09-workload-socket\") pod \"e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj\" (UID: \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\") " pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:30:17.077373 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:17.068560    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2b3bbf0-2054-45ee-b135-fbc431f02a09-workload-certs\") pod \"e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj\" (UID: \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\") " pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:30:17.077373 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:17.068815    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2b3bbf0-2054-45ee-b135-fbc431f02a09-istiod-ca-cert\") pod \"e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj\" (UID: \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\") " pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:30:17.095747 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:17.088931    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2b3bbf0-2054-45ee-b135-fbc431f02a09-credential-socket\") pod \"e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj\" (UID: \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\") " pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:30:17.100565 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:17.100528    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2b3bbf0-2054-45ee-b135-fbc431f02a09-istio-podinfo\") pod \"e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj\" (UID: \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\") " pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:30:17.101211 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:17.101153    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2b3bbf0-2054-45ee-b135-fbc431f02a09-istio-envoy\") pod \"e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj\" (UID: \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\") " pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:30:17.141946 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:17.130644    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2b3bbf0-2054-45ee-b135-fbc431f02a09-istio-token\") pod \"e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj\" (UID: \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\") " pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:30:17.159019 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:17.156208    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfsqt\" (UniqueName: \"kubernetes.io/projected/d2b3bbf0-2054-45ee-b135-fbc431f02a09-kube-api-access-gfsqt\") pod \"e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj\" (UID: \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\") " pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:30:17.251444 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:17.251137    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:30:17.780646 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:17.780608    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"]
Nov 02 08:30:17.813667 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:30:17.813608    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2b3bbf0_2054_45ee_b135_fbc431f02a09.slice/crio-3d88bfdd11213a1d96a97c0b34b37431672d16a79930911fa4984d01976b8cc8 WatchSource:0}: Error finding container 3d88bfdd11213a1d96a97c0b34b37431672d16a79930911fa4984d01976b8cc8: Status 404 returned error can't find the container with id 3d88bfdd11213a1d96a97c0b34b37431672d16a79930911fa4984d01976b8cc8
Nov 02 08:30:17.816369 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:17.816327    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:30:17.816488 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:17.816400    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:30:17.816488 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:17.816430    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:30:17.967052 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:17.967002    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj" event={"ID":"d2b3bbf0-2054-45ee-b135-fbc431f02a09","Type":"ContainerStarted","Data":"b6206ac5856d0e106fc0d78084eea535526c9caced63dfed014c53a46976edbd"}
Nov 02 08:30:17.967495 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:17.967069    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj" event={"ID":"d2b3bbf0-2054-45ee-b135-fbc431f02a09","Type":"ContainerStarted","Data":"3d88bfdd11213a1d96a97c0b34b37431672d16a79930911fa4984d01976b8cc8"}
Nov 02 08:30:18.081627 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:18.081511    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj" podStartSLOduration=2.081491464 podStartE2EDuration="2.081491464s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:30:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:30:18.07816033 +0000 UTC m=+1407.836589074" watchObservedRunningTime="2026-11-02 08:30:18.081491464 +0000 UTC m=+1407.839920198"
Nov 02 08:30:18.254902 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:18.254031    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:30:18.254902 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:18.254146    6210 patch_prober.go:29] interesting pod/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Nov 02 08:30:18.254902 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:18.254189    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj" podUID="d2b3bbf0-2054-45ee-b135-fbc431f02a09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Nov 02 08:30:19.257244 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:19.257210    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:30:19.978635 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:19.978600    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:30:19.979585 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:19.979561    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:30:23.364338 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:23.357738    6210 scope.go:122] "RemoveContainer" containerID="162ffba5751396784f9bb29e62dff254c6e51656807054139137d797ac6f282a"
Nov 02 08:30:23.508742 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:23.508708    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9"]
Nov 02 08:30:23.525951 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:23.523390    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9"
Nov 02 08:30:23.536906 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:23.535063    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca605614-76a4-4da3-aaef-b077c7fc867c-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9\" (UID: \"ca605614-76a4-4da3-aaef-b077c7fc867c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9"
Nov 02 08:30:23.536906 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:23.535124    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjp7b\" (UniqueName: \"kubernetes.io/projected/ca605614-76a4-4da3-aaef-b077c7fc867c-kube-api-access-bjp7b\") pod \"payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9\" (UID: \"ca605614-76a4-4da3-aaef-b077c7fc867c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9"
Nov 02 08:30:23.581531 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:23.577242    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9"]
Nov 02 08:30:23.645957 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:23.639191    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-00cc0e\""
Nov 02 08:30:23.645957 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:23.639344    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-00cc0e-dockercfg-d4p5r\""
Nov 02 08:30:23.676904 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:23.666981    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca605614-76a4-4da3-aaef-b077c7fc867c-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9\" (UID: \"ca605614-76a4-4da3-aaef-b077c7fc867c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9"
Nov 02 08:30:23.676904 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:23.667049    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjp7b\" (UniqueName: \"kubernetes.io/projected/ca605614-76a4-4da3-aaef-b077c7fc867c-kube-api-access-bjp7b\") pod \"payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9\" (UID: \"ca605614-76a4-4da3-aaef-b077c7fc867c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9"
Nov 02 08:30:23.676904 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:23.668510    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca605614-76a4-4da3-aaef-b077c7fc867c-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9\" (UID: \"ca605614-76a4-4da3-aaef-b077c7fc867c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9"
Nov 02 08:30:23.905996 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:23.904585    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjp7b\" (UniqueName: \"kubernetes.io/projected/ca605614-76a4-4da3-aaef-b077c7fc867c-kube-api-access-bjp7b\") pod \"payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9\" (UID: \"ca605614-76a4-4da3-aaef-b077c7fc867c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9"
Nov 02 08:30:24.007759 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:24.007711    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cba6f9af-29893470-zqnlx" event={"ID":"121c8d2c-a869-4d3e-abd2-2f66ac8738ab","Type":"ContainerStarted","Data":"0731367b305685e5e138eb756174c5f4dfb02210c4c184c8ab27a436f390320b"}
Nov 02 08:30:24.120037 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:24.119977    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cba6f9af-29893470-zqnlx" podStartSLOduration=16.589693839 podStartE2EDuration="24.119959637s" totalImagesPullingTime="7.530265798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:30:24.119248778 +0000 UTC m=+1413.877677510" watchObservedRunningTime="2026-11-02 08:30:24.119959637 +0000 UTC m=+1413.878388371"
Nov 02 08:30:24.186465 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:24.186379    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9"
Nov 02 08:30:24.345431 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:24.345404    6210 scope.go:122] "RemoveContainer" containerID="f32aafb348488978911f699fcf0e53dbebcba19fe72e618f688542ea715f66ff"
Nov 02 08:30:24.560299 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:24.560273    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9"]
Nov 02 08:30:24.582761 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:30:24.582729    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca605614_76a4_4da3_aaef_b077c7fc867c.slice/crio-a47e1ffdf88de6d115fe40e283213fb583b692414e18dc844b0ef2a50fe116c0 WatchSource:0}: Error finding container a47e1ffdf88de6d115fe40e283213fb583b692414e18dc844b0ef2a50fe116c0: Status 404 returned error can't find the container with id a47e1ffdf88de6d115fe40e283213fb583b692414e18dc844b0ef2a50fe116c0
Nov 02 08:30:25.016632 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:25.016550    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9" event={"ID":"ca605614-76a4-4da3-aaef-b077c7fc867c","Type":"ContainerStarted","Data":"09c1fbbf16b25858af417256f30e2962d668339d0aeb635d4841a09b394e1cfe"}
Nov 02 08:30:25.016806 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:25.016634    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9" event={"ID":"ca605614-76a4-4da3-aaef-b077c7fc867c","Type":"ContainerStarted","Data":"a47e1ffdf88de6d115fe40e283213fb583b692414e18dc844b0ef2a50fe116c0"}
Nov 02 08:30:25.016806 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:25.016660    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9"
Nov 02 08:30:25.018702 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:25.018677    6210 generic.go:356] "Generic (PLEG): container finished" podID="121c8d2c-a869-4d3e-abd2-2f66ac8738ab" containerID="0731367b305685e5e138eb756174c5f4dfb02210c4c184c8ab27a436f390320b" exitCode=60
Nov 02 08:30:25.018805 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:25.018750    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cba6f9af-29893470-zqnlx" event={"ID":"121c8d2c-a869-4d3e-abd2-2f66ac8738ab","Type":"ContainerDied","Data":"0731367b305685e5e138eb756174c5f4dfb02210c4c184c8ab27a436f390320b"}
Nov 02 08:30:25.018854 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:25.018815    6210 scope.go:122] "RemoveContainer" containerID="162ffba5751396784f9bb29e62dff254c6e51656807054139137d797ac6f282a"
Nov 02 08:30:25.019177 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:25.019158    6210 scope.go:122] "RemoveContainer" containerID="0731367b305685e5e138eb756174c5f4dfb02210c4c184c8ab27a436f390320b"
Nov 02 08:30:25.019454 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:30:25.019430    6210 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-mt-cba6f9af-29893470-zqnlx_odh-ai-gateway-infra(121c8d2c-a869-4d3e-abd2-2f66ac8738ab)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cba6f9af-29893470-zqnlx" podUID="121c8d2c-a869-4d3e-abd2-2f66ac8738ab"
Nov 02 08:30:25.020785 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:25.020764    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29893470-q659r" event={"ID":"e8e87668-3205-4177-a130-030095f6fca5","Type":"ContainerStarted","Data":"1731133e5d9514af90f245a0ed68c46f84d5fc872520f233ebd2c52e6cff483f"}
Nov 02 08:30:25.123677 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:25.123631    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9" podStartSLOduration=2.123617824 podStartE2EDuration="2.123617824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:30:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:30:25.122073438 +0000 UTC m=+1414.880502186" watchObservedRunningTime="2026-11-02 08:30:25.123617824 +0000 UTC m=+1414.882046581"
Nov 02 08:30:25.130610 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:25.130585    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cba6f9af-29893470-zqnlx"]
Nov 02 08:30:25.345590 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:25.345518    6210 scope.go:122] "RemoveContainer" containerID="c54e6d314a22a0e7c0921b85cee2a92e033aeedf28064b3eee546f57ff620f0d"
Nov 02 08:30:26.030535 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:26.030502    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-8e6407-29893470-r9wtg" event={"ID":"f7b7b5e7-bac8-498d-93c1-717ab8e93a89","Type":"ContainerStarted","Data":"1ae0dfef048f75660c6bc97863a73926667777fb9077df5ea33b31b992de45f2"}
Nov 02 08:30:26.032396 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:26.032373    6210 generic.go:356] "Generic (PLEG): container finished" podID="e8e87668-3205-4177-a130-030095f6fca5" containerID="1731133e5d9514af90f245a0ed68c46f84d5fc872520f233ebd2c52e6cff483f" exitCode=60
Nov 02 08:30:26.032505 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:26.032452    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29893470-q659r" event={"ID":"e8e87668-3205-4177-a130-030095f6fca5","Type":"ContainerDied","Data":"1731133e5d9514af90f245a0ed68c46f84d5fc872520f233ebd2c52e6cff483f"}
Nov 02 08:30:26.032568 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:26.032542    6210 scope.go:122] "RemoveContainer" containerID="f32aafb348488978911f699fcf0e53dbebcba19fe72e618f688542ea715f66ff"
Nov 02 08:30:26.032871 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:26.032849    6210 scope.go:122] "RemoveContainer" containerID="1731133e5d9514af90f245a0ed68c46f84d5fc872520f233ebd2c52e6cff483f"
Nov 02 08:30:26.033160 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:30:26.033137    6210 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-29893470-q659r_odh-ai-gateway-infra(e8e87668-3205-4177-a130-030095f6fca5)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29893470-q659r" podUID="e8e87668-3205-4177-a130-030095f6fca5"
Nov 02 08:30:26.209150 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:26.209122    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cba6f9af-29893470-zqnlx"
Nov 02 08:30:26.217447 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:26.217425    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/121c8d2c-a869-4d3e-abd2-2f66ac8738ab-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/121c8d2c-a869-4d3e-abd2-2f66ac8738ab-maas-api-service-ca\") pod \"121c8d2c-a869-4d3e-abd2-2f66ac8738ab\" (UID: \"121c8d2c-a869-4d3e-abd2-2f66ac8738ab\") "
Nov 02 08:30:26.217672 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:26.217654    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/121c8d2c-a869-4d3e-abd2-2f66ac8738ab-kube-api-access-nk9xg\" (UniqueName: \"kubernetes.io/projected/121c8d2c-a869-4d3e-abd2-2f66ac8738ab-kube-api-access-nk9xg\") pod \"121c8d2c-a869-4d3e-abd2-2f66ac8738ab\" (UID: \"121c8d2c-a869-4d3e-abd2-2f66ac8738ab\") "
Nov 02 08:30:26.217805 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:26.217787    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/121c8d2c-a869-4d3e-abd2-2f66ac8738ab-maas-api-service-ca" pod "121c8d2c-a869-4d3e-abd2-2f66ac8738ab" (UID: "121c8d2c-a869-4d3e-abd2-2f66ac8738ab"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:30:26.218127 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:26.218112    6210 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/121c8d2c-a869-4d3e-abd2-2f66ac8738ab-maas-api-service-ca\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:30:26.219705 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:26.219686    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/121c8d2c-a869-4d3e-abd2-2f66ac8738ab-kube-api-access-nk9xg" pod "121c8d2c-a869-4d3e-abd2-2f66ac8738ab" (UID: "121c8d2c-a869-4d3e-abd2-2f66ac8738ab"). InnerVolumeSpecName "kube-api-access-nk9xg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:30:26.319588 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:26.319517    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nk9xg\" (UniqueName: \"kubernetes.io/projected/121c8d2c-a869-4d3e-abd2-2f66ac8738ab-kube-api-access-nk9xg\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:30:26.354351 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:26.354318    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29893470-q659r"]
Nov 02 08:30:27.039220 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:27.039189    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cba6f9af-29893470-zqnlx"
Nov 02 08:30:27.039698 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:27.039224    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cba6f9af-29893470-zqnlx" event={"ID":"121c8d2c-a869-4d3e-abd2-2f66ac8738ab","Type":"ContainerDied","Data":"eefc31cf22729a86bf122b31c91d9c44b577ff5964cc40e8d8d0d9d3b49cfff1"}
Nov 02 08:30:27.039698 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:27.039292    6210 scope.go:122] "RemoveContainer" containerID="0731367b305685e5e138eb756174c5f4dfb02210c4c184c8ab27a436f390320b"
Nov 02 08:30:27.041521 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:27.041498    6210 generic.go:356] "Generic (PLEG): container finished" podID="f7b7b5e7-bac8-498d-93c1-717ab8e93a89" containerID="1ae0dfef048f75660c6bc97863a73926667777fb9077df5ea33b31b992de45f2" exitCode=60
Nov 02 08:30:27.041662 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:27.041637    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-8e6407-29893470-r9wtg" event={"ID":"f7b7b5e7-bac8-498d-93c1-717ab8e93a89","Type":"ContainerDied","Data":"1ae0dfef048f75660c6bc97863a73926667777fb9077df5ea33b31b992de45f2"}
Nov 02 08:30:27.042061 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:27.042040    6210 scope.go:122] "RemoveContainer" containerID="1ae0dfef048f75660c6bc97863a73926667777fb9077df5ea33b31b992de45f2"
Nov 02 08:30:27.042405 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:30:27.042377    6210 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-8e6407-29893470-r9wtg_odh-ai-gateway-infra(f7b7b5e7-bac8-498d-93c1-717ab8e93a89)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-8e6407-29893470-r9wtg" podUID="f7b7b5e7-bac8-498d-93c1-717ab8e93a89"
Nov 02 08:30:27.049980 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:27.049958    6210 scope.go:122] "RemoveContainer" containerID="c54e6d314a22a0e7c0921b85cee2a92e033aeedf28064b3eee546f57ff620f0d"
Nov 02 08:30:27.196469 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:27.196441    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29893470-q659r"
Nov 02 08:30:27.230594 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:27.230562    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e8e87668-3205-4177-a130-030095f6fca5-kube-api-access-8nb2l\" (UniqueName: \"kubernetes.io/projected/e8e87668-3205-4177-a130-030095f6fca5-kube-api-access-8nb2l\") pod \"e8e87668-3205-4177-a130-030095f6fca5\" (UID: \"e8e87668-3205-4177-a130-030095f6fca5\") "
Nov 02 08:30:27.230768 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:27.230746    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e8e87668-3205-4177-a130-030095f6fca5-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e87668-3205-4177-a130-030095f6fca5-maas-api-service-ca\") pod \"e8e87668-3205-4177-a130-030095f6fca5\" (UID: \"e8e87668-3205-4177-a130-030095f6fca5\") "
Nov 02 08:30:27.231142 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:27.231114    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8e87668-3205-4177-a130-030095f6fca5-maas-api-service-ca" pod "e8e87668-3205-4177-a130-030095f6fca5" (UID: "e8e87668-3205-4177-a130-030095f6fca5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:30:27.232611 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:27.232586    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8e87668-3205-4177-a130-030095f6fca5-kube-api-access-8nb2l" pod "e8e87668-3205-4177-a130-030095f6fca5" (UID: "e8e87668-3205-4177-a130-030095f6fca5"). InnerVolumeSpecName "kube-api-access-8nb2l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:30:27.300071 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:27.299958    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cba6f9af-29893470-zqnlx"]
Nov 02 08:30:27.303052 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:27.303023    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cba6f9af-29893470-zqnlx"]
Nov 02 08:30:27.332503 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:27.332475    6210 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e87668-3205-4177-a130-030095f6fca5-maas-api-service-ca\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:30:27.332503 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:27.332500    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8nb2l\" (UniqueName: \"kubernetes.io/projected/e8e87668-3205-4177-a130-030095f6fca5-kube-api-access-8nb2l\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:30:27.357934 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:27.357907    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-8e6407-29893470-r9wtg"]
Nov 02 08:30:28.072033 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.072007    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29893470-q659r"
Nov 02 08:30:28.072604 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.072008    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29893470-q659r" event={"ID":"e8e87668-3205-4177-a130-030095f6fca5","Type":"ContainerDied","Data":"2c5e9bea33501545772e49870d4adbadd158a71966c2e7871dc85f97f6e5c4bd"}
Nov 02 08:30:28.072733 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.072659    6210 scope.go:122] "RemoveContainer" containerID="1731133e5d9514af90f245a0ed68c46f84d5fc872520f233ebd2c52e6cff483f"
Nov 02 08:30:28.370410 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.370326    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="121c8d2c-a869-4d3e-abd2-2f66ac8738ab" path="/var/lib/kubelet/pods/121c8d2c-a869-4d3e-abd2-2f66ac8738ab/volumes"
Nov 02 08:30:28.371462 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.371438    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29893470-q659r"]
Nov 02 08:30:28.371699 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.371651    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29893470-q659r"]
Nov 02 08:30:28.404009 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.403980    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-8e6407-29893470-r9wtg"
Nov 02 08:30:28.498783 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.498747    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f7b7b5e7-bac8-498d-93c1-717ab8e93a89-kube-api-access-l7s74\" (UniqueName: \"kubernetes.io/projected/f7b7b5e7-bac8-498d-93c1-717ab8e93a89-kube-api-access-l7s74\") pod \"f7b7b5e7-bac8-498d-93c1-717ab8e93a89\" (UID: \"f7b7b5e7-bac8-498d-93c1-717ab8e93a89\") "
Nov 02 08:30:28.510361 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.505566    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f7b7b5e7-bac8-498d-93c1-717ab8e93a89-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7b7b5e7-bac8-498d-93c1-717ab8e93a89-maas-api-service-ca\") pod \"f7b7b5e7-bac8-498d-93c1-717ab8e93a89\" (UID: \"f7b7b5e7-bac8-498d-93c1-717ab8e93a89\") "
Nov 02 08:30:28.510361 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.506758    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7b7b5e7-bac8-498d-93c1-717ab8e93a89-maas-api-service-ca" pod "f7b7b5e7-bac8-498d-93c1-717ab8e93a89" (UID: "f7b7b5e7-bac8-498d-93c1-717ab8e93a89"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:30:28.542719 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.542682    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7b7b5e7-bac8-498d-93c1-717ab8e93a89-kube-api-access-l7s74" pod "f7b7b5e7-bac8-498d-93c1-717ab8e93a89" (UID: "f7b7b5e7-bac8-498d-93c1-717ab8e93a89"). InnerVolumeSpecName "kube-api-access-l7s74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:30:28.567273 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.567238    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb"]
Nov 02 08:30:28.568100 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.568075    6210 cpu_manager.go:414] "containerMap: removing container" podUID="e8e87668-3205-4177-a130-030095f6fca5" containerName="cleanup"
Nov 02 08:30:28.568419 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.568397    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e8e87668-3205-4177-a130-030095f6fca5" containerName="cleanup"
Nov 02 08:30:28.568568 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.568551    6210 cpu_manager.go:414] "containerMap: removing container" podUID="121c8d2c-a869-4d3e-abd2-2f66ac8738ab" containerName="cleanup"
Nov 02 08:30:28.568673 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.568661    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="121c8d2c-a869-4d3e-abd2-2f66ac8738ab" containerName="cleanup"
Nov 02 08:30:28.568761 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.568751    6210 cpu_manager.go:414] "containerMap: removing container" podUID="f7b7b5e7-bac8-498d-93c1-717ab8e93a89" containerName="cleanup"
Nov 02 08:30:28.568849 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.568837    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f7b7b5e7-bac8-498d-93c1-717ab8e93a89" containerName="cleanup"
Nov 02 08:30:28.569018 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.569006    6210 cpu_manager.go:414] "containerMap: removing container" podUID="121c8d2c-a869-4d3e-abd2-2f66ac8738ab" containerName="cleanup"
Nov 02 08:30:28.569096 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.569084    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="121c8d2c-a869-4d3e-abd2-2f66ac8738ab" containerName="cleanup"
Nov 02 08:30:28.569204 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.569192    6210 cpu_manager.go:414] "containerMap: removing container" podUID="e8e87668-3205-4177-a130-030095f6fca5" containerName="cleanup"
Nov 02 08:30:28.569404 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.569348    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e8e87668-3205-4177-a130-030095f6fca5" containerName="cleanup"
Nov 02 08:30:28.569516 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.569503    6210 cpu_manager.go:414] "containerMap: removing container" podUID="f7b7b5e7-bac8-498d-93c1-717ab8e93a89" containerName="cleanup"
Nov 02 08:30:28.569663 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.569650    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f7b7b5e7-bac8-498d-93c1-717ab8e93a89" containerName="cleanup"
Nov 02 08:30:28.569926 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.569909    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="121c8d2c-a869-4d3e-abd2-2f66ac8738ab" containerName="cleanup"
Nov 02 08:30:28.570038 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.570027    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="e8e87668-3205-4177-a130-030095f6fca5" containerName="cleanup"
Nov 02 08:30:28.570125 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.570115    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="f7b7b5e7-bac8-498d-93c1-717ab8e93a89" containerName="cleanup"
Nov 02 08:30:28.570198 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.570189    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="f7b7b5e7-bac8-498d-93c1-717ab8e93a89" containerName="cleanup"
Nov 02 08:30:28.570274 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.570265    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="e8e87668-3205-4177-a130-030095f6fca5" containerName="cleanup"
Nov 02 08:30:28.570356 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.570345    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="121c8d2c-a869-4d3e-abd2-2f66ac8738ab" containerName="cleanup"
Nov 02 08:30:28.570431 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.570422    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="f7b7b5e7-bac8-498d-93c1-717ab8e93a89" containerName="cleanup"
Nov 02 08:30:28.574964 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.574944    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb"
Nov 02 08:30:28.607520 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.607478    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7s74\" (UniqueName: \"kubernetes.io/projected/f7b7b5e7-bac8-498d-93c1-717ab8e93a89-kube-api-access-l7s74\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:30:28.607520 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.607510    6210 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7b7b5e7-bac8-498d-93c1-717ab8e93a89-maas-api-service-ca\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:30:28.625315 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.625222    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-bca68b\""
Nov 02 08:30:28.625482 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.625346    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-bca68b-dockercfg-7rzlp\""
Nov 02 08:30:28.627789 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.627685    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb"]
Nov 02 08:30:28.801709 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.800864    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee204718-9b92-4b57-94d3-0fdd1cf05988-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb\" (UID: \"ee204718-9b92-4b57-94d3-0fdd1cf05988\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb"
Nov 02 08:30:28.802068 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.802039    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5f7b\" (UniqueName: \"kubernetes.io/projected/ee204718-9b92-4b57-94d3-0fdd1cf05988-kube-api-access-l5f7b\") pod \"payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb\" (UID: \"ee204718-9b92-4b57-94d3-0fdd1cf05988\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb"
Nov 02 08:30:28.803738 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.803717    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc"]
Nov 02 08:30:28.805066 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.804721    6210 cpu_manager.go:414] "containerMap: removing container" podUID="f7b7b5e7-bac8-498d-93c1-717ab8e93a89" containerName="cleanup"
Nov 02 08:30:28.805200 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.805183    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f7b7b5e7-bac8-498d-93c1-717ab8e93a89" containerName="cleanup"
Nov 02 08:30:28.805367 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.805322    6210 cpu_manager.go:414] "containerMap: removing container" podUID="121c8d2c-a869-4d3e-abd2-2f66ac8738ab" containerName="cleanup"
Nov 02 08:30:28.805460 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.805445    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="121c8d2c-a869-4d3e-abd2-2f66ac8738ab" containerName="cleanup"
Nov 02 08:30:28.805570 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.805558    6210 cpu_manager.go:414] "containerMap: removing container" podUID="e8e87668-3205-4177-a130-030095f6fca5" containerName="cleanup"
Nov 02 08:30:28.805653 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.805642    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e8e87668-3205-4177-a130-030095f6fca5" containerName="cleanup"
Nov 02 08:30:28.805910 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.805895    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="e8e87668-3205-4177-a130-030095f6fca5" containerName="cleanup"
Nov 02 08:30:28.806020 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.806009    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="121c8d2c-a869-4d3e-abd2-2f66ac8738ab" containerName="cleanup"
Nov 02 08:30:28.810067 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.810048    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc"
Nov 02 08:30:28.856771 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.854765    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc"]
Nov 02 08:30:28.929238 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.928972    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5f7b\" (UniqueName: \"kubernetes.io/projected/ee204718-9b92-4b57-94d3-0fdd1cf05988-kube-api-access-l5f7b\") pod \"payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb\" (UID: \"ee204718-9b92-4b57-94d3-0fdd1cf05988\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb"
Nov 02 08:30:28.929238 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.929057    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2tdz\" (UniqueName: \"kubernetes.io/projected/84c73bdd-c4d0-406e-8d9a-2a16958e08d8-kube-api-access-z2tdz\") pod \"payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc\" (UID: \"84c73bdd-c4d0-406e-8d9a-2a16958e08d8\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc"
Nov 02 08:30:28.929514 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.929299    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84c73bdd-c4d0-406e-8d9a-2a16958e08d8-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc\" (UID: \"84c73bdd-c4d0-406e-8d9a-2a16958e08d8\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc"
Nov 02 08:30:28.929514 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.929378    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee204718-9b92-4b57-94d3-0fdd1cf05988-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb\" (UID: \"ee204718-9b92-4b57-94d3-0fdd1cf05988\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb"
Nov 02 08:30:28.931293 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.930408    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee204718-9b92-4b57-94d3-0fdd1cf05988-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb\" (UID: \"ee204718-9b92-4b57-94d3-0fdd1cf05988\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb"
Nov 02 08:30:28.984272 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:28.984238    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5f7b\" (UniqueName: \"kubernetes.io/projected/ee204718-9b92-4b57-94d3-0fdd1cf05988-kube-api-access-l5f7b\") pod \"payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb\" (UID: \"ee204718-9b92-4b57-94d3-0fdd1cf05988\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb"
Nov 02 08:30:29.031388 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:29.031356    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2tdz\" (UniqueName: \"kubernetes.io/projected/84c73bdd-c4d0-406e-8d9a-2a16958e08d8-kube-api-access-z2tdz\") pod \"payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc\" (UID: \"84c73bdd-c4d0-406e-8d9a-2a16958e08d8\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc"
Nov 02 08:30:29.031547 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:29.031481    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84c73bdd-c4d0-406e-8d9a-2a16958e08d8-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc\" (UID: \"84c73bdd-c4d0-406e-8d9a-2a16958e08d8\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc"
Nov 02 08:30:29.032206 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:29.032178    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84c73bdd-c4d0-406e-8d9a-2a16958e08d8-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc\" (UID: \"84c73bdd-c4d0-406e-8d9a-2a16958e08d8\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc"
Nov 02 08:30:29.080070 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:29.080041    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-8e6407-29893470-r9wtg"
Nov 02 08:30:29.080499 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:29.080083    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-8e6407-29893470-r9wtg" event={"ID":"f7b7b5e7-bac8-498d-93c1-717ab8e93a89","Type":"ContainerDied","Data":"87f047c61d5556dfe2a94b57c32ec63312d0875d63717340807d54e8a5e4ef7c"}
Nov 02 08:30:29.080499 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:29.080159    6210 scope.go:122] "RemoveContainer" containerID="1ae0dfef048f75660c6bc97863a73926667777fb9077df5ea33b31b992de45f2"
Nov 02 08:30:29.084659 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:29.084633    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2tdz\" (UniqueName: \"kubernetes.io/projected/84c73bdd-c4d0-406e-8d9a-2a16958e08d8-kube-api-access-z2tdz\") pod \"payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc\" (UID: \"84c73bdd-c4d0-406e-8d9a-2a16958e08d8\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc"
Nov 02 08:30:29.170398 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:29.170369    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc"
Nov 02 08:30:29.193235 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:29.193211    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb"
Nov 02 08:30:29.235068 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:29.235019    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-8e6407-29893470-r9wtg"]
Nov 02 08:30:29.249843 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:29.249374    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-8e6407-29893470-r9wtg"]
Nov 02 08:30:29.542677 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:29.542647    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc"]
Nov 02 08:30:29.544231 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:30:29.544205    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84c73bdd_c4d0_406e_8d9a_2a16958e08d8.slice/crio-c9ac8f5163ce070067947fa7aa55122e2bf7d7bc7b4905326159f9e852c3f449 WatchSource:0}: Error finding container c9ac8f5163ce070067947fa7aa55122e2bf7d7bc7b4905326159f9e852c3f449: Status 404 returned error can't find the container with id c9ac8f5163ce070067947fa7aa55122e2bf7d7bc7b4905326159f9e852c3f449
Nov 02 08:30:29.587501 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:29.587471    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb"]
Nov 02 08:30:29.589597 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:30:29.589566    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee204718_9b92_4b57_94d3_0fdd1cf05988.slice/crio-10d48bb1dda209194dc8c66e6012fb66250fd1c82feea3a77e3be47e9269357e WatchSource:0}: Error finding container 10d48bb1dda209194dc8c66e6012fb66250fd1c82feea3a77e3be47e9269357e: Status 404 returned error can't find the container with id 10d48bb1dda209194dc8c66e6012fb66250fd1c82feea3a77e3be47e9269357e
Nov 02 08:30:30.089777 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:30.089739    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc" event={"ID":"84c73bdd-c4d0-406e-8d9a-2a16958e08d8","Type":"ContainerStarted","Data":"723c23a728142ab46a99dbad8fc122187b56ef4c7212a3fd9aec982d5c7ef442"}
Nov 02 08:30:30.090282 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:30.089802    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc"
Nov 02 08:30:30.090282 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:30.089826    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc" event={"ID":"84c73bdd-c4d0-406e-8d9a-2a16958e08d8","Type":"ContainerStarted","Data":"c9ac8f5163ce070067947fa7aa55122e2bf7d7bc7b4905326159f9e852c3f449"}
Nov 02 08:30:30.091198 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:30.091171    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb" event={"ID":"ee204718-9b92-4b57-94d3-0fdd1cf05988","Type":"ContainerStarted","Data":"5616e8aa8944828a4ec88c644ec44f3e32c4433e7d46abfa43a956df14fcfb5c"}
Nov 02 08:30:30.091314 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:30.091219    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb" event={"ID":"ee204718-9b92-4b57-94d3-0fdd1cf05988","Type":"ContainerStarted","Data":"10d48bb1dda209194dc8c66e6012fb66250fd1c82feea3a77e3be47e9269357e"}
Nov 02 08:30:30.091314 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:30.091241    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb"
Nov 02 08:30:30.200387 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:30.200335    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc" podStartSLOduration=2.200322053 podStartE2EDuration="2.200322053s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:30:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:30:30.198216177 +0000 UTC m=+1419.956644912" watchObservedRunningTime="2026-11-02 08:30:30.200322053 +0000 UTC m=+1419.958750786"
Nov 02 08:30:30.310563 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:30.310475    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb" podStartSLOduration=2.310456565 podStartE2EDuration="2.310456565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:30:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:30:30.305055594 +0000 UTC m=+1420.063484328" watchObservedRunningTime="2026-11-02 08:30:30.310456565 +0000 UTC m=+1420.068885299"
Nov 02 08:30:30.380334 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:30.380239    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e8e87668-3205-4177-a130-030095f6fca5" path="/var/lib/kubelet/pods/e8e87668-3205-4177-a130-030095f6fca5/volumes"
Nov 02 08:30:30.381263 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:30.381224    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f7b7b5e7-bac8-498d-93c1-717ab8e93a89" path="/var/lib/kubelet/pods/f7b7b5e7-bac8-498d-93c1-717ab8e93a89/volumes"
Nov 02 08:30:30.824728 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:30:30.824321    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:30:36.036243 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:36.036210    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9"
Nov 02 08:30:41.073644 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:41.073598    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn"]
Nov 02 08:30:41.088704 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:41.088675    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn"
Nov 02 08:30:41.121694 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:41.121667    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb"
Nov 02 08:30:41.121823 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:41.121728    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc"
Nov 02 08:30:41.125974 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:41.125952    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn"]
Nov 02 08:30:41.171936 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:41.170234    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-19ee94\""
Nov 02 08:30:41.171936 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:41.170425    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-19ee94-dockercfg-4cwx4\""
Nov 02 08:30:41.231898 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:41.231284    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82z85\" (UniqueName: \"kubernetes.io/projected/f94c4843-39ab-4210-8c12-6bcf80a36401-kube-api-access-82z85\") pod \"payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn\" (UID: \"f94c4843-39ab-4210-8c12-6bcf80a36401\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn"
Nov 02 08:30:41.231898 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:41.231470    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f94c4843-39ab-4210-8c12-6bcf80a36401-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn\" (UID: \"f94c4843-39ab-4210-8c12-6bcf80a36401\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn"
Nov 02 08:30:41.355423 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:41.355330    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f94c4843-39ab-4210-8c12-6bcf80a36401-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn\" (UID: \"f94c4843-39ab-4210-8c12-6bcf80a36401\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn"
Nov 02 08:30:41.355638 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:41.355482    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82z85\" (UniqueName: \"kubernetes.io/projected/f94c4843-39ab-4210-8c12-6bcf80a36401-kube-api-access-82z85\") pod \"payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn\" (UID: \"f94c4843-39ab-4210-8c12-6bcf80a36401\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn"
Nov 02 08:30:41.356313 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:41.356280    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f94c4843-39ab-4210-8c12-6bcf80a36401-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn\" (UID: \"f94c4843-39ab-4210-8c12-6bcf80a36401\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn"
Nov 02 08:30:41.409233 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:41.409196    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82z85\" (UniqueName: \"kubernetes.io/projected/f94c4843-39ab-4210-8c12-6bcf80a36401-kube-api-access-82z85\") pod \"payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn\" (UID: \"f94c4843-39ab-4210-8c12-6bcf80a36401\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn"
Nov 02 08:30:41.707841 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:41.705458    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn"
Nov 02 08:30:42.077803 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:42.077771    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn"]
Nov 02 08:30:42.080151 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:30:42.080126    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf94c4843_39ab_4210_8c12_6bcf80a36401.slice/crio-c51bad7d218277a8f6e338932f8e07072ca5261c6b99af42402b71dd74747556 WatchSource:0}: Error finding container c51bad7d218277a8f6e338932f8e07072ca5261c6b99af42402b71dd74747556: Status 404 returned error can't find the container with id c51bad7d218277a8f6e338932f8e07072ca5261c6b99af42402b71dd74747556
Nov 02 08:30:42.362955 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:42.362825    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn" event={"ID":"f94c4843-39ab-4210-8c12-6bcf80a36401","Type":"ContainerStarted","Data":"b57ca663bd0566dd56e9379ecb9dcacd8a3f5602f8ebf9dad912956ade45d971"}
Nov 02 08:30:42.362955 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:42.362892    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn" event={"ID":"f94c4843-39ab-4210-8c12-6bcf80a36401","Type":"ContainerStarted","Data":"c51bad7d218277a8f6e338932f8e07072ca5261c6b99af42402b71dd74747556"}
Nov 02 08:30:42.362955 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:42.362925    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn"
Nov 02 08:30:42.471649 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:42.471594    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn" podStartSLOduration=1.471579829 podStartE2EDuration="1.471579829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:30:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:30:42.470654295 +0000 UTC m=+1432.229083024" watchObservedRunningTime="2026-11-02 08:30:42.471579829 +0000 UTC m=+1432.230008561"
Nov 02 08:30:52.166180 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:52.166145    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"]
Nov 02 08:30:52.171658 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:52.171634    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"
Nov 02 08:30:52.222853 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:52.222829    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-cba6f9af-openshift-default-dockercfg-lc888\""
Nov 02 08:30:52.269250 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:52.269220    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"]
Nov 02 08:30:52.314749 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:52.314716    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36a05f34-aef7-440a-9a18-8c6b9812990a-workload-socket\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-t7927\" (UID: \"36a05f34-aef7-440a-9a18-8c6b9812990a\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"
Nov 02 08:30:52.314957 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:52.314837    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36a05f34-aef7-440a-9a18-8c6b9812990a-credential-socket\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-t7927\" (UID: \"36a05f34-aef7-440a-9a18-8c6b9812990a\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"
Nov 02 08:30:52.314957 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:52.314867    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxvtv\" (UniqueName: \"kubernetes.io/projected/36a05f34-aef7-440a-9a18-8c6b9812990a-kube-api-access-zxvtv\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-t7927\" (UID: \"36a05f34-aef7-440a-9a18-8c6b9812990a\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"
Nov 02 08:30:52.315104 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:52.315003    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36a05f34-aef7-440a-9a18-8c6b9812990a-istio-podinfo\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-t7927\" (UID: \"36a05f34-aef7-440a-9a18-8c6b9812990a\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"
Nov 02 08:30:52.315104 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:52.315075    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36a05f34-aef7-440a-9a18-8c6b9812990a-istio-envoy\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-t7927\" (UID: \"36a05f34-aef7-440a-9a18-8c6b9812990a\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"
Nov 02 08:30:52.315220 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:52.315119    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36a05f34-aef7-440a-9a18-8c6b9812990a-istio-data\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-t7927\" (UID: \"36a05f34-aef7-440a-9a18-8c6b9812990a\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"
Nov 02 08:30:52.315220 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:52.315148    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36a05f34-aef7-440a-9a18-8c6b9812990a-istio-token\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-t7927\" (UID: \"36a05f34-aef7-440a-9a18-8c6b9812990a\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"
Nov 02 08:30:52.315307 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:52.315288    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36a05f34-aef7-440a-9a18-8c6b9812990a-istiod-ca-cert\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-t7927\" (UID: \"36a05f34-aef7-440a-9a18-8c6b9812990a\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"
Nov 02 08:30:52.315368 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:52.315355    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36a05f34-aef7-440a-9a18-8c6b9812990a-workload-certs\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-t7927\" (UID: \"36a05f34-aef7-440a-9a18-8c6b9812990a\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"
Nov 02 08:30:52.417069 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:52.416978    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36a05f34-aef7-440a-9a18-8c6b9812990a-workload-socket\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-t7927\" (UID: \"36a05f34-aef7-440a-9a18-8c6b9812990a\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"
Nov 02 08:30:52.417260 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:52.417085    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36a05f34-aef7-440a-9a18-8c6b9812990a-credential-socket\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-t7927\" (UID: \"36a05f34-aef7-440a-9a18-8c6b9812990a\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"
Nov 02 08:30:52.417260 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:52.417125    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxvtv\" (UniqueName: \"kubernetes.io/projected/36a05f34-aef7-440a-9a18-8c6b9812990a-kube-api-access-zxvtv\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-t7927\" (UID: \"36a05f34-aef7-440a-9a18-8c6b9812990a\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"
Nov 02 08:30:52.417260 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:52.417214    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36a05f34-aef7-440a-9a18-8c6b9812990a-istio-podinfo\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-t7927\" (UID: \"36a05f34-aef7-440a-9a18-8c6b9812990a\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"
Nov 02 08:30:52.417433 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:52.417259    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36a05f34-aef7-440a-9a18-8c6b9812990a-istio-envoy\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-t7927\" (UID: \"36a05f34-aef7-440a-9a18-8c6b9812990a\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"
Nov 02 08:30:52.417433 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:52.417288    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36a05f34-aef7-440a-9a18-8c6b9812990a-istio-data\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-t7927\" (UID: \"36a05f34-aef7-440a-9a18-8c6b9812990a\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"
Nov 02 08:30:52.417433 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:52.417314    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36a05f34-aef7-440a-9a18-8c6b9812990a-istio-token\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-t7927\" (UID: \"36a05f34-aef7-440a-9a18-8c6b9812990a\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"
Nov 02 08:30:52.417433 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:52.417406    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36a05f34-aef7-440a-9a18-8c6b9812990a-workload-socket\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-t7927\" (UID: \"36a05f34-aef7-440a-9a18-8c6b9812990a\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"
Nov 02 08:30:52.417433 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:52.417415    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36a05f34-aef7-440a-9a18-8c6b9812990a-istiod-ca-cert\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-t7927\" (UID: \"36a05f34-aef7-440a-9a18-8c6b9812990a\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"
Nov 02 08:30:52.417689 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:52.417481    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36a05f34-aef7-440a-9a18-8c6b9812990a-credential-socket\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-t7927\" (UID: \"36a05f34-aef7-440a-9a18-8c6b9812990a\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"
Nov 02 08:30:52.417689 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:52.417503    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36a05f34-aef7-440a-9a18-8c6b9812990a-workload-certs\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-t7927\" (UID: \"36a05f34-aef7-440a-9a18-8c6b9812990a\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"
Nov 02 08:30:52.417802 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:52.417687    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36a05f34-aef7-440a-9a18-8c6b9812990a-istio-data\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-t7927\" (UID: \"36a05f34-aef7-440a-9a18-8c6b9812990a\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"
Nov 02 08:30:52.417862 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:52.417826    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36a05f34-aef7-440a-9a18-8c6b9812990a-workload-certs\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-t7927\" (UID: \"36a05f34-aef7-440a-9a18-8c6b9812990a\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"
Nov 02 08:30:52.418150 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:52.418124    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36a05f34-aef7-440a-9a18-8c6b9812990a-istiod-ca-cert\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-t7927\" (UID: \"36a05f34-aef7-440a-9a18-8c6b9812990a\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"
Nov 02 08:30:52.419508 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:52.419487    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36a05f34-aef7-440a-9a18-8c6b9812990a-istio-envoy\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-t7927\" (UID: \"36a05f34-aef7-440a-9a18-8c6b9812990a\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"
Nov 02 08:30:52.419828 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:52.419811    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36a05f34-aef7-440a-9a18-8c6b9812990a-istio-podinfo\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-t7927\" (UID: \"36a05f34-aef7-440a-9a18-8c6b9812990a\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"
Nov 02 08:30:52.471445 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:52.471403    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36a05f34-aef7-440a-9a18-8c6b9812990a-istio-token\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-t7927\" (UID: \"36a05f34-aef7-440a-9a18-8c6b9812990a\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"
Nov 02 08:30:52.472500 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:52.472476    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxvtv\" (UniqueName: \"kubernetes.io/projected/36a05f34-aef7-440a-9a18-8c6b9812990a-kube-api-access-zxvtv\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-t7927\" (UID: \"36a05f34-aef7-440a-9a18-8c6b9812990a\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"
Nov 02 08:30:52.485542 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:52.485518    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"
Nov 02 08:30:52.955100 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:52.955073    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"]
Nov 02 08:30:52.956898 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:30:52.956858    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36a05f34_aef7_440a_9a18_8c6b9812990a.slice/crio-ae9178a638eb47cd5f04168d481a7967375e17db72cfe67fe1c6636c0e366226 WatchSource:0}: Error finding container ae9178a638eb47cd5f04168d481a7967375e17db72cfe67fe1c6636c0e366226: Status 404 returned error can't find the container with id ae9178a638eb47cd5f04168d481a7967375e17db72cfe67fe1c6636c0e366226
Nov 02 08:30:52.959605 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:52.959569    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:30:52.959685 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:52.959637    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:30:52.959685 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:52.959666    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:30:53.372630 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:53.372603    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn"
Nov 02 08:30:53.432047 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:53.432011    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927" event={"ID":"36a05f34-aef7-440a-9a18-8c6b9812990a","Type":"ContainerStarted","Data":"f274b522361c13881bdbbee90abbd59b849f5ee46b54fba1c1fe489f2bafe521"}
Nov 02 08:30:53.432189 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:53.432067    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927" event={"ID":"36a05f34-aef7-440a-9a18-8c6b9812990a","Type":"ContainerStarted","Data":"ae9178a638eb47cd5f04168d481a7967375e17db72cfe67fe1c6636c0e366226"}
Nov 02 08:30:53.486507 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:53.486468    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"
Nov 02 08:30:53.588144 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:53.588089    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927" podStartSLOduration=1.588071243 podStartE2EDuration="1.588071243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:30:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:30:53.588006187 +0000 UTC m=+1443.346434923" watchObservedRunningTime="2026-11-02 08:30:53.588071243 +0000 UTC m=+1443.346499975"
Nov 02 08:30:54.488333 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:54.488301    6210 patch_prober.go:29] interesting pod/e2e-mt-cba6f9af-openshift-default-db985b657-t7927 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Nov 02 08:30:54.488840 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:54.488356    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927" podUID="36a05f34-aef7-440a-9a18-8c6b9812990a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Nov 02 08:30:55.486343 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:55.486304    6210 patch_prober.go:29] interesting pod/e2e-mt-cba6f9af-openshift-default-db985b657-t7927 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Nov 02 08:30:55.486545 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:55.486372    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927" podUID="36a05f34-aef7-440a-9a18-8c6b9812990a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Nov 02 08:30:56.233903 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:56.226391    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj"]
Nov 02 08:30:56.256769 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:56.255196    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj"
Nov 02 08:30:56.296907 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:56.295829    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj"]
Nov 02 08:30:56.326182 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:56.326148    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-c7f7d7-dockercfg-bcd2c\""
Nov 02 08:30:56.335908 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:56.327158    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-c7f7d7\""
Nov 02 08:30:56.486984 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:56.474397    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9mv5\" (UniqueName: \"kubernetes.io/projected/7c7034e7-ee65-4f14-8731-21d93d7fa08c-kube-api-access-h9mv5\") pod \"payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj\" (UID: \"7c7034e7-ee65-4f14-8731-21d93d7fa08c\") " pod="openshift-ingress/payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj"
Nov 02 08:30:56.486984 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:56.474591    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c7034e7-ee65-4f14-8731-21d93d7fa08c-plugins-config-volume\") pod \"payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj\" (UID: \"7c7034e7-ee65-4f14-8731-21d93d7fa08c\") " pod="openshift-ingress/payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj"
Nov 02 08:30:56.496610 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:56.493007    6210 patch_prober.go:29] interesting pod/e2e-mt-cba6f9af-openshift-default-db985b657-t7927 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Nov 02 08:30:56.496610 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:56.493081    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927" podUID="36a05f34-aef7-440a-9a18-8c6b9812990a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Nov 02 08:30:56.575440 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:56.575398    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9mv5\" (UniqueName: \"kubernetes.io/projected/7c7034e7-ee65-4f14-8731-21d93d7fa08c-kube-api-access-h9mv5\") pod \"payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj\" (UID: \"7c7034e7-ee65-4f14-8731-21d93d7fa08c\") " pod="openshift-ingress/payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj"
Nov 02 08:30:56.575610 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:56.575517    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c7034e7-ee65-4f14-8731-21d93d7fa08c-plugins-config-volume\") pod \"payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj\" (UID: \"7c7034e7-ee65-4f14-8731-21d93d7fa08c\") " pod="openshift-ingress/payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj"
Nov 02 08:30:56.576375 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:56.576353    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c7034e7-ee65-4f14-8731-21d93d7fa08c-plugins-config-volume\") pod \"payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj\" (UID: \"7c7034e7-ee65-4f14-8731-21d93d7fa08c\") " pod="openshift-ingress/payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj"
Nov 02 08:30:56.629561 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:56.629530    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9mv5\" (UniqueName: \"kubernetes.io/projected/7c7034e7-ee65-4f14-8731-21d93d7fa08c-kube-api-access-h9mv5\") pod \"payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj\" (UID: \"7c7034e7-ee65-4f14-8731-21d93d7fa08c\") " pod="openshift-ingress/payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj"
Nov 02 08:30:56.798058 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:56.797975    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj"
Nov 02 08:30:57.194926 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:57.194889    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj"]
Nov 02 08:30:57.196857 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:30:57.196819    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c7034e7_ee65_4f14_8731_21d93d7fa08c.slice/crio-f32061a1b918f9241a0c8e77aed112d99006c4f8af549da4754df552c1b6698e WatchSource:0}: Error finding container f32061a1b918f9241a0c8e77aed112d99006c4f8af549da4754df552c1b6698e: Status 404 returned error can't find the container with id f32061a1b918f9241a0c8e77aed112d99006c4f8af549da4754df552c1b6698e
Nov 02 08:30:57.486123 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:57.486090    6210 patch_prober.go:29] interesting pod/e2e-mt-cba6f9af-openshift-default-db985b657-t7927 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Nov 02 08:30:57.486526 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:57.486141    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927" podUID="36a05f34-aef7-440a-9a18-8c6b9812990a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Nov 02 08:30:57.531710 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:57.531673    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj" event={"ID":"7c7034e7-ee65-4f14-8731-21d93d7fa08c","Type":"ContainerStarted","Data":"7620ca5f7cc4b7ecbcd125f85ee9bf9286d344ad159d990e785d690b38d4a0e6"}
Nov 02 08:30:57.531910 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:57.531731    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj" event={"ID":"7c7034e7-ee65-4f14-8731-21d93d7fa08c","Type":"ContainerStarted","Data":"f32061a1b918f9241a0c8e77aed112d99006c4f8af549da4754df552c1b6698e"}
Nov 02 08:30:57.531910 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:57.531753    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj"
Nov 02 08:30:57.640652 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:57.640598    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj" podStartSLOduration=1.6405839229999999 podStartE2EDuration="1.640583923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:30:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:30:57.638721643 +0000 UTC m=+1447.397150376" watchObservedRunningTime="2026-11-02 08:30:57.640583923 +0000 UTC m=+1447.399012654"
Nov 02 08:30:58.486822 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:58.486788    6210 patch_prober.go:29] interesting pod/e2e-mt-cba6f9af-openshift-default-db985b657-t7927 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Nov 02 08:30:58.487247 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:58.486856    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927" podUID="36a05f34-aef7-440a-9a18-8c6b9812990a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Nov 02 08:30:59.486775 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:59.486736    6210 patch_prober.go:29] interesting pod/e2e-mt-cba6f9af-openshift-default-db985b657-t7927 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Nov 02 08:30:59.486993 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:30:59.486806    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927" podUID="36a05f34-aef7-440a-9a18-8c6b9812990a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Nov 02 08:31:00.491093 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:00.491064    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"
Nov 02 08:31:00.491548 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:00.491528    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"
Nov 02 08:31:00.492181 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:00.492154    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"
Nov 02 08:31:00.825922 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:31:00.825809    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:31:08.540744 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:08.540716    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj"
Nov 02 08:31:30.821874 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:31:30.821835    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:31:34.168452 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:34.168417    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a25202-6c4578db76-gkrqv"]
Nov 02 08:31:34.174061 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:34.174038    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a25202-6c4578db76-gkrqv"
Nov 02 08:31:34.269623 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:34.269594    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-a25202-serving-cert\""
Nov 02 08:31:34.272604 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:34.272578    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a25202-6c4578db76-gkrqv"]
Nov 02 08:31:34.328255 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:34.328217    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e080b58-6116-41f4-a940-0b18c2d15049-maas-api-tls\") pod \"maas-api-e2e-api-b-a25202-6c4578db76-gkrqv\" (UID: \"2e080b58-6116-41f4-a940-0b18c2d15049\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a25202-6c4578db76-gkrqv"
Nov 02 08:31:34.328554 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:34.328268    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e080b58-6116-41f4-a940-0b18c2d15049-openshift-service-ca\") pod \"maas-api-e2e-api-b-a25202-6c4578db76-gkrqv\" (UID: \"2e080b58-6116-41f4-a940-0b18c2d15049\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a25202-6c4578db76-gkrqv"
Nov 02 08:31:34.328554 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:34.328341    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e080b58-6116-41f4-a940-0b18c2d15049-metrics-certs\") pod \"maas-api-e2e-api-b-a25202-6c4578db76-gkrqv\" (UID: \"2e080b58-6116-41f4-a940-0b18c2d15049\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a25202-6c4578db76-gkrqv"
Nov 02 08:31:34.328554 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:34.328471    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqbw6\" (UniqueName: \"kubernetes.io/projected/2e080b58-6116-41f4-a940-0b18c2d15049-kube-api-access-kqbw6\") pod \"maas-api-e2e-api-b-a25202-6c4578db76-gkrqv\" (UID: \"2e080b58-6116-41f4-a940-0b18c2d15049\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a25202-6c4578db76-gkrqv"
Nov 02 08:31:34.429999 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:34.429919    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e080b58-6116-41f4-a940-0b18c2d15049-maas-api-tls\") pod \"maas-api-e2e-api-b-a25202-6c4578db76-gkrqv\" (UID: \"2e080b58-6116-41f4-a940-0b18c2d15049\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a25202-6c4578db76-gkrqv"
Nov 02 08:31:34.429999 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:34.429957    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e080b58-6116-41f4-a940-0b18c2d15049-openshift-service-ca\") pod \"maas-api-e2e-api-b-a25202-6c4578db76-gkrqv\" (UID: \"2e080b58-6116-41f4-a940-0b18c2d15049\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a25202-6c4578db76-gkrqv"
Nov 02 08:31:34.429999 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:34.429999    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e080b58-6116-41f4-a940-0b18c2d15049-metrics-certs\") pod \"maas-api-e2e-api-b-a25202-6c4578db76-gkrqv\" (UID: \"2e080b58-6116-41f4-a940-0b18c2d15049\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a25202-6c4578db76-gkrqv"
Nov 02 08:31:34.430273 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:34.430042    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqbw6\" (UniqueName: \"kubernetes.io/projected/2e080b58-6116-41f4-a940-0b18c2d15049-kube-api-access-kqbw6\") pod \"maas-api-e2e-api-b-a25202-6c4578db76-gkrqv\" (UID: \"2e080b58-6116-41f4-a940-0b18c2d15049\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a25202-6c4578db76-gkrqv"
Nov 02 08:31:34.430621 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:34.430599    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e080b58-6116-41f4-a940-0b18c2d15049-openshift-service-ca\") pod \"maas-api-e2e-api-b-a25202-6c4578db76-gkrqv\" (UID: \"2e080b58-6116-41f4-a940-0b18c2d15049\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a25202-6c4578db76-gkrqv"
Nov 02 08:31:34.432438 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:34.432407    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e080b58-6116-41f4-a940-0b18c2d15049-maas-api-tls\") pod \"maas-api-e2e-api-b-a25202-6c4578db76-gkrqv\" (UID: \"2e080b58-6116-41f4-a940-0b18c2d15049\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a25202-6c4578db76-gkrqv"
Nov 02 08:31:34.432438 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:34.432427    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e080b58-6116-41f4-a940-0b18c2d15049-metrics-certs\") pod \"maas-api-e2e-api-b-a25202-6c4578db76-gkrqv\" (UID: \"2e080b58-6116-41f4-a940-0b18c2d15049\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a25202-6c4578db76-gkrqv"
Nov 02 08:31:34.483749 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:34.483716    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqbw6\" (UniqueName: \"kubernetes.io/projected/2e080b58-6116-41f4-a940-0b18c2d15049-kube-api-access-kqbw6\") pod \"maas-api-e2e-api-b-a25202-6c4578db76-gkrqv\" (UID: \"2e080b58-6116-41f4-a940-0b18c2d15049\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a25202-6c4578db76-gkrqv"
Nov 02 08:31:34.487554 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:34.487527    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a25202-6c4578db76-gkrqv"
Nov 02 08:31:34.865862 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:34.865838    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a25202-6c4578db76-gkrqv"]
Nov 02 08:31:34.868289 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:31:34.868263    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e080b58_6116_41f4_a940_0b18c2d15049.slice/crio-8130ad91ed1115fa8694753ffdf90511346ed6f3f1e0a4c4c3075d5639729cef WatchSource:0}: Error finding container 8130ad91ed1115fa8694753ffdf90511346ed6f3f1e0a4c4c3075d5639729cef: Status 404 returned error can't find the container with id 8130ad91ed1115fa8694753ffdf90511346ed6f3f1e0a4c4c3075d5639729cef
Nov 02 08:31:36.093910 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:36.091355    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a25202-6c4578db76-gkrqv" event={"ID":"2e080b58-6116-41f4-a940-0b18c2d15049","Type":"ContainerStarted","Data":"8130ad91ed1115fa8694753ffdf90511346ed6f3f1e0a4c4c3075d5639729cef"}
Nov 02 08:31:37.099583 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:37.099542    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a25202-6c4578db76-gkrqv" event={"ID":"2e080b58-6116-41f4-a940-0b18c2d15049","Type":"ContainerStarted","Data":"a6295723cdfc82db16e276f83b3ad93fcfe37c0cd80c702b51870dc14076b6ce"}
Nov 02 08:31:37.100043 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:37.099676    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a25202-6c4578db76-gkrqv"
Nov 02 08:31:37.222311 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:37.222241    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a25202-6c4578db76-gkrqv" podStartSLOduration=2.339637651 podStartE2EDuration="3.222216914s" totalImagesPullingTime="882.579263ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:31:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:31:37.212341002 +0000 UTC m=+1486.970769734" watchObservedRunningTime="2026-11-02 08:31:37.222216914 +0000 UTC m=+1486.980645647"
Nov 02 08:31:39.355423 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:39.355397    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk"]
Nov 02 08:31:39.359602 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:39.359580    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk"
Nov 02 08:31:39.456207 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:39.456177    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-19ee94-serving-cert\""
Nov 02 08:31:39.459054 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:39.459033    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk"]
Nov 02 08:31:39.530098 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:39.530064    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d787563-f928-4b74-9534-0d5bde83ad2f-metrics-certs\") pod \"maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk\" (UID: \"7d787563-f928-4b74-9534-0d5bde83ad2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk"
Nov 02 08:31:39.530253 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:39.530112    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d787563-f928-4b74-9534-0d5bde83ad2f-maas-api-tls\") pod \"maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk\" (UID: \"7d787563-f928-4b74-9534-0d5bde83ad2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk"
Nov 02 08:31:39.530253 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:39.530218    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d787563-f928-4b74-9534-0d5bde83ad2f-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk\" (UID: \"7d787563-f928-4b74-9534-0d5bde83ad2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk"
Nov 02 08:31:39.530343 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:39.530330    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgf6p\" (UniqueName: \"kubernetes.io/projected/7d787563-f928-4b74-9534-0d5bde83ad2f-kube-api-access-tgf6p\") pod \"maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk\" (UID: \"7d787563-f928-4b74-9534-0d5bde83ad2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk"
Nov 02 08:31:39.632304 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:39.632229    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d787563-f928-4b74-9534-0d5bde83ad2f-metrics-certs\") pod \"maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk\" (UID: \"7d787563-f928-4b74-9534-0d5bde83ad2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk"
Nov 02 08:31:39.632304 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:39.632270    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d787563-f928-4b74-9534-0d5bde83ad2f-maas-api-tls\") pod \"maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk\" (UID: \"7d787563-f928-4b74-9534-0d5bde83ad2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk"
Nov 02 08:31:39.632497 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:39.632310    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d787563-f928-4b74-9534-0d5bde83ad2f-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk\" (UID: \"7d787563-f928-4b74-9534-0d5bde83ad2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk"
Nov 02 08:31:39.632497 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:39.632407    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgf6p\" (UniqueName: \"kubernetes.io/projected/7d787563-f928-4b74-9534-0d5bde83ad2f-kube-api-access-tgf6p\") pod \"maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk\" (UID: \"7d787563-f928-4b74-9534-0d5bde83ad2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk"
Nov 02 08:31:39.633123 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:39.633095    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d787563-f928-4b74-9534-0d5bde83ad2f-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk\" (UID: \"7d787563-f928-4b74-9534-0d5bde83ad2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk"
Nov 02 08:31:39.634914 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:39.634869    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d787563-f928-4b74-9534-0d5bde83ad2f-maas-api-tls\") pod \"maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk\" (UID: \"7d787563-f928-4b74-9534-0d5bde83ad2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk"
Nov 02 08:31:39.635147 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:39.635123    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d787563-f928-4b74-9534-0d5bde83ad2f-metrics-certs\") pod \"maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk\" (UID: \"7d787563-f928-4b74-9534-0d5bde83ad2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk"
Nov 02 08:31:39.686089 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:39.686065    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgf6p\" (UniqueName: \"kubernetes.io/projected/7d787563-f928-4b74-9534-0d5bde83ad2f-kube-api-access-tgf6p\") pod \"maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk\" (UID: \"7d787563-f928-4b74-9534-0d5bde83ad2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk"
Nov 02 08:31:39.974135 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:39.974093    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk"
Nov 02 08:31:40.343719 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:40.343692    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk"]
Nov 02 08:31:40.345018 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:31:40.344985    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d787563_f928_4b74_9534_0d5bde83ad2f.slice/crio-30551be9baf86a7b51ae427b69bce45b02123eadf5d599fe0370c222bf911699 WatchSource:0}: Error finding container 30551be9baf86a7b51ae427b69bce45b02123eadf5d599fe0370c222bf911699: Status 404 returned error can't find the container with id 30551be9baf86a7b51ae427b69bce45b02123eadf5d599fe0370c222bf911699
Nov 02 08:31:41.125957 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:41.125924    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk" event={"ID":"7d787563-f928-4b74-9534-0d5bde83ad2f","Type":"ContainerStarted","Data":"30551be9baf86a7b51ae427b69bce45b02123eadf5d599fe0370c222bf911699"}
Nov 02 08:31:42.134388 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:42.134348    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk" event={"ID":"7d787563-f928-4b74-9534-0d5bde83ad2f","Type":"ContainerStarted","Data":"1109d8b0a985aa5ce271380fd6f44df4c9714d6d1bc766278cb3f5f50ceb22ea"}
Nov 02 08:31:42.134778 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:42.134457    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk"
Nov 02 08:31:42.247227 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:42.247173    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk" podStartSLOduration=2.362463876 podStartE2EDuration="3.247158427s" totalImagesPullingTime="884.694551ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:31:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:31:42.245463338 +0000 UTC m=+1492.003892073" watchObservedRunningTime="2026-11-02 08:31:42.247158427 +0000 UTC m=+1492.005587177"
Nov 02 08:31:43.112265 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:43.112234    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a25202-6c4578db76-gkrqv"
Nov 02 08:31:45.769972 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:45.769935    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl"]
Nov 02 08:31:45.774503 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:45.774483    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl"
Nov 02 08:31:45.837295 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:45.837260    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-69a9bb\""
Nov 02 08:31:45.851970 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:45.851924    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/397d6ce7-76ec-4915-8ef3-f48e0f5966c3-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl\" (UID: \"397d6ce7-76ec-4915-8ef3-f48e0f5966c3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl"
Nov 02 08:31:45.866097 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:45.866062    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpgp5\" (UniqueName: \"kubernetes.io/projected/397d6ce7-76ec-4915-8ef3-f48e0f5966c3-kube-api-access-zpgp5\") pod \"payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl\" (UID: \"397d6ce7-76ec-4915-8ef3-f48e0f5966c3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl"
Nov 02 08:31:45.959185 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:45.958902    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-69a9bb-dockercfg-sqc9d\""
Nov 02 08:31:46.002898 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:45.985138    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpgp5\" (UniqueName: \"kubernetes.io/projected/397d6ce7-76ec-4915-8ef3-f48e0f5966c3-kube-api-access-zpgp5\") pod \"payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl\" (UID: \"397d6ce7-76ec-4915-8ef3-f48e0f5966c3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl"
Nov 02 08:31:46.063663 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:46.063527    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/397d6ce7-76ec-4915-8ef3-f48e0f5966c3-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl\" (UID: \"397d6ce7-76ec-4915-8ef3-f48e0f5966c3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl"
Nov 02 08:31:46.064298 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:46.017399    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl"]
Nov 02 08:31:46.064705 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:46.064681    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/397d6ce7-76ec-4915-8ef3-f48e0f5966c3-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl\" (UID: \"397d6ce7-76ec-4915-8ef3-f48e0f5966c3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl"
Nov 02 08:31:46.074956 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:46.074932    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpgp5\" (UniqueName: \"kubernetes.io/projected/397d6ce7-76ec-4915-8ef3-f48e0f5966c3-kube-api-access-zpgp5\") pod \"payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl\" (UID: \"397d6ce7-76ec-4915-8ef3-f48e0f5966c3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl"
Nov 02 08:31:46.088842 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:46.088818    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl"
Nov 02 08:31:46.462508 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:46.460491    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl"]
Nov 02 08:31:47.178263 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:47.178221    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl" event={"ID":"397d6ce7-76ec-4915-8ef3-f48e0f5966c3","Type":"ContainerStarted","Data":"bfad423218d65d09b50fad97348aed6f249a0639448f469cac7368d819dba784"}
Nov 02 08:31:47.178716 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:47.178293    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl" event={"ID":"397d6ce7-76ec-4915-8ef3-f48e0f5966c3","Type":"ContainerStarted","Data":"8213d3ee97e4860c231575d9bb32fd2ba733b2dd2ae240d442fddab67fc86e13"}
Nov 02 08:31:47.178716 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:47.178463    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl"
Nov 02 08:31:47.298948 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:47.298872    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl" podStartSLOduration=2.298856717 podStartE2EDuration="2.298856717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:31:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:31:47.296110169 +0000 UTC m=+1497.054538901" watchObservedRunningTime="2026-11-02 08:31:47.298856717 +0000 UTC m=+1497.057285499"
Nov 02 08:31:48.142598 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:48.142557    6210 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk" podUID="7d787563-f928-4b74-9534-0d5bde83ad2f" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.76:8443/health\": dial tcp 10.134.0.76:8443: connect: connection refused"
Nov 02 08:31:50.543473 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:50.543437    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q_f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae/extract/0.log"
Nov 02 08:31:50.543986 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:50.543778    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q_f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae/extract/0.log"
Nov 02 08:31:50.559304 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:50.559277    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb77f_3e7ae74c-fcd8-4820-a8b7-769a5fff9f15/ovn-acl-logging/0.log"
Nov 02 08:31:50.559731 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:50.559710    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb77f_3e7ae74c-fcd8-4820-a8b7-769a5fff9f15/ovn-acl-logging/0.log"
Nov 02 08:31:52.227256 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:52.224917    6210 generic.go:356] "Generic (PLEG): container finished" podID="7d787563-f928-4b74-9534-0d5bde83ad2f" containerID="1109d8b0a985aa5ce271380fd6f44df4c9714d6d1bc766278cb3f5f50ceb22ea" exitCode=1
Nov 02 08:31:52.227256 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:52.225001    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk" event={"ID":"7d787563-f928-4b74-9534-0d5bde83ad2f","Type":"ContainerDied","Data":"1109d8b0a985aa5ce271380fd6f44df4c9714d6d1bc766278cb3f5f50ceb22ea"}
Nov 02 08:31:52.227256 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:52.225506    6210 scope.go:122] "RemoveContainer" containerID="1109d8b0a985aa5ce271380fd6f44df4c9714d6d1bc766278cb3f5f50ceb22ea"
Nov 02 08:31:54.239972 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:54.239935    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk" event={"ID":"7d787563-f928-4b74-9534-0d5bde83ad2f","Type":"ContainerStarted","Data":"884da2005c51cf7844113c0c03768f08c1027d7f7fea60220eb2c687791786eb"}
Nov 02 08:31:54.240355 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:54.240143    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk"
Nov 02 08:31:58.187980 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:58.187940    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl"
Nov 02 08:31:59.275070 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:59.275040    6210 generic.go:356] "Generic (PLEG): container finished" podID="d2b3bbf0-2054-45ee-b135-fbc431f02a09" containerID="b6206ac5856d0e106fc0d78084eea535526c9caced63dfed014c53a46976edbd" exitCode=0
Nov 02 08:31:59.275528 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:59.275112    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj" event={"ID":"d2b3bbf0-2054-45ee-b135-fbc431f02a09","Type":"ContainerDied","Data":"b6206ac5856d0e106fc0d78084eea535526c9caced63dfed014c53a46976edbd"}
Nov 02 08:31:59.275646 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:59.275628    6210 scope.go:122] "RemoveContainer" containerID="b6206ac5856d0e106fc0d78084eea535526c9caced63dfed014c53a46976edbd"
Nov 02 08:31:59.277311 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:59.277281    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:31:59.277405 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:59.277349    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:31:59.277405 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:31:59.277383    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:32:00.252400 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:00.252370    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk"
Nov 02 08:32:00.283487 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:00.283454    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj" event={"ID":"d2b3bbf0-2054-45ee-b135-fbc431f02a09","Type":"ContainerStarted","Data":"e74be045d174cafb5bf5dc0ff509a957bf92ace6fafd76f0edd17e7a20065ca0"}
Nov 02 08:32:00.861607 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:32:00.861555    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:32:01.252095 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:01.252055    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:32:01.253623 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:01.253591    6210 patch_prober.go:29] interesting pod/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Nov 02 08:32:01.253750 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:01.253655    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj" podUID="d2b3bbf0-2054-45ee-b135-fbc431f02a09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Nov 02 08:32:02.252019 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:02.251983    6210 patch_prober.go:29] interesting pod/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Nov 02 08:32:02.252418 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:02.252039    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj" podUID="d2b3bbf0-2054-45ee-b135-fbc431f02a09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Nov 02 08:32:03.252996 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:03.252953    6210 patch_prober.go:29] interesting pod/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Nov 02 08:32:03.253405 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:03.253014    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj" podUID="d2b3bbf0-2054-45ee-b135-fbc431f02a09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Nov 02 08:32:04.252586 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:04.252544    6210 patch_prober.go:29] interesting pod/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Nov 02 08:32:04.252783 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:04.252613    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj" podUID="d2b3bbf0-2054-45ee-b135-fbc431f02a09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Nov 02 08:32:04.979025 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:04.978971    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:32:05.252073 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:05.251993    6210 patch_prober.go:29] interesting pod/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Nov 02 08:32:05.252073 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:05.252051    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj" podUID="d2b3bbf0-2054-45ee-b135-fbc431f02a09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Nov 02 08:32:06.256910 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:06.256864    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:32:06.257820 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:06.257799    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:32:11.459840 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:11.459807    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7355-c9b19c"]
Nov 02 08:32:11.463346 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:11.463325    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7355-c9b19c"
Nov 02 08:32:11.513408 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:11.513381    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-nb5bk\""
Nov 02 08:32:11.563561 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:11.563527    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7355-c9b19c"]
Nov 02 08:32:11.624443 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:11.624409    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r4q6\" (UniqueName: \"kubernetes.io/projected/b0ac0b71-0ee1-4d97-b1e9-22b88f3c11fb-kube-api-access-7r4q6\") pod \"test-curl-7355-c9b19c\" (UID: \"b0ac0b71-0ee1-4d97-b1e9-22b88f3c11fb\") " pod="opendatahub/test-curl-7355-c9b19c"
Nov 02 08:32:11.725521 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:11.725428    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7r4q6\" (UniqueName: \"kubernetes.io/projected/b0ac0b71-0ee1-4d97-b1e9-22b88f3c11fb-kube-api-access-7r4q6\") pod \"test-curl-7355-c9b19c\" (UID: \"b0ac0b71-0ee1-4d97-b1e9-22b88f3c11fb\") " pod="opendatahub/test-curl-7355-c9b19c"
Nov 02 08:32:11.783474 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:11.783440    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r4q6\" (UniqueName: \"kubernetes.io/projected/b0ac0b71-0ee1-4d97-b1e9-22b88f3c11fb-kube-api-access-7r4q6\") pod \"test-curl-7355-c9b19c\" (UID: \"b0ac0b71-0ee1-4d97-b1e9-22b88f3c11fb\") " pod="opendatahub/test-curl-7355-c9b19c"
Nov 02 08:32:12.075756 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:12.075677    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7355-c9b19c"
Nov 02 08:32:12.454077 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:12.454051    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7355-c9b19c"]
Nov 02 08:32:12.455759 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:32:12.455731    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0ac0b71_0ee1_4d97_b1e9_22b88f3c11fb.slice/crio-7afba6f7f167cfafce2c34f27b671c0c49acc64be1a65b135846b5b5d4719c89 WatchSource:0}: Error finding container 7afba6f7f167cfafce2c34f27b671c0c49acc64be1a65b135846b5b5d4719c89: Status 404 returned error can't find the container with id 7afba6f7f167cfafce2c34f27b671c0c49acc64be1a65b135846b5b5d4719c89
Nov 02 08:32:13.391818 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:13.391783    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7355-c9b19c" event={"ID":"b0ac0b71-0ee1-4d97-b1e9-22b88f3c11fb","Type":"ContainerStarted","Data":"7afba6f7f167cfafce2c34f27b671c0c49acc64be1a65b135846b5b5d4719c89"}
Nov 02 08:32:16.414537 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:16.414500    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7355-c9b19c" event={"ID":"b0ac0b71-0ee1-4d97-b1e9-22b88f3c11fb","Type":"ContainerStarted","Data":"d4bb451d921490f6563c01e5ad3bf61db4d7ab2d0f0a0248d0c7a7d7319d8654"}
Nov 02 08:32:16.532616 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:16.532566    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7355-c9b19c" podStartSLOduration=2.582584202 podStartE2EDuration="5.532552041s" totalImagesPullingTime="2.949967839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:32:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:32:16.531493465 +0000 UTC m=+1526.289922199" watchObservedRunningTime="2026-11-02 08:32:16.532552041 +0000 UTC m=+1526.290980800"
Nov 02 08:32:18.116396 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:18.116365    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7355-c9b19c"]
Nov 02 08:32:18.120322 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:18.120295    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7355-c9b19c"]
Nov 02 08:32:18.426368 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:18.426269    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7355-c9b19c" podUID="b0ac0b71-0ee1-4d97-b1e9-22b88f3c11fb" containerName="test-curl-7355-c9b19c" containerID="cri-o://d4bb451d921490f6563c01e5ad3bf61db4d7ab2d0f0a0248d0c7a7d7319d8654" gracePeriod=2
Nov 02 08:32:20.673841 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:20.673812    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7355-c9b19c"
Nov 02 08:32:20.777991 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:20.777962    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b0ac0b71-0ee1-4d97-b1e9-22b88f3c11fb-kube-api-access-7r4q6\" (UniqueName: \"kubernetes.io/projected/b0ac0b71-0ee1-4d97-b1e9-22b88f3c11fb-kube-api-access-7r4q6\") pod \"b0ac0b71-0ee1-4d97-b1e9-22b88f3c11fb\" (UID: \"b0ac0b71-0ee1-4d97-b1e9-22b88f3c11fb\") "
Nov 02 08:32:20.780046 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:20.780018    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0ac0b71-0ee1-4d97-b1e9-22b88f3c11fb-kube-api-access-7r4q6" pod "b0ac0b71-0ee1-4d97-b1e9-22b88f3c11fb" (UID: "b0ac0b71-0ee1-4d97-b1e9-22b88f3c11fb"). InnerVolumeSpecName "kube-api-access-7r4q6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:32:20.879997 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:20.879966    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7r4q6\" (UniqueName: \"kubernetes.io/projected/b0ac0b71-0ee1-4d97-b1e9-22b88f3c11fb-kube-api-access-7r4q6\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:32:21.447444 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:21.447410    6210 generic.go:356] "Generic (PLEG): container finished" podID="b0ac0b71-0ee1-4d97-b1e9-22b88f3c11fb" containerID="d4bb451d921490f6563c01e5ad3bf61db4d7ab2d0f0a0248d0c7a7d7319d8654" exitCode=137
Nov 02 08:32:21.447643 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:21.447456    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7355-c9b19c"
Nov 02 08:32:21.447643 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:21.447504    6210 scope.go:122] "RemoveContainer" containerID="d4bb451d921490f6563c01e5ad3bf61db4d7ab2d0f0a0248d0c7a7d7319d8654"
Nov 02 08:32:21.457813 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:21.457797    6210 scope.go:122] "RemoveContainer" containerID="d4bb451d921490f6563c01e5ad3bf61db4d7ab2d0f0a0248d0c7a7d7319d8654"
Nov 02 08:32:21.458094 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:32:21.458074    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4bb451d921490f6563c01e5ad3bf61db4d7ab2d0f0a0248d0c7a7d7319d8654\": container with ID starting with d4bb451d921490f6563c01e5ad3bf61db4d7ab2d0f0a0248d0c7a7d7319d8654 not found: ID does not exist" containerID="d4bb451d921490f6563c01e5ad3bf61db4d7ab2d0f0a0248d0c7a7d7319d8654"
Nov 02 08:32:21.458170 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:21.458105    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4bb451d921490f6563c01e5ad3bf61db4d7ab2d0f0a0248d0c7a7d7319d8654"} err="failed to get container status \"d4bb451d921490f6563c01e5ad3bf61db4d7ab2d0f0a0248d0c7a7d7319d8654\": rpc error: code = NotFound desc = could not find container \"d4bb451d921490f6563c01e5ad3bf61db4d7ab2d0f0a0248d0c7a7d7319d8654\": container with ID starting with d4bb451d921490f6563c01e5ad3bf61db4d7ab2d0f0a0248d0c7a7d7319d8654 not found: ID does not exist"
Nov 02 08:32:21.504364 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:32:21.504332    6210 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7355-c9b19c\" is forbidden: User \"system:node:ip-10-0-135-235.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-235.us-west-2.compute.internal' and this object" podUID="b0ac0b71-0ee1-4d97-b1e9-22b88f3c11fb" pod="opendatahub/test-curl-7355-c9b19c"
Nov 02 08:32:22.353115 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:22.353082    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b0ac0b71-0ee1-4d97-b1e9-22b88f3c11fb" path="/var/lib/kubelet/pods/b0ac0b71-0ee1-4d97-b1e9-22b88f3c11fb/volumes"
Nov 02 08:32:30.671524 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:30.671492    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b"]
Nov 02 08:32:30.823538 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:32:30.823502    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:32:35.676794 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:35.676690    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b" podUID="d95e342b-b6a4-47cb-9fa2-eadccc09a579" containerName="payload-pre-processing" containerID="cri-o://1dfaad8db248ff10b745cc31db6f8b68a7926d840c791d2669f38dee18a047f2" gracePeriod=25
Nov 02 08:32:41.328710 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:41.328672    6210 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b" podUID="d95e342b-b6a4-47cb-9fa2-eadccc09a579" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 02 08:32:51.362900 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:51.358954    6210 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b" podUID="d95e342b-b6a4-47cb-9fa2-eadccc09a579" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 02 08:32:55.610746 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:55.610714    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc"]
Nov 02 08:32:55.738680 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:55.738641    6210 generic.go:356] "Generic (PLEG): container finished" podID="d95e342b-b6a4-47cb-9fa2-eadccc09a579" containerID="1dfaad8db248ff10b745cc31db6f8b68a7926d840c791d2669f38dee18a047f2" exitCode=0
Nov 02 08:32:55.738852 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:55.738670    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b" event={"ID":"d95e342b-b6a4-47cb-9fa2-eadccc09a579","Type":"ContainerDied","Data":"1dfaad8db248ff10b745cc31db6f8b68a7926d840c791d2669f38dee18a047f2"}
Nov 02 08:32:55.764748 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:55.764720    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb"]
Nov 02 08:32:56.415338 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:56.415315    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b"
Nov 02 08:32:56.510930 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:56.510829    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d95e342b-b6a4-47cb-9fa2-eadccc09a579-kube-api-access-wz6pf\" (UniqueName: \"kubernetes.io/projected/d95e342b-b6a4-47cb-9fa2-eadccc09a579-kube-api-access-wz6pf\") pod \"d95e342b-b6a4-47cb-9fa2-eadccc09a579\" (UID: \"d95e342b-b6a4-47cb-9fa2-eadccc09a579\") "
Nov 02 08:32:56.511104 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:56.511080    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d95e342b-b6a4-47cb-9fa2-eadccc09a579-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d95e342b-b6a4-47cb-9fa2-eadccc09a579-plugins-config-volume\") pod \"d95e342b-b6a4-47cb-9fa2-eadccc09a579\" (UID: \"d95e342b-b6a4-47cb-9fa2-eadccc09a579\") "
Nov 02 08:32:56.511413 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:56.511388    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d95e342b-b6a4-47cb-9fa2-eadccc09a579-plugins-config-volume" pod "d95e342b-b6a4-47cb-9fa2-eadccc09a579" (UID: "d95e342b-b6a4-47cb-9fa2-eadccc09a579"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:32:56.511581 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:56.511565    6210 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d95e342b-b6a4-47cb-9fa2-eadccc09a579-plugins-config-volume\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:32:56.512919 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:56.512865    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d95e342b-b6a4-47cb-9fa2-eadccc09a579-kube-api-access-wz6pf" pod "d95e342b-b6a4-47cb-9fa2-eadccc09a579" (UID: "d95e342b-b6a4-47cb-9fa2-eadccc09a579"). InnerVolumeSpecName "kube-api-access-wz6pf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:32:56.612556 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:56.612527    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wz6pf\" (UniqueName: \"kubernetes.io/projected/d95e342b-b6a4-47cb-9fa2-eadccc09a579-kube-api-access-wz6pf\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:32:56.746487 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:56.746461    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b"
Nov 02 08:32:56.746657 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:56.746460    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b" event={"ID":"d95e342b-b6a4-47cb-9fa2-eadccc09a579","Type":"ContainerDied","Data":"9a0ef64ce53d2b4575eb137632ab8436ec28085de0ba8c21667ea770ca4c8317"}
Nov 02 08:32:56.746657 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:56.746596    6210 scope.go:122] "RemoveContainer" containerID="1dfaad8db248ff10b745cc31db6f8b68a7926d840c791d2669f38dee18a047f2"
Nov 02 08:32:56.916266 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:56.916163    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b"]
Nov 02 08:32:56.922008 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:56.921980    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b"]
Nov 02 08:32:58.353338 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:32:58.353306    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d95e342b-b6a4-47cb-9fa2-eadccc09a579" path="/var/lib/kubelet/pods/d95e342b-b6a4-47cb-9fa2-eadccc09a579/volumes"
Nov 02 08:33:00.367377 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:00.367329    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67"]
Nov 02 08:33:00.368287 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:00.368261    6210 cpu_manager.go:414] "containerMap: removing container" podUID="d95e342b-b6a4-47cb-9fa2-eadccc09a579" containerName="payload-pre-processing"
Nov 02 08:33:00.368404 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:00.368288    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d95e342b-b6a4-47cb-9fa2-eadccc09a579" containerName="payload-pre-processing"
Nov 02 08:33:00.368404 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:00.368358    6210 cpu_manager.go:414] "containerMap: removing container" podUID="b0ac0b71-0ee1-4d97-b1e9-22b88f3c11fb" containerName="test-curl-7355-c9b19c"
Nov 02 08:33:00.368404 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:00.368366    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b0ac0b71-0ee1-4d97-b1e9-22b88f3c11fb" containerName="test-curl-7355-c9b19c"
Nov 02 08:33:00.368553 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:00.368505    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="b0ac0b71-0ee1-4d97-b1e9-22b88f3c11fb" containerName="test-curl-7355-c9b19c"
Nov 02 08:33:00.368553 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:00.368523    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="d95e342b-b6a4-47cb-9fa2-eadccc09a579" containerName="payload-pre-processing"
Nov 02 08:33:00.374064 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:00.374040    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67"
Nov 02 08:33:00.419810 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:00.419771    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67"]
Nov 02 08:33:00.473533 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:00.473424    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-b9eea3-dockercfg-9l6j7\""
Nov 02 08:33:00.473533 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:00.473540    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-b9eea3\""
Nov 02 08:33:00.483537 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:00.483492    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch"]
Nov 02 08:33:00.501923 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:00.500079    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq2qm\" (UniqueName: \"kubernetes.io/projected/931e577d-0e59-4304-b6eb-7b2b5e9834ba-kube-api-access-nq2qm\") pod \"payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67\" (UID: \"931e577d-0e59-4304-b6eb-7b2b5e9834ba\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67"
Nov 02 08:33:00.510310 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:00.510276    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch"
Nov 02 08:33:00.528239 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:00.528194    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/931e577d-0e59-4304-b6eb-7b2b5e9834ba-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67\" (UID: \"931e577d-0e59-4304-b6eb-7b2b5e9834ba\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67"
Nov 02 08:33:00.611296 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:00.611235    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc" podUID="84c73bdd-c4d0-406e-8d9a-2a16958e08d8" containerName="payload-processing" containerID="cri-o://723c23a728142ab46a99dbad8fc122187b56ef4c7212a3fd9aec982d5c7ef442" gracePeriod=25
Nov 02 08:33:00.627418 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:00.627387    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch"]
Nov 02 08:33:00.634429 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:00.633823    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/931e577d-0e59-4304-b6eb-7b2b5e9834ba-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67\" (UID: \"931e577d-0e59-4304-b6eb-7b2b5e9834ba\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67"
Nov 02 08:33:00.634429 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:00.634038    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq2qm\" (UniqueName: \"kubernetes.io/projected/931e577d-0e59-4304-b6eb-7b2b5e9834ba-kube-api-access-nq2qm\") pod \"payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67\" (UID: \"931e577d-0e59-4304-b6eb-7b2b5e9834ba\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67"
Nov 02 08:33:00.634429 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:00.634067    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/533b692f-58b1-4609-b173-914d4a183be8-plugins-config-volume\") pod \"payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch\" (UID: \"533b692f-58b1-4609-b173-914d4a183be8\") " pod="openshift-ingress/payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch"
Nov 02 08:33:00.634429 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:00.634114    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfvl2\" (UniqueName: \"kubernetes.io/projected/533b692f-58b1-4609-b173-914d4a183be8-kube-api-access-qfvl2\") pod \"payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch\" (UID: \"533b692f-58b1-4609-b173-914d4a183be8\") " pod="openshift-ingress/payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch"
Nov 02 08:33:00.634968 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:00.634940    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/931e577d-0e59-4304-b6eb-7b2b5e9834ba-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67\" (UID: \"931e577d-0e59-4304-b6eb-7b2b5e9834ba\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67"
Nov 02 08:33:00.695022 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:00.694954    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq2qm\" (UniqueName: \"kubernetes.io/projected/931e577d-0e59-4304-b6eb-7b2b5e9834ba-kube-api-access-nq2qm\") pod \"payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67\" (UID: \"931e577d-0e59-4304-b6eb-7b2b5e9834ba\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67"
Nov 02 08:33:00.735189 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:00.735154    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/533b692f-58b1-4609-b173-914d4a183be8-plugins-config-volume\") pod \"payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch\" (UID: \"533b692f-58b1-4609-b173-914d4a183be8\") " pod="openshift-ingress/payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch"
Nov 02 08:33:00.735354 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:00.735205    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfvl2\" (UniqueName: \"kubernetes.io/projected/533b692f-58b1-4609-b173-914d4a183be8-kube-api-access-qfvl2\") pod \"payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch\" (UID: \"533b692f-58b1-4609-b173-914d4a183be8\") " pod="openshift-ingress/payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch"
Nov 02 08:33:00.735913 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:00.735872    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/533b692f-58b1-4609-b173-914d4a183be8-plugins-config-volume\") pod \"payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch\" (UID: \"533b692f-58b1-4609-b173-914d4a183be8\") " pod="openshift-ingress/payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch"
Nov 02 08:33:00.765785 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:00.765746    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb" podUID="ee204718-9b92-4b57-94d3-0fdd1cf05988" containerName="payload-pre-processing" containerID="cri-o://5616e8aa8944828a4ec88c644ec44f3e32c4433e7d46abfa43a956df14fcfb5c" gracePeriod=25
Nov 02 08:33:00.791651 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:00.791622    6210 generic.go:356] "Generic (PLEG): container finished" podID="84c73bdd-c4d0-406e-8d9a-2a16958e08d8" containerID="723c23a728142ab46a99dbad8fc122187b56ef4c7212a3fd9aec982d5c7ef442" exitCode=0
Nov 02 08:33:00.791791 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:00.791714    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc" event={"ID":"84c73bdd-c4d0-406e-8d9a-2a16958e08d8","Type":"ContainerDied","Data":"723c23a728142ab46a99dbad8fc122187b56ef4c7212a3fd9aec982d5c7ef442"}
Nov 02 08:33:00.792760 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:00.792738    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfvl2\" (UniqueName: \"kubernetes.io/projected/533b692f-58b1-4609-b173-914d4a183be8-kube-api-access-qfvl2\") pod \"payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch\" (UID: \"533b692f-58b1-4609-b173-914d4a183be8\") " pod="openshift-ingress/payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch"
Nov 02 08:33:00.825931 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:33:00.825869    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:33:00.928756 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:00.928723    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch"
Nov 02 08:33:00.929954 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:00.929933    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc"
Nov 02 08:33:00.989574 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:00.989191    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67"
Nov 02 08:33:01.041239 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:01.039712    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/84c73bdd-c4d0-406e-8d9a-2a16958e08d8-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84c73bdd-c4d0-406e-8d9a-2a16958e08d8-plugins-config-volume\") pod \"84c73bdd-c4d0-406e-8d9a-2a16958e08d8\" (UID: \"84c73bdd-c4d0-406e-8d9a-2a16958e08d8\") "
Nov 02 08:33:01.041239 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:01.039944    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/84c73bdd-c4d0-406e-8d9a-2a16958e08d8-kube-api-access-z2tdz\" (UniqueName: \"kubernetes.io/projected/84c73bdd-c4d0-406e-8d9a-2a16958e08d8-kube-api-access-z2tdz\") pod \"84c73bdd-c4d0-406e-8d9a-2a16958e08d8\" (UID: \"84c73bdd-c4d0-406e-8d9a-2a16958e08d8\") "
Nov 02 08:33:01.041650 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:01.041609    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84c73bdd-c4d0-406e-8d9a-2a16958e08d8-plugins-config-volume" pod "84c73bdd-c4d0-406e-8d9a-2a16958e08d8" (UID: "84c73bdd-c4d0-406e-8d9a-2a16958e08d8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:33:01.048354 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:01.047032    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84c73bdd-c4d0-406e-8d9a-2a16958e08d8-kube-api-access-z2tdz" pod "84c73bdd-c4d0-406e-8d9a-2a16958e08d8" (UID: "84c73bdd-c4d0-406e-8d9a-2a16958e08d8"). InnerVolumeSpecName "kube-api-access-z2tdz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:33:01.052246 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:01.052167    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb"
Nov 02 08:33:01.141984 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:01.141908    6210 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84c73bdd-c4d0-406e-8d9a-2a16958e08d8-plugins-config-volume\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:33:01.141984 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:01.141941    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2tdz\" (UniqueName: \"kubernetes.io/projected/84c73bdd-c4d0-406e-8d9a-2a16958e08d8-kube-api-access-z2tdz\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:33:01.242444 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:01.242406    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ee204718-9b92-4b57-94d3-0fdd1cf05988-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee204718-9b92-4b57-94d3-0fdd1cf05988-plugins-config-volume\") pod \"ee204718-9b92-4b57-94d3-0fdd1cf05988\" (UID: \"ee204718-9b92-4b57-94d3-0fdd1cf05988\") "
Nov 02 08:33:01.242651 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:01.242638    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ee204718-9b92-4b57-94d3-0fdd1cf05988-kube-api-access-l5f7b\" (UniqueName: \"kubernetes.io/projected/ee204718-9b92-4b57-94d3-0fdd1cf05988-kube-api-access-l5f7b\") pod \"ee204718-9b92-4b57-94d3-0fdd1cf05988\" (UID: \"ee204718-9b92-4b57-94d3-0fdd1cf05988\") "
Nov 02 08:33:01.242792 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:01.242768    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee204718-9b92-4b57-94d3-0fdd1cf05988-plugins-config-volume" pod "ee204718-9b92-4b57-94d3-0fdd1cf05988" (UID: "ee204718-9b92-4b57-94d3-0fdd1cf05988"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:33:01.243107 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:01.243078    6210 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee204718-9b92-4b57-94d3-0fdd1cf05988-plugins-config-volume\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:33:01.244629 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:01.244608    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee204718-9b92-4b57-94d3-0fdd1cf05988-kube-api-access-l5f7b" pod "ee204718-9b92-4b57-94d3-0fdd1cf05988" (UID: "ee204718-9b92-4b57-94d3-0fdd1cf05988"). InnerVolumeSpecName "kube-api-access-l5f7b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:33:01.333389 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:01.333356    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch"]
Nov 02 08:33:01.334106 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:33:01.334078    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod533b692f_58b1_4609_b173_914d4a183be8.slice/crio-8c490fbc5c538cb794b0e8b9549eb885fff1a3c66a4b1d1b4d1a9b2f87737cb5 WatchSource:0}: Error finding container 8c490fbc5c538cb794b0e8b9549eb885fff1a3c66a4b1d1b4d1a9b2f87737cb5: Status 404 returned error can't find the container with id 8c490fbc5c538cb794b0e8b9549eb885fff1a3c66a4b1d1b4d1a9b2f87737cb5
Nov 02 08:33:01.344215 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:01.344190    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5f7b\" (UniqueName: \"kubernetes.io/projected/ee204718-9b92-4b57-94d3-0fdd1cf05988-kube-api-access-l5f7b\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:33:01.399698 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:01.399671    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67"]
Nov 02 08:33:01.400515 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:33:01.400493    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod931e577d_0e59_4304_b6eb_7b2b5e9834ba.slice/crio-cf5f36864938525f92f7aacb7d61d11511f5e44c497342095ceb67eb388b8bba WatchSource:0}: Error finding container cf5f36864938525f92f7aacb7d61d11511f5e44c497342095ceb67eb388b8bba: Status 404 returned error can't find the container with id cf5f36864938525f92f7aacb7d61d11511f5e44c497342095ceb67eb388b8bba
Nov 02 08:33:01.799538 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:01.799505    6210 generic.go:356] "Generic (PLEG): container finished" podID="ee204718-9b92-4b57-94d3-0fdd1cf05988" containerID="5616e8aa8944828a4ec88c644ec44f3e32c4433e7d46abfa43a956df14fcfb5c" exitCode=0
Nov 02 08:33:01.799709 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:01.799571    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb"
Nov 02 08:33:01.799709 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:01.799589    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb" event={"ID":"ee204718-9b92-4b57-94d3-0fdd1cf05988","Type":"ContainerDied","Data":"5616e8aa8944828a4ec88c644ec44f3e32c4433e7d46abfa43a956df14fcfb5c"}
Nov 02 08:33:01.799709 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:01.799643    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb" event={"ID":"ee204718-9b92-4b57-94d3-0fdd1cf05988","Type":"ContainerDied","Data":"10d48bb1dda209194dc8c66e6012fb66250fd1c82feea3a77e3be47e9269357e"}
Nov 02 08:33:01.799709 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:01.799673    6210 scope.go:122] "RemoveContainer" containerID="5616e8aa8944828a4ec88c644ec44f3e32c4433e7d46abfa43a956df14fcfb5c"
Nov 02 08:33:01.801447 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:01.801417    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67" event={"ID":"931e577d-0e59-4304-b6eb-7b2b5e9834ba","Type":"ContainerStarted","Data":"455d8ec0d2debafd7be14984c4fcd0eba12a9c9e7f7f40bcea0b477a02c5ba4f"}
Nov 02 08:33:01.801843 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:01.801820    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67" event={"ID":"931e577d-0e59-4304-b6eb-7b2b5e9834ba","Type":"ContainerStarted","Data":"cf5f36864938525f92f7aacb7d61d11511f5e44c497342095ceb67eb388b8bba"}
Nov 02 08:33:01.801937 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:01.801890    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67"
Nov 02 08:33:01.803345 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:01.803321    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch" event={"ID":"533b692f-58b1-4609-b173-914d4a183be8","Type":"ContainerStarted","Data":"d17738ee9e08188e54eeb6ce6cf501bd6479a4cfd22c1a776e3a272754151313"}
Nov 02 08:33:01.803477 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:01.803361    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch" event={"ID":"533b692f-58b1-4609-b173-914d4a183be8","Type":"ContainerStarted","Data":"8c490fbc5c538cb794b0e8b9549eb885fff1a3c66a4b1d1b4d1a9b2f87737cb5"}
Nov 02 08:33:01.803477 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:01.803431    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch"
Nov 02 08:33:01.805070 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:01.805045    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc" event={"ID":"84c73bdd-c4d0-406e-8d9a-2a16958e08d8","Type":"ContainerDied","Data":"c9ac8f5163ce070067947fa7aa55122e2bf7d7bc7b4905326159f9e852c3f449"}
Nov 02 08:33:01.805209 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:01.805085    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc"
Nov 02 08:33:01.813299 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:01.813281    6210 scope.go:122] "RemoveContainer" containerID="5616e8aa8944828a4ec88c644ec44f3e32c4433e7d46abfa43a956df14fcfb5c"
Nov 02 08:33:01.813625 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:33:01.813603    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5616e8aa8944828a4ec88c644ec44f3e32c4433e7d46abfa43a956df14fcfb5c\": container with ID starting with 5616e8aa8944828a4ec88c644ec44f3e32c4433e7d46abfa43a956df14fcfb5c not found: ID does not exist" containerID="5616e8aa8944828a4ec88c644ec44f3e32c4433e7d46abfa43a956df14fcfb5c"
Nov 02 08:33:01.813697 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:01.813641    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5616e8aa8944828a4ec88c644ec44f3e32c4433e7d46abfa43a956df14fcfb5c"} err="failed to get container status \"5616e8aa8944828a4ec88c644ec44f3e32c4433e7d46abfa43a956df14fcfb5c\": rpc error: code = NotFound desc = could not find container \"5616e8aa8944828a4ec88c644ec44f3e32c4433e7d46abfa43a956df14fcfb5c\": container with ID starting with 5616e8aa8944828a4ec88c644ec44f3e32c4433e7d46abfa43a956df14fcfb5c not found: ID does not exist"
Nov 02 08:33:01.813697 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:01.813665    6210 scope.go:122] "RemoveContainer" containerID="723c23a728142ab46a99dbad8fc122187b56ef4c7212a3fd9aec982d5c7ef442"
Nov 02 08:33:01.959332 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:01.959298    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc"]
Nov 02 08:33:01.963787 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:01.963745    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc"]
Nov 02 08:33:02.066917 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:02.066870    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb"]
Nov 02 08:33:02.078016 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:02.077984    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb"]
Nov 02 08:33:02.188225 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:02.188169    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67" podStartSLOduration=2.188153935 podStartE2EDuration="2.188153935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:33:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:33:02.186333275 +0000 UTC m=+1571.944762008" watchObservedRunningTime="2026-11-02 08:33:02.188153935 +0000 UTC m=+1571.946582667"
Nov 02 08:33:02.296069 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:02.295955    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch" podStartSLOduration=2.295939551 podStartE2EDuration="2.295939551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:33:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:33:02.294946911 +0000 UTC m=+1572.053375642" watchObservedRunningTime="2026-11-02 08:33:02.295939551 +0000 UTC m=+1572.054368282"
Nov 02 08:33:02.374313 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:02.374278    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="84c73bdd-c4d0-406e-8d9a-2a16958e08d8" path="/var/lib/kubelet/pods/84c73bdd-c4d0-406e-8d9a-2a16958e08d8/volumes"
Nov 02 08:33:02.374972 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:02.374807    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ee204718-9b92-4b57-94d3-0fdd1cf05988" path="/var/lib/kubelet/pods/ee204718-9b92-4b57-94d3-0fdd1cf05988/volumes"
Nov 02 08:33:04.766444 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:04.766411    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj"]
Nov 02 08:33:04.767075 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:04.767060    6210 cpu_manager.go:414] "containerMap: removing container" podUID="ee204718-9b92-4b57-94d3-0fdd1cf05988" containerName="payload-pre-processing"
Nov 02 08:33:04.767139 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:04.767076    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ee204718-9b92-4b57-94d3-0fdd1cf05988" containerName="payload-pre-processing"
Nov 02 08:33:04.767139 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:04.767098    6210 cpu_manager.go:414] "containerMap: removing container" podUID="84c73bdd-c4d0-406e-8d9a-2a16958e08d8" containerName="payload-processing"
Nov 02 08:33:04.767139 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:04.767104    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="84c73bdd-c4d0-406e-8d9a-2a16958e08d8" containerName="payload-processing"
Nov 02 08:33:04.767249 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:04.767190    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="ee204718-9b92-4b57-94d3-0fdd1cf05988" containerName="payload-pre-processing"
Nov 02 08:33:04.767249 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:04.767202    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="84c73bdd-c4d0-406e-8d9a-2a16958e08d8" containerName="payload-processing"
Nov 02 08:33:04.771806 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:04.771779    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj"
Nov 02 08:33:04.818026 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:04.817990    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b5d1715-0d89-42c0-a004-e0f47ba14e76-metrics-certs\") pod \"maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj\" (UID: \"7b5d1715-0d89-42c0-a004-e0f47ba14e76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj"
Nov 02 08:33:04.818186 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:04.818154    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79298\" (UniqueName: \"kubernetes.io/projected/7b5d1715-0d89-42c0-a004-e0f47ba14e76-kube-api-access-79298\") pod \"maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj\" (UID: \"7b5d1715-0d89-42c0-a004-e0f47ba14e76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj"
Nov 02 08:33:04.818186 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:04.818180    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b5d1715-0d89-42c0-a004-e0f47ba14e76-maas-api-tls\") pod \"maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj\" (UID: \"7b5d1715-0d89-42c0-a004-e0f47ba14e76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj"
Nov 02 08:33:04.818384 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:04.818360    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b5d1715-0d89-42c0-a004-e0f47ba14e76-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj\" (UID: \"7b5d1715-0d89-42c0-a004-e0f47ba14e76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj"
Nov 02 08:33:04.829833 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:04.829793    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj"]
Nov 02 08:33:04.869951 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:04.869918    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-69a9bb-serving-cert\""
Nov 02 08:33:04.919465 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:04.919407    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b5d1715-0d89-42c0-a004-e0f47ba14e76-metrics-certs\") pod \"maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj\" (UID: \"7b5d1715-0d89-42c0-a004-e0f47ba14e76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj"
Nov 02 08:33:04.919668 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:04.919564    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79298\" (UniqueName: \"kubernetes.io/projected/7b5d1715-0d89-42c0-a004-e0f47ba14e76-kube-api-access-79298\") pod \"maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj\" (UID: \"7b5d1715-0d89-42c0-a004-e0f47ba14e76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj"
Nov 02 08:33:04.919668 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:04.919600    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b5d1715-0d89-42c0-a004-e0f47ba14e76-maas-api-tls\") pod \"maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj\" (UID: \"7b5d1715-0d89-42c0-a004-e0f47ba14e76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj"
Nov 02 08:33:04.919826 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:04.919770    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b5d1715-0d89-42c0-a004-e0f47ba14e76-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj\" (UID: \"7b5d1715-0d89-42c0-a004-e0f47ba14e76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj"
Nov 02 08:33:04.920058 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:33:04.920037    6210 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-69a9bb-serving-cert: secret "maas-api-e2e-ipp-a-69a9bb-serving-cert" not found
Nov 02 08:33:04.920151 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:33:04.920111    6210 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b5d1715-0d89-42c0-a004-e0f47ba14e76-maas-api-tls podName:7b5d1715-0d89-42c0-a004-e0f47ba14e76 nodeName:}" failed. No retries permitted until 2026-11-02 08:33:05.420090572 +0000 UTC m=+1575.178519296 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7b5d1715-0d89-42c0-a004-e0f47ba14e76-maas-api-tls") pod "maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj" (UID: "7b5d1715-0d89-42c0-a004-e0f47ba14e76") : secret "maas-api-e2e-ipp-a-69a9bb-serving-cert" not found
Nov 02 08:33:04.920628 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:04.920605    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b5d1715-0d89-42c0-a004-e0f47ba14e76-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj\" (UID: \"7b5d1715-0d89-42c0-a004-e0f47ba14e76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj"
Nov 02 08:33:04.922144 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:04.922118    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b5d1715-0d89-42c0-a004-e0f47ba14e76-metrics-certs\") pod \"maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj\" (UID: \"7b5d1715-0d89-42c0-a004-e0f47ba14e76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj"
Nov 02 08:33:04.974600 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:04.974570    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79298\" (UniqueName: \"kubernetes.io/projected/7b5d1715-0d89-42c0-a004-e0f47ba14e76-kube-api-access-79298\") pod \"maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj\" (UID: \"7b5d1715-0d89-42c0-a004-e0f47ba14e76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj"
Nov 02 08:33:05.433479 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:05.433441    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b5d1715-0d89-42c0-a004-e0f47ba14e76-maas-api-tls\") pod \"maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj\" (UID: \"7b5d1715-0d89-42c0-a004-e0f47ba14e76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj"
Nov 02 08:33:05.435849 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:05.435822    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b5d1715-0d89-42c0-a004-e0f47ba14e76-maas-api-tls\") pod \"maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj\" (UID: \"7b5d1715-0d89-42c0-a004-e0f47ba14e76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj"
Nov 02 08:33:05.685513 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:05.685429    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj"
Nov 02 08:33:06.056389 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:33:06.056342    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b5d1715_0d89_42c0_a004_e0f47ba14e76.slice/crio-b6710551e9a612f7747319973e8e09f6d0d99548f2f450a6a0bde4d3726f4f2c WatchSource:0}: Error finding container b6710551e9a612f7747319973e8e09f6d0d99548f2f450a6a0bde4d3726f4f2c: Status 404 returned error can't find the container with id b6710551e9a612f7747319973e8e09f6d0d99548f2f450a6a0bde4d3726f4f2c
Nov 02 08:33:06.056767 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:06.056692    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj"]
Nov 02 08:33:06.058101 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:06.058082    6210 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 02 08:33:06.853492 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:06.853458    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj" event={"ID":"7b5d1715-0d89-42c0-a004-e0f47ba14e76","Type":"ContainerStarted","Data":"b6710551e9a612f7747319973e8e09f6d0d99548f2f450a6a0bde4d3726f4f2c"}
Nov 02 08:33:07.869951 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:07.869912    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj" event={"ID":"7b5d1715-0d89-42c0-a004-e0f47ba14e76","Type":"ContainerStarted","Data":"cf053c6c6e6a5a196eb8fc7b452c81892e8c96b3a11a8b98af9165bead7be3a8"}
Nov 02 08:33:07.870419 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:07.869998    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj"
Nov 02 08:33:07.983901 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:07.983822    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj" podStartSLOduration=2.977723546 podStartE2EDuration="3.983808595s" totalImagesPullingTime="1.006085049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:33:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:33:07.983064668 +0000 UTC m=+1577.741493401" watchObservedRunningTime="2026-11-02 08:33:07.983808595 +0000 UTC m=+1577.742237362"
Nov 02 08:33:12.815536 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:12.815509    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch"
Nov 02 08:33:12.815981 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:12.815572    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67"
Nov 02 08:33:13.881517 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:13.881486    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj"
Nov 02 08:33:27.663046 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:27.663005    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn"]
Nov 02 08:33:30.821170 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:33:30.821128    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:33:32.663952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:32.663900    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn" podUID="f94c4843-39ab-4210-8c12-6bcf80a36401" containerName="payload-pre-processing" containerID="cri-o://b57ca663bd0566dd56e9379ecb9dcacd8a3f5602f8ebf9dad912956ade45d971" gracePeriod=25
Nov 02 08:33:32.939067 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:32.938985    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn"
Nov 02 08:33:32.965282 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:32.965255    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f94c4843-39ab-4210-8c12-6bcf80a36401-kube-api-access-82z85\" (UniqueName: \"kubernetes.io/projected/f94c4843-39ab-4210-8c12-6bcf80a36401-kube-api-access-82z85\") pod \"f94c4843-39ab-4210-8c12-6bcf80a36401\" (UID: \"f94c4843-39ab-4210-8c12-6bcf80a36401\") "
Nov 02 08:33:32.965429 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:32.965391    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f94c4843-39ab-4210-8c12-6bcf80a36401-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f94c4843-39ab-4210-8c12-6bcf80a36401-plugins-config-volume\") pod \"f94c4843-39ab-4210-8c12-6bcf80a36401\" (UID: \"f94c4843-39ab-4210-8c12-6bcf80a36401\") "
Nov 02 08:33:32.965739 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:32.965712    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f94c4843-39ab-4210-8c12-6bcf80a36401-plugins-config-volume" pod "f94c4843-39ab-4210-8c12-6bcf80a36401" (UID: "f94c4843-39ab-4210-8c12-6bcf80a36401"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:33:32.965906 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:32.965866    6210 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f94c4843-39ab-4210-8c12-6bcf80a36401-plugins-config-volume\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:33:32.967363 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:32.967341    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f94c4843-39ab-4210-8c12-6bcf80a36401-kube-api-access-82z85" pod "f94c4843-39ab-4210-8c12-6bcf80a36401" (UID: "f94c4843-39ab-4210-8c12-6bcf80a36401"). InnerVolumeSpecName "kube-api-access-82z85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:33:33.066991 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:33.066959    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82z85\" (UniqueName: \"kubernetes.io/projected/f94c4843-39ab-4210-8c12-6bcf80a36401-kube-api-access-82z85\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:33:33.158993 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:33.155760    6210 generic.go:356] "Generic (PLEG): container finished" podID="f94c4843-39ab-4210-8c12-6bcf80a36401" containerID="b57ca663bd0566dd56e9379ecb9dcacd8a3f5602f8ebf9dad912956ade45d971" exitCode=0
Nov 02 08:33:33.158993 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:33.155820    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn" event={"ID":"f94c4843-39ab-4210-8c12-6bcf80a36401","Type":"ContainerDied","Data":"b57ca663bd0566dd56e9379ecb9dcacd8a3f5602f8ebf9dad912956ade45d971"}
Nov 02 08:33:33.158993 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:33.155873    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn" event={"ID":"f94c4843-39ab-4210-8c12-6bcf80a36401","Type":"ContainerDied","Data":"c51bad7d218277a8f6e338932f8e07072ca5261c6b99af42402b71dd74747556"}
Nov 02 08:33:33.158993 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:33.155940    6210 scope.go:122] "RemoveContainer" containerID="b57ca663bd0566dd56e9379ecb9dcacd8a3f5602f8ebf9dad912956ade45d971"
Nov 02 08:33:33.158993 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:33.156090    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn"
Nov 02 08:33:33.169451 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:33.169425    6210 scope.go:122] "RemoveContainer" containerID="b57ca663bd0566dd56e9379ecb9dcacd8a3f5602f8ebf9dad912956ade45d971"
Nov 02 08:33:33.169752 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:33:33.169729    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b57ca663bd0566dd56e9379ecb9dcacd8a3f5602f8ebf9dad912956ade45d971\": container with ID starting with b57ca663bd0566dd56e9379ecb9dcacd8a3f5602f8ebf9dad912956ade45d971 not found: ID does not exist" containerID="b57ca663bd0566dd56e9379ecb9dcacd8a3f5602f8ebf9dad912956ade45d971"
Nov 02 08:33:33.169802 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:33.169761    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b57ca663bd0566dd56e9379ecb9dcacd8a3f5602f8ebf9dad912956ade45d971"} err="failed to get container status \"b57ca663bd0566dd56e9379ecb9dcacd8a3f5602f8ebf9dad912956ade45d971\": rpc error: code = NotFound desc = could not find container \"b57ca663bd0566dd56e9379ecb9dcacd8a3f5602f8ebf9dad912956ade45d971\": container with ID starting with b57ca663bd0566dd56e9379ecb9dcacd8a3f5602f8ebf9dad912956ade45d971 not found: ID does not exist"
Nov 02 08:33:33.322024 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:33.321986    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn"]
Nov 02 08:33:33.325343 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:33.325317    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn"]
Nov 02 08:33:34.353004 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:34.352969    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f94c4843-39ab-4210-8c12-6bcf80a36401" path="/var/lib/kubelet/pods/f94c4843-39ab-4210-8c12-6bcf80a36401/volumes"
Nov 02 08:33:36.894105 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:36.894070    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"]
Nov 02 08:33:36.894867 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:36.894848    6210 cpu_manager.go:414] "containerMap: removing container" podUID="f94c4843-39ab-4210-8c12-6bcf80a36401" containerName="payload-pre-processing"
Nov 02 08:33:36.894933 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:36.894868    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f94c4843-39ab-4210-8c12-6bcf80a36401" containerName="payload-pre-processing"
Nov 02 08:33:36.895000 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:36.894990    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="f94c4843-39ab-4210-8c12-6bcf80a36401" containerName="payload-pre-processing"
Nov 02 08:33:36.900262 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:36.900233    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"
Nov 02 08:33:37.017799 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:37.017762    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-istio-token\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9\" (UID: \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"
Nov 02 08:33:37.018012 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:37.017815    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgv7t\" (UniqueName: \"kubernetes.io/projected/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-kube-api-access-kgv7t\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9\" (UID: \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"
Nov 02 08:33:37.018012 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:37.017934    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-credential-socket\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9\" (UID: \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"
Nov 02 08:33:37.018012 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:37.017997    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-istio-data\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9\" (UID: \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"
Nov 02 08:33:37.018191 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:37.018095    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-istio-envoy\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9\" (UID: \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"
Nov 02 08:33:37.018191 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:37.018141    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-workload-certs\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9\" (UID: \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"
Nov 02 08:33:37.018307 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:37.018292    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-istio-podinfo\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9\" (UID: \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"
Nov 02 08:33:37.018379 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:37.018366    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-workload-socket\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9\" (UID: \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"
Nov 02 08:33:37.018441 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:37.018417    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-istiod-ca-cert\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9\" (UID: \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"
Nov 02 08:33:37.054462 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:37.054431    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-69a9bb-openshift-default-dockercfg-6vf2g\""
Nov 02 08:33:37.098244 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:37.098212    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"]
Nov 02 08:33:37.119890 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:37.119853    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-istio-token\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9\" (UID: \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"
Nov 02 08:33:37.120053 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:37.119918    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgv7t\" (UniqueName: \"kubernetes.io/projected/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-kube-api-access-kgv7t\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9\" (UID: \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"
Nov 02 08:33:37.120053 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:37.119951    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-credential-socket\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9\" (UID: \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"
Nov 02 08:33:37.120053 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:37.120023    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-istio-data\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9\" (UID: \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"
Nov 02 08:33:37.120235 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:37.120053    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-istio-envoy\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9\" (UID: \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"
Nov 02 08:33:37.120235 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:37.120103    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-workload-certs\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9\" (UID: \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"
Nov 02 08:33:37.120352 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:37.120333    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-istio-podinfo\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9\" (UID: \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"
Nov 02 08:33:37.120485 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:37.120464    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-workload-socket\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9\" (UID: \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"
Nov 02 08:33:37.120566 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:37.120504    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-istiod-ca-cert\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9\" (UID: \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"
Nov 02 08:33:37.120566 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:37.120535    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-istio-data\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9\" (UID: \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"
Nov 02 08:33:37.120566 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:37.120547    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-workload-certs\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9\" (UID: \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"
Nov 02 08:33:37.120905 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:37.120862    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-credential-socket\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9\" (UID: \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"
Nov 02 08:33:37.121078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:37.120971    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-workload-socket\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9\" (UID: \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"
Nov 02 08:33:37.121242 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:37.121223    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-istiod-ca-cert\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9\" (UID: \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"
Nov 02 08:33:37.122824 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:37.122799    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-istio-envoy\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9\" (UID: \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"
Nov 02 08:33:37.123403 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:37.123382    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-istio-podinfo\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9\" (UID: \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"
Nov 02 08:33:37.175615 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:37.175548    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-istio-token\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9\" (UID: \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"
Nov 02 08:33:37.175752 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:37.175661    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgv7t\" (UniqueName: \"kubernetes.io/projected/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-kube-api-access-kgv7t\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9\" (UID: \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"
Nov 02 08:33:37.214356 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:37.214327    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"
Nov 02 08:33:37.644024 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:37.643997    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"]
Nov 02 08:33:37.644290 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:33:37.644259    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3375cf1d_ea97_41c2_87c5_09dfad6fc5f4.slice/crio-9e5a6780c8fd10a4c210505b47060d0a9dbcfc44f0db378da3752a4046ef25cb WatchSource:0}: Error finding container 9e5a6780c8fd10a4c210505b47060d0a9dbcfc44f0db378da3752a4046ef25cb: Status 404 returned error can't find the container with id 9e5a6780c8fd10a4c210505b47060d0a9dbcfc44f0db378da3752a4046ef25cb
Nov 02 08:33:37.646954 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:37.646919    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:33:37.647038 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:37.646988    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:33:37.647038 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:37.647017    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:33:38.192334 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:38.192298    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9" event={"ID":"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4","Type":"ContainerStarted","Data":"382fef4808544e2c5466c751552eece34328592fad1b72c4d5ba73bea632a74d"}
Nov 02 08:33:38.192712 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:38.192377    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9" event={"ID":"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4","Type":"ContainerStarted","Data":"9e5a6780c8fd10a4c210505b47060d0a9dbcfc44f0db378da3752a4046ef25cb"}
Nov 02 08:33:38.214924 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:38.214872    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"
Nov 02 08:33:38.216299 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:38.216273    6210 patch_prober.go:29] interesting pod/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Nov 02 08:33:38.216423 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:38.216320    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9" podUID="3375cf1d-ea97-41c2-87c5-09dfad6fc5f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Nov 02 08:33:38.303154 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:38.303103    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9" podStartSLOduration=2.303088673 podStartE2EDuration="2.303088673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:33:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:33:38.301764308 +0000 UTC m=+1608.060193041" watchObservedRunningTime="2026-11-02 08:33:38.303088673 +0000 UTC m=+1608.061517404"
Nov 02 08:33:39.220901 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:39.220271    6210 patch_prober.go:29] interesting pod/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Nov 02 08:33:39.220901 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:39.220343    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9" podUID="3375cf1d-ea97-41c2-87c5-09dfad6fc5f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Nov 02 08:33:40.224033 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:40.223995    6210 patch_prober.go:29] interesting pod/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Nov 02 08:33:40.224661 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:40.224616    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9" podUID="3375cf1d-ea97-41c2-87c5-09dfad6fc5f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Nov 02 08:33:41.222903 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:41.216258    6210 patch_prober.go:29] interesting pod/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Nov 02 08:33:41.222903 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:41.216319    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9" podUID="3375cf1d-ea97-41c2-87c5-09dfad6fc5f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Nov 02 08:33:42.220903 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:42.218286    6210 patch_prober.go:29] interesting pod/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Nov 02 08:33:42.220903 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:42.218351    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9" podUID="3375cf1d-ea97-41c2-87c5-09dfad6fc5f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Nov 02 08:33:43.222903 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:43.222294    6210 patch_prober.go:29] interesting pod/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Nov 02 08:33:43.222903 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:43.222359    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9" podUID="3375cf1d-ea97-41c2-87c5-09dfad6fc5f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Nov 02 08:33:44.219993 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:44.219966    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"
Nov 02 08:33:44.220366 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:44.220347    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"
Nov 02 08:33:44.220973 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:44.220954    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"
Nov 02 08:33:58.198197 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:58.198158    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"]
Nov 02 08:33:58.198657 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:33:58.198384    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m" podUID="84913035-795c-471e-8c5f-c9d23a3703ab" containerName="istio-proxy" containerID="cri-o://21f1528b1a8b8f722bd529e8418b4a98aeb32432e871af09652ab33697d8e5fc" gracePeriod=30
Nov 02 08:34:00.822093 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:34:00.822059    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:34:03.391574 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:03.391466    6210 generic.go:356] "Generic (PLEG): container finished" podID="84913035-795c-471e-8c5f-c9d23a3703ab" containerID="21f1528b1a8b8f722bd529e8418b4a98aeb32432e871af09652ab33697d8e5fc" exitCode=0
Nov 02 08:34:03.391574 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:03.391514    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m" event={"ID":"84913035-795c-471e-8c5f-c9d23a3703ab","Type":"ContainerDied","Data":"21f1528b1a8b8f722bd529e8418b4a98aeb32432e871af09652ab33697d8e5fc"}
Nov 02 08:34:03.474397 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:03.474327    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"
Nov 02 08:34:03.598170 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:03.598139    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/84913035-795c-471e-8c5f-c9d23a3703ab-kube-api-access-l9l5w\" (UniqueName: \"kubernetes.io/projected/84913035-795c-471e-8c5f-c9d23a3703ab-kube-api-access-l9l5w\") pod \"84913035-795c-471e-8c5f-c9d23a3703ab\" (UID: \"84913035-795c-471e-8c5f-c9d23a3703ab\") "
Nov 02 08:34:03.598365 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:03.598241    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/84913035-795c-471e-8c5f-c9d23a3703ab-istio-token\" (UniqueName: \"kubernetes.io/projected/84913035-795c-471e-8c5f-c9d23a3703ab-istio-token\") pod \"84913035-795c-471e-8c5f-c9d23a3703ab\" (UID: \"84913035-795c-471e-8c5f-c9d23a3703ab\") "
Nov 02 08:34:03.598365 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:03.598295    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/84913035-795c-471e-8c5f-c9d23a3703ab-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84913035-795c-471e-8c5f-c9d23a3703ab-istio-data\") pod \"84913035-795c-471e-8c5f-c9d23a3703ab\" (UID: \"84913035-795c-471e-8c5f-c9d23a3703ab\") "
Nov 02 08:34:03.598365 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:03.598346    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/84913035-795c-471e-8c5f-c9d23a3703ab-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84913035-795c-471e-8c5f-c9d23a3703ab-workload-socket\") pod \"84913035-795c-471e-8c5f-c9d23a3703ab\" (UID: \"84913035-795c-471e-8c5f-c9d23a3703ab\") "
Nov 02 08:34:03.598534 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:03.598496    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/84913035-795c-471e-8c5f-c9d23a3703ab-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84913035-795c-471e-8c5f-c9d23a3703ab-istiod-ca-cert\") pod \"84913035-795c-471e-8c5f-c9d23a3703ab\" (UID: \"84913035-795c-471e-8c5f-c9d23a3703ab\") "
Nov 02 08:34:03.598534 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:03.598526    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/84913035-795c-471e-8c5f-c9d23a3703ab-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84913035-795c-471e-8c5f-c9d23a3703ab-credential-socket\") pod \"84913035-795c-471e-8c5f-c9d23a3703ab\" (UID: \"84913035-795c-471e-8c5f-c9d23a3703ab\") "
Nov 02 08:34:03.598632 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:03.598586    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/84913035-795c-471e-8c5f-c9d23a3703ab-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84913035-795c-471e-8c5f-c9d23a3703ab-workload-certs\") pod \"84913035-795c-471e-8c5f-c9d23a3703ab\" (UID: \"84913035-795c-471e-8c5f-c9d23a3703ab\") "
Nov 02 08:34:03.598688 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:03.598635    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84913035-795c-471e-8c5f-c9d23a3703ab-istio-data" pod "84913035-795c-471e-8c5f-c9d23a3703ab" (UID: "84913035-795c-471e-8c5f-c9d23a3703ab"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:34:03.598688 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:03.598676    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/84913035-795c-471e-8c5f-c9d23a3703ab-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84913035-795c-471e-8c5f-c9d23a3703ab-istio-podinfo\") pod \"84913035-795c-471e-8c5f-c9d23a3703ab\" (UID: \"84913035-795c-471e-8c5f-c9d23a3703ab\") "
Nov 02 08:34:03.598788 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:03.598680    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84913035-795c-471e-8c5f-c9d23a3703ab-workload-socket" pod "84913035-795c-471e-8c5f-c9d23a3703ab" (UID: "84913035-795c-471e-8c5f-c9d23a3703ab"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:34:03.598788 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:03.598775    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/84913035-795c-471e-8c5f-c9d23a3703ab-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84913035-795c-471e-8c5f-c9d23a3703ab-istio-envoy\") pod \"84913035-795c-471e-8c5f-c9d23a3703ab\" (UID: \"84913035-795c-471e-8c5f-c9d23a3703ab\") "
Nov 02 08:34:03.598930 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:03.598810    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84913035-795c-471e-8c5f-c9d23a3703ab-credential-socket" pod "84913035-795c-471e-8c5f-c9d23a3703ab" (UID: "84913035-795c-471e-8c5f-c9d23a3703ab"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:34:03.598997 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:03.598940    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84913035-795c-471e-8c5f-c9d23a3703ab-istiod-ca-cert" pod "84913035-795c-471e-8c5f-c9d23a3703ab" (UID: "84913035-795c-471e-8c5f-c9d23a3703ab"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:34:03.598997 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:03.598946    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84913035-795c-471e-8c5f-c9d23a3703ab-workload-certs" pod "84913035-795c-471e-8c5f-c9d23a3703ab" (UID: "84913035-795c-471e-8c5f-c9d23a3703ab"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:34:03.599434 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:03.599406    6210 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84913035-795c-471e-8c5f-c9d23a3703ab-istiod-ca-cert\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:34:03.599566 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:03.599440    6210 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84913035-795c-471e-8c5f-c9d23a3703ab-credential-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:34:03.599566 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:03.599454    6210 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84913035-795c-471e-8c5f-c9d23a3703ab-workload-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:34:03.599566 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:03.599468    6210 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84913035-795c-471e-8c5f-c9d23a3703ab-istio-data\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:34:03.599566 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:03.599482    6210 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84913035-795c-471e-8c5f-c9d23a3703ab-workload-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:34:03.600602 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:03.600574    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84913035-795c-471e-8c5f-c9d23a3703ab-kube-api-access-l9l5w" pod "84913035-795c-471e-8c5f-c9d23a3703ab" (UID: "84913035-795c-471e-8c5f-c9d23a3703ab"). InnerVolumeSpecName "kube-api-access-l9l5w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:34:03.600717 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:03.600609    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84913035-795c-471e-8c5f-c9d23a3703ab-istio-token" pod "84913035-795c-471e-8c5f-c9d23a3703ab" (UID: "84913035-795c-471e-8c5f-c9d23a3703ab"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:34:03.600717 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:03.600689    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84913035-795c-471e-8c5f-c9d23a3703ab-istio-envoy" pod "84913035-795c-471e-8c5f-c9d23a3703ab" (UID: "84913035-795c-471e-8c5f-c9d23a3703ab"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:34:03.600837 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:03.600824    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/84913035-795c-471e-8c5f-c9d23a3703ab-istio-podinfo" pod "84913035-795c-471e-8c5f-c9d23a3703ab" (UID: "84913035-795c-471e-8c5f-c9d23a3703ab"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 08:34:03.700787 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:03.700755    6210 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84913035-795c-471e-8c5f-c9d23a3703ab-istio-podinfo\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:34:03.700787 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:03.700783    6210 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84913035-795c-471e-8c5f-c9d23a3703ab-istio-envoy\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:34:03.700787 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:03.700793    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9l5w\" (UniqueName: \"kubernetes.io/projected/84913035-795c-471e-8c5f-c9d23a3703ab-kube-api-access-l9l5w\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:34:03.701052 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:03.700804    6210 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84913035-795c-471e-8c5f-c9d23a3703ab-istio-token\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:34:04.399027 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:04.398993    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m" event={"ID":"84913035-795c-471e-8c5f-c9d23a3703ab","Type":"ContainerDied","Data":"9bc80c0103cc15ec0fc54fbba0c7e3d7ac063fe109786a7c949ca16ccd301318"}
Nov 02 08:34:04.399027 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:04.399014    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"
Nov 02 08:34:04.399481 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:04.399057    6210 scope.go:122] "RemoveContainer" containerID="21f1528b1a8b8f722bd529e8418b4a98aeb32432e871af09652ab33697d8e5fc"
Nov 02 08:34:04.602306 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:04.602273    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"]
Nov 02 08:34:04.649033 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:04.648953    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m"]
Nov 02 08:34:06.353932 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:06.353894    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="84913035-795c-471e-8c5f-c9d23a3703ab" path="/var/lib/kubelet/pods/84913035-795c-471e-8c5f-c9d23a3703ab/volumes"
Nov 02 08:34:16.220046 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:16.220016    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q"]
Nov 02 08:34:16.220674 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:16.220658    6210 cpu_manager.go:414] "containerMap: removing container" podUID="84913035-795c-471e-8c5f-c9d23a3703ab" containerName="istio-proxy"
Nov 02 08:34:16.220674 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:16.220674    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="84913035-795c-471e-8c5f-c9d23a3703ab" containerName="istio-proxy"
Nov 02 08:34:16.220856 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:16.220801    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="84913035-795c-471e-8c5f-c9d23a3703ab" containerName="istio-proxy"
Nov 02 08:34:16.224535 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:16.224514    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q"
Nov 02 08:34:16.258728 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:16.258700    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5356cab6-ae06-4027-a75f-9b3f74cb7318-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q\" (UID: \"5356cab6-ae06-4027-a75f-9b3f74cb7318\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q"
Nov 02 08:34:16.258912 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:16.258888    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkmhq\" (UniqueName: \"kubernetes.io/projected/5356cab6-ae06-4027-a75f-9b3f74cb7318-kube-api-access-nkmhq\") pod \"payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q\" (UID: \"5356cab6-ae06-4027-a75f-9b3f74cb7318\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q"
Nov 02 08:34:16.279638 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:16.279610    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q"]
Nov 02 08:34:16.322147 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:16.322102    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-bca68b\""
Nov 02 08:34:16.322147 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:16.322139    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-bca68b-dockercfg-b9k5k\""
Nov 02 08:34:16.360169 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:16.360137    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5356cab6-ae06-4027-a75f-9b3f74cb7318-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q\" (UID: \"5356cab6-ae06-4027-a75f-9b3f74cb7318\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q"
Nov 02 08:34:16.360376 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:16.360313    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkmhq\" (UniqueName: \"kubernetes.io/projected/5356cab6-ae06-4027-a75f-9b3f74cb7318-kube-api-access-nkmhq\") pod \"payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q\" (UID: \"5356cab6-ae06-4027-a75f-9b3f74cb7318\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q"
Nov 02 08:34:16.361038 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:16.361016    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5356cab6-ae06-4027-a75f-9b3f74cb7318-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q\" (UID: \"5356cab6-ae06-4027-a75f-9b3f74cb7318\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q"
Nov 02 08:34:16.414845 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:16.414808    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkmhq\" (UniqueName: \"kubernetes.io/projected/5356cab6-ae06-4027-a75f-9b3f74cb7318-kube-api-access-nkmhq\") pod \"payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q\" (UID: \"5356cab6-ae06-4027-a75f-9b3f74cb7318\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q"
Nov 02 08:34:16.538535 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:16.538446    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q"
Nov 02 08:34:16.910857 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:16.910831    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q"]
Nov 02 08:34:16.913383 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:34:16.913292    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5356cab6_ae06_4027_a75f_9b3f74cb7318.slice/crio-25dab6816bca1d300d927d04335b92dd5e53ffec69f4d835e13ea88d8f8faa88 WatchSource:0}: Error finding container 25dab6816bca1d300d927d04335b92dd5e53ffec69f4d835e13ea88d8f8faa88: Status 404 returned error can't find the container with id 25dab6816bca1d300d927d04335b92dd5e53ffec69f4d835e13ea88d8f8faa88
Nov 02 08:34:17.735108 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:17.735070    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q" event={"ID":"5356cab6-ae06-4027-a75f-9b3f74cb7318","Type":"ContainerStarted","Data":"25dab6816bca1d300d927d04335b92dd5e53ffec69f4d835e13ea88d8f8faa88"}
Nov 02 08:34:19.753650 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:19.753613    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q" event={"ID":"5356cab6-ae06-4027-a75f-9b3f74cb7318","Type":"ContainerStarted","Data":"d83e61998b146ce83cc3a8c1fea9031e37235e47e88d4bebbc000f031a04e297"}
Nov 02 08:34:19.754079 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:19.753695    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q"
Nov 02 08:34:22.206004 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.205954    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q" podStartSLOduration=3.795485138 podStartE2EDuration="6.205939611s" totalImagesPullingTime="2.410454473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:34:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:34:19.889043179 +0000 UTC m=+1649.647471918" watchObservedRunningTime="2026-11-02 08:34:22.205939611 +0000 UTC m=+1651.964368391"
Nov 02 08:34:22.208548 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.208519    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"]
Nov 02 08:34:22.213251 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.213222    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"
Nov 02 08:34:22.255257 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.255226    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"]
Nov 02 08:34:22.259305 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.259281    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"
Nov 02 08:34:22.263756 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.263733    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-istio-token\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br\" (UID: \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"
Nov 02 08:34:22.263894 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.263774    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-workload-certs\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br\" (UID: \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"
Nov 02 08:34:22.263894 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.263799    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-istio-podinfo\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br\" (UID: \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"
Nov 02 08:34:22.263989 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.263958    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-istio-data\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br\" (UID: \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"
Nov 02 08:34:22.264125 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.264103    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjwwm\" (UniqueName: \"kubernetes.io/projected/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-kube-api-access-kjwwm\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br\" (UID: \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"
Nov 02 08:34:22.264307 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.264288    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-workload-socket\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br\" (UID: \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"
Nov 02 08:34:22.264377 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.264362    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-istio-envoy\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br\" (UID: \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"
Nov 02 08:34:22.264427 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.264411    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-credential-socket\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br\" (UID: \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"
Nov 02 08:34:22.264479 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.264465    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-istiod-ca-cert\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br\" (UID: \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"
Nov 02 08:34:22.311104 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.311075    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"]
Nov 02 08:34:22.359689 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.359658    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"]
Nov 02 08:34:22.365767 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.365735    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab1cc655-53d5-4b53-8041-bb102a2d133e-istio-token\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z\" (UID: \"ab1cc655-53d5-4b53-8041-bb102a2d133e\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"
Nov 02 08:34:22.365937 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.365781    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrnrk\" (UniqueName: \"kubernetes.io/projected/ab1cc655-53d5-4b53-8041-bb102a2d133e-kube-api-access-vrnrk\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z\" (UID: \"ab1cc655-53d5-4b53-8041-bb102a2d133e\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"
Nov 02 08:34:22.365937 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.365841    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab1cc655-53d5-4b53-8041-bb102a2d133e-workload-certs\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z\" (UID: \"ab1cc655-53d5-4b53-8041-bb102a2d133e\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"
Nov 02 08:34:22.365937 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.365867    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab1cc655-53d5-4b53-8041-bb102a2d133e-istio-podinfo\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z\" (UID: \"ab1cc655-53d5-4b53-8041-bb102a2d133e\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"
Nov 02 08:34:22.366132 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.365939    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab1cc655-53d5-4b53-8041-bb102a2d133e-istio-data\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z\" (UID: \"ab1cc655-53d5-4b53-8041-bb102a2d133e\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"
Nov 02 08:34:22.366132 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.366082    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjwwm\" (UniqueName: \"kubernetes.io/projected/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-kube-api-access-kjwwm\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br\" (UID: \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"
Nov 02 08:34:22.366132 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.366112    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab1cc655-53d5-4b53-8041-bb102a2d133e-istio-envoy\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z\" (UID: \"ab1cc655-53d5-4b53-8041-bb102a2d133e\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"
Nov 02 08:34:22.366280 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.366208    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab1cc655-53d5-4b53-8041-bb102a2d133e-workload-socket\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z\" (UID: \"ab1cc655-53d5-4b53-8041-bb102a2d133e\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"
Nov 02 08:34:22.366349 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.366331    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-workload-socket\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br\" (UID: \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"
Nov 02 08:34:22.366424 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.366401    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-istio-envoy\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br\" (UID: \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"
Nov 02 08:34:22.366483 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.366459    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-credential-socket\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br\" (UID: \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"
Nov 02 08:34:22.366533 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.366487    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-istiod-ca-cert\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br\" (UID: \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"
Nov 02 08:34:22.366533 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.366521    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab1cc655-53d5-4b53-8041-bb102a2d133e-credential-socket\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z\" (UID: \"ab1cc655-53d5-4b53-8041-bb102a2d133e\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"
Nov 02 08:34:22.366638 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.366551    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab1cc655-53d5-4b53-8041-bb102a2d133e-istiod-ca-cert\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z\" (UID: \"ab1cc655-53d5-4b53-8041-bb102a2d133e\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"
Nov 02 08:34:22.366638 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.366597    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-istio-token\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br\" (UID: \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"
Nov 02 08:34:22.366739 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.366636    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-workload-certs\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br\" (UID: \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"
Nov 02 08:34:22.366739 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.366675    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-istio-podinfo\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br\" (UID: \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"
Nov 02 08:34:22.366739 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.366718    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-istio-data\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br\" (UID: \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"
Nov 02 08:34:22.367142 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.367119    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-credential-socket\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br\" (UID: \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"
Nov 02 08:34:22.367230 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.367195    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-istio-data\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br\" (UID: \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"
Nov 02 08:34:22.367641 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.367618    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-workload-socket\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br\" (UID: \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"
Nov 02 08:34:22.367839 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.367817    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-istiod-ca-cert\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br\" (UID: \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"
Nov 02 08:34:22.368405 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.368382    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-workload-certs\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br\" (UID: \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"
Nov 02 08:34:22.370238 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.370204    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-istio-envoy\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br\" (UID: \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"
Nov 02 08:34:22.371049 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.371027    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-istio-podinfo\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br\" (UID: \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"
Nov 02 08:34:22.421121 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.421093    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjwwm\" (UniqueName: \"kubernetes.io/projected/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-kube-api-access-kjwwm\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br\" (UID: \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"
Nov 02 08:34:22.421252 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.421152    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-istio-token\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br\" (UID: \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"
Nov 02 08:34:22.468415 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.468375    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab1cc655-53d5-4b53-8041-bb102a2d133e-credential-socket\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z\" (UID: \"ab1cc655-53d5-4b53-8041-bb102a2d133e\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"
Nov 02 08:34:22.468592 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.468420    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab1cc655-53d5-4b53-8041-bb102a2d133e-istiod-ca-cert\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z\" (UID: \"ab1cc655-53d5-4b53-8041-bb102a2d133e\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"
Nov 02 08:34:22.468592 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.468490    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab1cc655-53d5-4b53-8041-bb102a2d133e-istio-token\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z\" (UID: \"ab1cc655-53d5-4b53-8041-bb102a2d133e\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"
Nov 02 08:34:22.468592 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.468518    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrnrk\" (UniqueName: \"kubernetes.io/projected/ab1cc655-53d5-4b53-8041-bb102a2d133e-kube-api-access-vrnrk\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z\" (UID: \"ab1cc655-53d5-4b53-8041-bb102a2d133e\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"
Nov 02 08:34:22.468592 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.468588    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab1cc655-53d5-4b53-8041-bb102a2d133e-workload-certs\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z\" (UID: \"ab1cc655-53d5-4b53-8041-bb102a2d133e\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"
Nov 02 08:34:22.468805 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.468616    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab1cc655-53d5-4b53-8041-bb102a2d133e-istio-podinfo\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z\" (UID: \"ab1cc655-53d5-4b53-8041-bb102a2d133e\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"
Nov 02 08:34:22.468805 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.468652    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab1cc655-53d5-4b53-8041-bb102a2d133e-istio-data\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z\" (UID: \"ab1cc655-53d5-4b53-8041-bb102a2d133e\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"
Nov 02 08:34:22.468805 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.468695    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab1cc655-53d5-4b53-8041-bb102a2d133e-istio-envoy\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z\" (UID: \"ab1cc655-53d5-4b53-8041-bb102a2d133e\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"
Nov 02 08:34:22.468997 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.468823    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab1cc655-53d5-4b53-8041-bb102a2d133e-credential-socket\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z\" (UID: \"ab1cc655-53d5-4b53-8041-bb102a2d133e\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"
Nov 02 08:34:22.468997 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.468855    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab1cc655-53d5-4b53-8041-bb102a2d133e-workload-socket\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z\" (UID: \"ab1cc655-53d5-4b53-8041-bb102a2d133e\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"
Nov 02 08:34:22.469367 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.469338    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab1cc655-53d5-4b53-8041-bb102a2d133e-istio-data\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z\" (UID: \"ab1cc655-53d5-4b53-8041-bb102a2d133e\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"
Nov 02 08:34:22.470029 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.469976    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab1cc655-53d5-4b53-8041-bb102a2d133e-workload-certs\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z\" (UID: \"ab1cc655-53d5-4b53-8041-bb102a2d133e\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"
Nov 02 08:34:22.470029 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.469999    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab1cc655-53d5-4b53-8041-bb102a2d133e-workload-socket\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z\" (UID: \"ab1cc655-53d5-4b53-8041-bb102a2d133e\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"
Nov 02 08:34:22.470324 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.470286    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab1cc655-53d5-4b53-8041-bb102a2d133e-istiod-ca-cert\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z\" (UID: \"ab1cc655-53d5-4b53-8041-bb102a2d133e\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"
Nov 02 08:34:22.471169 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.471143    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab1cc655-53d5-4b53-8041-bb102a2d133e-istio-envoy\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z\" (UID: \"ab1cc655-53d5-4b53-8041-bb102a2d133e\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"
Nov 02 08:34:22.472222 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.472203    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab1cc655-53d5-4b53-8041-bb102a2d133e-istio-podinfo\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z\" (UID: \"ab1cc655-53d5-4b53-8041-bb102a2d133e\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"
Nov 02 08:34:22.524714 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.524686    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab1cc655-53d5-4b53-8041-bb102a2d133e-istio-token\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z\" (UID: \"ab1cc655-53d5-4b53-8041-bb102a2d133e\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"
Nov 02 08:34:22.524838 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.524753    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrnrk\" (UniqueName: \"kubernetes.io/projected/ab1cc655-53d5-4b53-8041-bb102a2d133e-kube-api-access-vrnrk\") pod \"e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z\" (UID: \"ab1cc655-53d5-4b53-8041-bb102a2d133e\") " pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"
Nov 02 08:34:22.526597 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.526577    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"
Nov 02 08:34:22.573030 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.573001    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"
Nov 02 08:34:22.947912 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.947866    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"]
Nov 02 08:34:22.949617 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:34:22.949585    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fb0e4fc_48cd_4d2f_8b52_0ac422f14a33.slice/crio-4c8df96aeaf6228a5bff22f00320d7fccf9972206ff5a7ec2bd95916edec89f9 WatchSource:0}: Error finding container 4c8df96aeaf6228a5bff22f00320d7fccf9972206ff5a7ec2bd95916edec89f9: Status 404 returned error can't find the container with id 4c8df96aeaf6228a5bff22f00320d7fccf9972206ff5a7ec2bd95916edec89f9
Nov 02 08:34:22.952713 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.952676    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:34:22.952790 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.952749    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:34:22.952790 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.952779    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:34:22.995421 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.995398    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"]
Nov 02 08:34:22.996655 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:34:22.996630    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab1cc655_53d5_4b53_8041_bb102a2d133e.slice/crio-42abe342129ae0e8803f1b8124723ec6692a412ad995e914cf07df819471d4e8 WatchSource:0}: Error finding container 42abe342129ae0e8803f1b8124723ec6692a412ad995e914cf07df819471d4e8: Status 404 returned error can't find the container with id 42abe342129ae0e8803f1b8124723ec6692a412ad995e914cf07df819471d4e8
Nov 02 08:34:22.999856 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.999800    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:34:23.000006 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.999914    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:34:23.000006 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:22.999969    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:34:23.780454 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:23.780420    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z" event={"ID":"ab1cc655-53d5-4b53-8041-bb102a2d133e","Type":"ContainerStarted","Data":"e7b326345f8f7ea0aaa3716e776c80dc11b748bec6278845808abd5d6d372c75"}
Nov 02 08:34:23.780856 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:23.780475    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z" event={"ID":"ab1cc655-53d5-4b53-8041-bb102a2d133e","Type":"ContainerStarted","Data":"42abe342129ae0e8803f1b8124723ec6692a412ad995e914cf07df819471d4e8"}
Nov 02 08:34:23.782073 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:23.782052    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br" event={"ID":"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33","Type":"ContainerStarted","Data":"bdc887b0ab0c95e314124c833037ae89ce94a222950a24a39c2c5039eeade5de"}
Nov 02 08:34:23.782126 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:23.782093    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br" event={"ID":"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33","Type":"ContainerStarted","Data":"4c8df96aeaf6228a5bff22f00320d7fccf9972206ff5a7ec2bd95916edec89f9"}
Nov 02 08:34:23.993453 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:23.993398    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z" podStartSLOduration=1.993381613 podStartE2EDuration="1.993381613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:34:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:34:23.94637797 +0000 UTC m=+1653.704806703" watchObservedRunningTime="2026-11-02 08:34:23.993381613 +0000 UTC m=+1653.751810397"
Nov 02 08:34:24.059945 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:24.059844    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br" podStartSLOduration=2.059823283 podStartE2EDuration="2.059823283s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:34:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:34:24.057367387 +0000 UTC m=+1653.815796120" watchObservedRunningTime="2026-11-02 08:34:24.059823283 +0000 UTC m=+1653.818252022"
Nov 02 08:34:24.534904 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:24.532092    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"
Nov 02 08:34:24.537333 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:24.537002    6210 patch_prober.go:29] interesting pod/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Nov 02 08:34:24.537333 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:24.537062    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br" podUID="3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Nov 02 08:34:24.573904 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:24.573851    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"
Nov 02 08:34:24.574907 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:24.574863    6210 patch_prober.go:29] interesting pod/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Nov 02 08:34:24.574981 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:24.574933    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z" podUID="ab1cc655-53d5-4b53-8041-bb102a2d133e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Nov 02 08:34:25.530904 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:25.530276    6210 patch_prober.go:29] interesting pod/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Nov 02 08:34:25.530904 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:25.530339    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br" podUID="3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Nov 02 08:34:25.573496 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:25.573465    6210 patch_prober.go:29] interesting pod/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Nov 02 08:34:25.573649 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:25.573516    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z" podUID="ab1cc655-53d5-4b53-8041-bb102a2d133e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Nov 02 08:34:26.527304 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:26.527262    6210 patch_prober.go:29] interesting pod/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Nov 02 08:34:26.527594 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:26.527562    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br" podUID="3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Nov 02 08:34:26.573902 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:26.573847    6210 patch_prober.go:29] interesting pod/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Nov 02 08:34:26.574291 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:26.573991    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z" podUID="ab1cc655-53d5-4b53-8041-bb102a2d133e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Nov 02 08:34:27.530752 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:27.530285    6210 patch_prober.go:29] interesting pod/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Nov 02 08:34:27.530752 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:27.530362    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br" podUID="3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Nov 02 08:34:27.573677 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:27.573641    6210 patch_prober.go:29] interesting pod/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Nov 02 08:34:27.573848 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:27.573693    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z" podUID="ab1cc655-53d5-4b53-8041-bb102a2d133e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Nov 02 08:34:28.535903 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:28.532268    6210 patch_prober.go:29] interesting pod/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Nov 02 08:34:28.535903 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:28.532333    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br" podUID="3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Nov 02 08:34:28.573327 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:28.573291    6210 patch_prober.go:29] interesting pod/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Nov 02 08:34:28.573492 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:28.573345    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z" podUID="ab1cc655-53d5-4b53-8041-bb102a2d133e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Nov 02 08:34:29.531756 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:29.531729    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"
Nov 02 08:34:29.532191 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:29.532175    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"
Nov 02 08:34:29.532757 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:29.532738    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"
Nov 02 08:34:29.578505 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:29.578478    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"
Nov 02 08:34:29.578917 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:29.578721    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"
Nov 02 08:34:29.579614 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:29.579593    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"
Nov 02 08:34:30.762715 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:30.762685    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q"
Nov 02 08:34:30.823125 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:34:30.823087    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:34:39.413654 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:39.413622    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"]
Nov 02 08:34:39.414142 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:39.413832    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx" podUID="5f4322fc-b832-434a-a118-20f92c9469d6" containerName="istio-proxy" containerID="cri-o://ef6febb2ec4deaf5fecefc5632dd077c8802174afacb173b13a8e096875c0fda" gracePeriod=30
Nov 02 08:34:42.532261 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:42.532228    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n"]
Nov 02 08:34:42.536532 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:42.536514    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n"
Nov 02 08:34:42.586527 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:42.586484    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-19ee94\""
Nov 02 08:34:42.587318 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:42.587280    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq7mq\" (UniqueName: \"kubernetes.io/projected/c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35-kube-api-access-zq7mq\") pod \"payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n\" (UID: \"c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n"
Nov 02 08:34:42.587505 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:42.587476    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n\" (UID: \"c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n"
Nov 02 08:34:42.633436 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:42.633405    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-19ee94-dockercfg-zzkzc\""
Nov 02 08:34:42.636136 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:42.636102    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n"]
Nov 02 08:34:42.688642 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:42.688610    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq7mq\" (UniqueName: \"kubernetes.io/projected/c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35-kube-api-access-zq7mq\") pod \"payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n\" (UID: \"c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n"
Nov 02 08:34:42.688790 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:42.688688    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n\" (UID: \"c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n"
Nov 02 08:34:42.689469 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:42.689451    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n\" (UID: \"c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n"
Nov 02 08:34:42.741774 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:42.741740    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq7mq\" (UniqueName: \"kubernetes.io/projected/c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35-kube-api-access-zq7mq\") pod \"payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n\" (UID: \"c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n"
Nov 02 08:34:42.851616 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:42.851530    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n"
Nov 02 08:34:43.222925 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:43.222891    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n"]
Nov 02 08:34:43.224216 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:34:43.224189    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc52623a3_d307_4cc2_bf8c_a5e7cbd2cc35.slice/crio-a622c39bdca4e4f1c7e18f74b28ad40f33e9b0b5d0d4dac9293e133ada0afcc1 WatchSource:0}: Error finding container a622c39bdca4e4f1c7e18f74b28ad40f33e9b0b5d0d4dac9293e133ada0afcc1: Status 404 returned error can't find the container with id a622c39bdca4e4f1c7e18f74b28ad40f33e9b0b5d0d4dac9293e133ada0afcc1
Nov 02 08:34:43.320815 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:43.320780    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp"]
Nov 02 08:34:43.326001 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:43.325982    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp"
Nov 02 08:34:43.377602 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:43.377570    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp"]
Nov 02 08:34:43.399622 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:43.399043    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lx9r\" (UniqueName: \"kubernetes.io/projected/b2aa7c8c-14cc-4768-8035-c5644474d228-kube-api-access-7lx9r\") pod \"payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp\" (UID: \"b2aa7c8c-14cc-4768-8035-c5644474d228\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp"
Nov 02 08:34:43.399622 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:43.399259    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2aa7c8c-14cc-4768-8035-c5644474d228-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp\" (UID: \"b2aa7c8c-14cc-4768-8035-c5644474d228\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp"
Nov 02 08:34:43.500494 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:43.500418    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lx9r\" (UniqueName: \"kubernetes.io/projected/b2aa7c8c-14cc-4768-8035-c5644474d228-kube-api-access-7lx9r\") pod \"payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp\" (UID: \"b2aa7c8c-14cc-4768-8035-c5644474d228\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp"
Nov 02 08:34:43.500634 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:43.500522    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2aa7c8c-14cc-4768-8035-c5644474d228-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp\" (UID: \"b2aa7c8c-14cc-4768-8035-c5644474d228\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp"
Nov 02 08:34:43.501255 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:43.501234    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2aa7c8c-14cc-4768-8035-c5644474d228-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp\" (UID: \"b2aa7c8c-14cc-4768-8035-c5644474d228\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp"
Nov 02 08:34:43.553709 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:43.553677    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lx9r\" (UniqueName: \"kubernetes.io/projected/b2aa7c8c-14cc-4768-8035-c5644474d228-kube-api-access-7lx9r\") pod \"payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp\" (UID: \"b2aa7c8c-14cc-4768-8035-c5644474d228\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp"
Nov 02 08:34:43.640650 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:43.640615    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp"
Nov 02 08:34:44.007603 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:44.007572    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp"]
Nov 02 08:34:44.010805 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:34:44.010774    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2aa7c8c_14cc_4768_8035_c5644474d228.slice/crio-e46394ec7c1115a23fd1e41356276ee1e15bcfa512ede3ee71972714eb9a2179 WatchSource:0}: Error finding container e46394ec7c1115a23fd1e41356276ee1e15bcfa512ede3ee71972714eb9a2179: Status 404 returned error can't find the container with id e46394ec7c1115a23fd1e41356276ee1e15bcfa512ede3ee71972714eb9a2179
Nov 02 08:34:44.052972 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:44.052934    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n" event={"ID":"c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35","Type":"ContainerStarted","Data":"90b817279b1ea85ea4fa60f9377bcf86249cc32787d977218399e9342a28e27e"}
Nov 02 08:34:44.053124 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:44.053001    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n" event={"ID":"c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35","Type":"ContainerStarted","Data":"a622c39bdca4e4f1c7e18f74b28ad40f33e9b0b5d0d4dac9293e133ada0afcc1"}
Nov 02 08:34:44.053124 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:44.053031    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n"
Nov 02 08:34:44.054236 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:44.054206    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp" event={"ID":"b2aa7c8c-14cc-4768-8035-c5644474d228","Type":"ContainerStarted","Data":"e46394ec7c1115a23fd1e41356276ee1e15bcfa512ede3ee71972714eb9a2179"}
Nov 02 08:34:44.159850 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:44.159797    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n" podStartSLOduration=2.159778873 podStartE2EDuration="2.159778873s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:34:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:34:44.158402196 +0000 UTC m=+1673.916830931" watchObservedRunningTime="2026-11-02 08:34:44.159778873 +0000 UTC m=+1673.918207604"
Nov 02 08:34:44.706132 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:44.706107    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"
Nov 02 08:34:44.725469 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:44.725443    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5f4322fc-b832-434a-a118-20f92c9469d6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f4322fc-b832-434a-a118-20f92c9469d6-istiod-ca-cert\") pod \"5f4322fc-b832-434a-a118-20f92c9469d6\" (UID: \"5f4322fc-b832-434a-a118-20f92c9469d6\") "
Nov 02 08:34:44.725604 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:44.725514    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5f4322fc-b832-434a-a118-20f92c9469d6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f4322fc-b832-434a-a118-20f92c9469d6-istio-data\") pod \"5f4322fc-b832-434a-a118-20f92c9469d6\" (UID: \"5f4322fc-b832-434a-a118-20f92c9469d6\") "
Nov 02 08:34:44.725604 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:44.725574    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5f4322fc-b832-434a-a118-20f92c9469d6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f4322fc-b832-434a-a118-20f92c9469d6-workload-socket\") pod \"5f4322fc-b832-434a-a118-20f92c9469d6\" (UID: \"5f4322fc-b832-434a-a118-20f92c9469d6\") "
Nov 02 08:34:44.725710 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:44.725620    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5f4322fc-b832-434a-a118-20f92c9469d6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f4322fc-b832-434a-a118-20f92c9469d6-istio-envoy\") pod \"5f4322fc-b832-434a-a118-20f92c9469d6\" (UID: \"5f4322fc-b832-434a-a118-20f92c9469d6\") "
Nov 02 08:34:44.725710 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:44.725674    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5f4322fc-b832-434a-a118-20f92c9469d6-istio-token\" (UniqueName: \"kubernetes.io/projected/5f4322fc-b832-434a-a118-20f92c9469d6-istio-token\") pod \"5f4322fc-b832-434a-a118-20f92c9469d6\" (UID: \"5f4322fc-b832-434a-a118-20f92c9469d6\") "
Nov 02 08:34:44.725807 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:44.725745    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5f4322fc-b832-434a-a118-20f92c9469d6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f4322fc-b832-434a-a118-20f92c9469d6-workload-certs\") pod \"5f4322fc-b832-434a-a118-20f92c9469d6\" (UID: \"5f4322fc-b832-434a-a118-20f92c9469d6\") "
Nov 02 08:34:44.725807 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:44.725774    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5f4322fc-b832-434a-a118-20f92c9469d6-kube-api-access-rxdf7\" (UniqueName: \"kubernetes.io/projected/5f4322fc-b832-434a-a118-20f92c9469d6-kube-api-access-rxdf7\") pod \"5f4322fc-b832-434a-a118-20f92c9469d6\" (UID: \"5f4322fc-b832-434a-a118-20f92c9469d6\") "
Nov 02 08:34:44.725975 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:44.725851    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/5f4322fc-b832-434a-a118-20f92c9469d6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f4322fc-b832-434a-a118-20f92c9469d6-istio-podinfo\") pod \"5f4322fc-b832-434a-a118-20f92c9469d6\" (UID: \"5f4322fc-b832-434a-a118-20f92c9469d6\") "
Nov 02 08:34:44.725975 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:44.725911    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5f4322fc-b832-434a-a118-20f92c9469d6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f4322fc-b832-434a-a118-20f92c9469d6-credential-socket\") pod \"5f4322fc-b832-434a-a118-20f92c9469d6\" (UID: \"5f4322fc-b832-434a-a118-20f92c9469d6\") "
Nov 02 08:34:44.725975 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:44.725932    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f4322fc-b832-434a-a118-20f92c9469d6-workload-socket" pod "5f4322fc-b832-434a-a118-20f92c9469d6" (UID: "5f4322fc-b832-434a-a118-20f92c9469d6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:34:44.726124 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:44.725983    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f4322fc-b832-434a-a118-20f92c9469d6-istiod-ca-cert" pod "5f4322fc-b832-434a-a118-20f92c9469d6" (UID: "5f4322fc-b832-434a-a118-20f92c9469d6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:34:44.727292 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:44.726271    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f4322fc-b832-434a-a118-20f92c9469d6-workload-certs" pod "5f4322fc-b832-434a-a118-20f92c9469d6" (UID: "5f4322fc-b832-434a-a118-20f92c9469d6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:34:44.727292 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:44.726489    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f4322fc-b832-434a-a118-20f92c9469d6-credential-socket" pod "5f4322fc-b832-434a-a118-20f92c9469d6" (UID: "5f4322fc-b832-434a-a118-20f92c9469d6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:34:44.727292 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:44.727212    6210 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f4322fc-b832-434a-a118-20f92c9469d6-istiod-ca-cert\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:34:44.727292 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:44.727239    6210 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f4322fc-b832-434a-a118-20f92c9469d6-workload-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:34:44.727292 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:44.727255    6210 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f4322fc-b832-434a-a118-20f92c9469d6-workload-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:34:44.727292 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:44.727270    6210 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f4322fc-b832-434a-a118-20f92c9469d6-credential-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:34:44.727761 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:44.727732    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f4322fc-b832-434a-a118-20f92c9469d6-istio-data" pod "5f4322fc-b832-434a-a118-20f92c9469d6" (UID: "5f4322fc-b832-434a-a118-20f92c9469d6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:34:44.728303 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:44.728274    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f4322fc-b832-434a-a118-20f92c9469d6-istio-envoy" pod "5f4322fc-b832-434a-a118-20f92c9469d6" (UID: "5f4322fc-b832-434a-a118-20f92c9469d6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:34:44.728405 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:44.728331    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5f4322fc-b832-434a-a118-20f92c9469d6-istio-podinfo" pod "5f4322fc-b832-434a-a118-20f92c9469d6" (UID: "5f4322fc-b832-434a-a118-20f92c9469d6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 08:34:44.728405 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:44.728360    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f4322fc-b832-434a-a118-20f92c9469d6-kube-api-access-rxdf7" pod "5f4322fc-b832-434a-a118-20f92c9469d6" (UID: "5f4322fc-b832-434a-a118-20f92c9469d6"). InnerVolumeSpecName "kube-api-access-rxdf7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:34:44.728405 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:44.728384    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f4322fc-b832-434a-a118-20f92c9469d6-istio-token" pod "5f4322fc-b832-434a-a118-20f92c9469d6" (UID: "5f4322fc-b832-434a-a118-20f92c9469d6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:34:44.829074 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:44.829042    6210 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f4322fc-b832-434a-a118-20f92c9469d6-istio-podinfo\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:34:44.829074 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:44.829074    6210 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f4322fc-b832-434a-a118-20f92c9469d6-istio-data\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:34:44.829330 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:44.829089    6210 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f4322fc-b832-434a-a118-20f92c9469d6-istio-envoy\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:34:44.829330 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:44.829103    6210 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f4322fc-b832-434a-a118-20f92c9469d6-istio-token\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:34:44.829330 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:44.829117    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxdf7\" (UniqueName: \"kubernetes.io/projected/5f4322fc-b832-434a-a118-20f92c9469d6-kube-api-access-rxdf7\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:34:45.062447 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:45.062410    6210 generic.go:356] "Generic (PLEG): container finished" podID="5f4322fc-b832-434a-a118-20f92c9469d6" containerID="ef6febb2ec4deaf5fecefc5632dd077c8802174afacb173b13a8e096875c0fda" exitCode=0
Nov 02 08:34:45.062633 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:45.062469    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"
Nov 02 08:34:45.062633 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:45.062486    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx" event={"ID":"5f4322fc-b832-434a-a118-20f92c9469d6","Type":"ContainerDied","Data":"ef6febb2ec4deaf5fecefc5632dd077c8802174afacb173b13a8e096875c0fda"}
Nov 02 08:34:45.062633 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:45.062538    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx" event={"ID":"5f4322fc-b832-434a-a118-20f92c9469d6","Type":"ContainerDied","Data":"8f5d3b1edf4e89e0bec5c3c6b1d6b670ae947b1db54ac9fb1825fe357b7d3204"}
Nov 02 08:34:45.062633 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:45.062563    6210 scope.go:122] "RemoveContainer" containerID="ef6febb2ec4deaf5fecefc5632dd077c8802174afacb173b13a8e096875c0fda"
Nov 02 08:34:45.064362 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:45.064332    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp" event={"ID":"b2aa7c8c-14cc-4768-8035-c5644474d228","Type":"ContainerStarted","Data":"609319b5eba7fcf60c40841069bbe39c50dd7b707757b2ac54fe34debe8fa93e"}
Nov 02 08:34:45.064460 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:45.064430    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp"
Nov 02 08:34:45.074100 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:45.074084    6210 scope.go:122] "RemoveContainer" containerID="ef6febb2ec4deaf5fecefc5632dd077c8802174afacb173b13a8e096875c0fda"
Nov 02 08:34:45.074407 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:34:45.074368    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef6febb2ec4deaf5fecefc5632dd077c8802174afacb173b13a8e096875c0fda\": container with ID starting with ef6febb2ec4deaf5fecefc5632dd077c8802174afacb173b13a8e096875c0fda not found: ID does not exist" containerID="ef6febb2ec4deaf5fecefc5632dd077c8802174afacb173b13a8e096875c0fda"
Nov 02 08:34:45.074465 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:45.074413    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef6febb2ec4deaf5fecefc5632dd077c8802174afacb173b13a8e096875c0fda"} err="failed to get container status \"ef6febb2ec4deaf5fecefc5632dd077c8802174afacb173b13a8e096875c0fda\": rpc error: code = NotFound desc = could not find container \"ef6febb2ec4deaf5fecefc5632dd077c8802174afacb173b13a8e096875c0fda\": container with ID starting with ef6febb2ec4deaf5fecefc5632dd077c8802174afacb173b13a8e096875c0fda not found: ID does not exist"
Nov 02 08:34:45.217468 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:45.217438    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"]
Nov 02 08:34:45.266939 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:45.266873    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx"]
Nov 02 08:34:45.370304 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:45.370211    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp" podStartSLOduration=2.370198628 podStartE2EDuration="2.370198628s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:34:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:34:45.367102133 +0000 UTC m=+1675.125530864" watchObservedRunningTime="2026-11-02 08:34:45.370198628 +0000 UTC m=+1675.128627359"
Nov 02 08:34:46.354535 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:46.354496    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5f4322fc-b832-434a-a118-20f92c9469d6" path="/var/lib/kubelet/pods/5f4322fc-b832-434a-a118-20f92c9469d6/volumes"
Nov 02 08:34:48.291590 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:48.291556    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl"]
Nov 02 08:34:53.292965 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:53.292925    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl" podUID="397d6ce7-76ec-4915-8ef3-f48e0f5966c3" containerName="payload-pre-processing" containerID="cri-o://bfad423218d65d09b50fad97348aed6f249a0639448f469cac7368d819dba784" gracePeriod=25
Nov 02 08:34:53.567671 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:53.567645    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl"
Nov 02 08:34:53.670191 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:53.670158    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7"]
Nov 02 08:34:53.670417 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:53.670382    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7" podUID="b41d3a86-c6af-4e00-9efa-5607bab05e94" containerName="maas-api" containerID="cri-o://56c1cc8f55f56ef1d5f299c934d0f96b25ce97aeb591f36a7a4a7a22e14eec2c" gracePeriod=30
Nov 02 08:34:53.700925 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:53.700902    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/397d6ce7-76ec-4915-8ef3-f48e0f5966c3-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/397d6ce7-76ec-4915-8ef3-f48e0f5966c3-plugins-config-volume\") pod \"397d6ce7-76ec-4915-8ef3-f48e0f5966c3\" (UID: \"397d6ce7-76ec-4915-8ef3-f48e0f5966c3\") "
Nov 02 08:34:53.701110 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:53.701094    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/397d6ce7-76ec-4915-8ef3-f48e0f5966c3-kube-api-access-zpgp5\" (UniqueName: \"kubernetes.io/projected/397d6ce7-76ec-4915-8ef3-f48e0f5966c3-kube-api-access-zpgp5\") pod \"397d6ce7-76ec-4915-8ef3-f48e0f5966c3\" (UID: \"397d6ce7-76ec-4915-8ef3-f48e0f5966c3\") "
Nov 02 08:34:53.701216 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:53.701195    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/397d6ce7-76ec-4915-8ef3-f48e0f5966c3-plugins-config-volume" pod "397d6ce7-76ec-4915-8ef3-f48e0f5966c3" (UID: "397d6ce7-76ec-4915-8ef3-f48e0f5966c3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:34:53.701728 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:53.701704    6210 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/397d6ce7-76ec-4915-8ef3-f48e0f5966c3-plugins-config-volume\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:34:53.703033 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:53.703007    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/397d6ce7-76ec-4915-8ef3-f48e0f5966c3-kube-api-access-zpgp5" pod "397d6ce7-76ec-4915-8ef3-f48e0f5966c3" (UID: "397d6ce7-76ec-4915-8ef3-f48e0f5966c3"). InnerVolumeSpecName "kube-api-access-zpgp5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:34:53.803420 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:53.803349    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpgp5\" (UniqueName: \"kubernetes.io/projected/397d6ce7-76ec-4915-8ef3-f48e0f5966c3-kube-api-access-zpgp5\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:34:54.048109 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:54.048079    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7"
Nov 02 08:34:54.209000 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:54.208967    6210 generic.go:356] "Generic (PLEG): container finished" podID="397d6ce7-76ec-4915-8ef3-f48e0f5966c3" containerID="bfad423218d65d09b50fad97348aed6f249a0639448f469cac7368d819dba784" exitCode=0
Nov 02 08:34:54.209398 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:54.209372    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl" event={"ID":"397d6ce7-76ec-4915-8ef3-f48e0f5966c3","Type":"ContainerDied","Data":"bfad423218d65d09b50fad97348aed6f249a0639448f469cac7368d819dba784"}
Nov 02 08:34:54.209606 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:54.209590    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl" event={"ID":"397d6ce7-76ec-4915-8ef3-f48e0f5966c3","Type":"ContainerDied","Data":"8213d3ee97e4860c231575d9bb32fd2ba733b2dd2ae240d442fddab67fc86e13"}
Nov 02 08:34:54.209714 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:54.209703    6210 scope.go:122] "RemoveContainer" containerID="bfad423218d65d09b50fad97348aed6f249a0639448f469cac7368d819dba784"
Nov 02 08:34:54.209993 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:54.209976    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl"
Nov 02 08:34:54.217915 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:54.217866    6210 generic.go:356] "Generic (PLEG): container finished" podID="b41d3a86-c6af-4e00-9efa-5607bab05e94" containerID="56c1cc8f55f56ef1d5f299c934d0f96b25ce97aeb591f36a7a4a7a22e14eec2c" exitCode=0
Nov 02 08:34:54.218125 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:54.218096    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7" event={"ID":"b41d3a86-c6af-4e00-9efa-5607bab05e94","Type":"ContainerDied","Data":"56c1cc8f55f56ef1d5f299c934d0f96b25ce97aeb591f36a7a4a7a22e14eec2c"}
Nov 02 08:34:54.220439 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:54.220398    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7" event={"ID":"b41d3a86-c6af-4e00-9efa-5607bab05e94","Type":"ContainerDied","Data":"5a110577567648b2446fa46c324282c7f849618c230c6facfa51204cc3128efc"}
Nov 02 08:34:54.220764 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:54.220745    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7"
Nov 02 08:34:54.227018 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:54.225873    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b41d3a86-c6af-4e00-9efa-5607bab05e94-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b41d3a86-c6af-4e00-9efa-5607bab05e94-openshift-service-ca\") pod \"b41d3a86-c6af-4e00-9efa-5607bab05e94\" (UID: \"b41d3a86-c6af-4e00-9efa-5607bab05e94\") "
Nov 02 08:34:54.227018 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:54.226045    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b41d3a86-c6af-4e00-9efa-5607bab05e94-kube-api-access-75h45\" (UniqueName: \"kubernetes.io/projected/b41d3a86-c6af-4e00-9efa-5607bab05e94-kube-api-access-75h45\") pod \"b41d3a86-c6af-4e00-9efa-5607bab05e94\" (UID: \"b41d3a86-c6af-4e00-9efa-5607bab05e94\") "
Nov 02 08:34:54.227018 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:54.226092    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b41d3a86-c6af-4e00-9efa-5607bab05e94-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b41d3a86-c6af-4e00-9efa-5607bab05e94-maas-api-tls\") pod \"b41d3a86-c6af-4e00-9efa-5607bab05e94\" (UID: \"b41d3a86-c6af-4e00-9efa-5607bab05e94\") "
Nov 02 08:34:54.227018 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:54.226188    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b41d3a86-c6af-4e00-9efa-5607bab05e94-metrics-certs\" (UniqueName: \"kubernetes.io/secret/b41d3a86-c6af-4e00-9efa-5607bab05e94-metrics-certs\") pod \"b41d3a86-c6af-4e00-9efa-5607bab05e94\" (UID: \"b41d3a86-c6af-4e00-9efa-5607bab05e94\") "
Nov 02 08:34:54.227018 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:54.226401    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b41d3a86-c6af-4e00-9efa-5607bab05e94-openshift-service-ca" pod "b41d3a86-c6af-4e00-9efa-5607bab05e94" (UID: "b41d3a86-c6af-4e00-9efa-5607bab05e94"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:34:54.227018 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:54.226935    6210 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b41d3a86-c6af-4e00-9efa-5607bab05e94-openshift-service-ca\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:34:54.231375 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:54.230909    6210 scope.go:122] "RemoveContainer" containerID="bfad423218d65d09b50fad97348aed6f249a0639448f469cac7368d819dba784"
Nov 02 08:34:54.233013 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:34:54.232926    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfad423218d65d09b50fad97348aed6f249a0639448f469cac7368d819dba784\": container with ID starting with bfad423218d65d09b50fad97348aed6f249a0639448f469cac7368d819dba784 not found: ID does not exist" containerID="bfad423218d65d09b50fad97348aed6f249a0639448f469cac7368d819dba784"
Nov 02 08:34:54.233013 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:54.232967    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfad423218d65d09b50fad97348aed6f249a0639448f469cac7368d819dba784"} err="failed to get container status \"bfad423218d65d09b50fad97348aed6f249a0639448f469cac7368d819dba784\": rpc error: code = NotFound desc = could not find container \"bfad423218d65d09b50fad97348aed6f249a0639448f469cac7368d819dba784\": container with ID starting with bfad423218d65d09b50fad97348aed6f249a0639448f469cac7368d819dba784 not found: ID does not exist"
Nov 02 08:34:54.233013 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:54.232990    6210 scope.go:122] "RemoveContainer" containerID="56c1cc8f55f56ef1d5f299c934d0f96b25ce97aeb591f36a7a4a7a22e14eec2c"
Nov 02 08:34:54.233235 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:54.233011    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b41d3a86-c6af-4e00-9efa-5607bab05e94-kube-api-access-75h45" pod "b41d3a86-c6af-4e00-9efa-5607bab05e94" (UID: "b41d3a86-c6af-4e00-9efa-5607bab05e94"). InnerVolumeSpecName "kube-api-access-75h45". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:34:54.233235 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:54.233145    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b41d3a86-c6af-4e00-9efa-5607bab05e94-metrics-certs" pod "b41d3a86-c6af-4e00-9efa-5607bab05e94" (UID: "b41d3a86-c6af-4e00-9efa-5607bab05e94"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:34:54.233525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:54.233443    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b41d3a86-c6af-4e00-9efa-5607bab05e94-maas-api-tls" pod "b41d3a86-c6af-4e00-9efa-5607bab05e94" (UID: "b41d3a86-c6af-4e00-9efa-5607bab05e94"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:34:54.244771 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:54.244698    6210 scope.go:122] "RemoveContainer" containerID="56c1cc8f55f56ef1d5f299c934d0f96b25ce97aeb591f36a7a4a7a22e14eec2c"
Nov 02 08:34:54.245195 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:34:54.245167    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56c1cc8f55f56ef1d5f299c934d0f96b25ce97aeb591f36a7a4a7a22e14eec2c\": container with ID starting with 56c1cc8f55f56ef1d5f299c934d0f96b25ce97aeb591f36a7a4a7a22e14eec2c not found: ID does not exist" containerID="56c1cc8f55f56ef1d5f299c934d0f96b25ce97aeb591f36a7a4a7a22e14eec2c"
Nov 02 08:34:54.245296 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:54.245207    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56c1cc8f55f56ef1d5f299c934d0f96b25ce97aeb591f36a7a4a7a22e14eec2c"} err="failed to get container status \"56c1cc8f55f56ef1d5f299c934d0f96b25ce97aeb591f36a7a4a7a22e14eec2c\": rpc error: code = NotFound desc = could not find container \"56c1cc8f55f56ef1d5f299c934d0f96b25ce97aeb591f36a7a4a7a22e14eec2c\": container with ID starting with 56c1cc8f55f56ef1d5f299c934d0f96b25ce97aeb591f36a7a4a7a22e14eec2c not found: ID does not exist"
Nov 02 08:34:54.342952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:54.339282    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75h45\" (UniqueName: \"kubernetes.io/projected/b41d3a86-c6af-4e00-9efa-5607bab05e94-kube-api-access-75h45\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:34:54.342952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:54.339321    6210 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b41d3a86-c6af-4e00-9efa-5607bab05e94-maas-api-tls\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:34:54.342952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:54.339337    6210 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b41d3a86-c6af-4e00-9efa-5607bab05e94-metrics-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:34:54.423989 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:54.423959    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl"]
Nov 02 08:34:54.427110 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:54.427083    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl"]
Nov 02 08:34:54.631410 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:54.631328    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7"]
Nov 02 08:34:54.638227 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:54.637392    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-v9cn7"]
Nov 02 08:34:55.066764 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:55.066730    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n"
Nov 02 08:34:56.074232 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:56.074203    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp"
Nov 02 08:34:56.356426 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:56.356334    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="397d6ce7-76ec-4915-8ef3-f48e0f5966c3" path="/var/lib/kubelet/pods/397d6ce7-76ec-4915-8ef3-f48e0f5966c3/volumes"
Nov 02 08:34:56.357107 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:34:56.357080    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b41d3a86-c6af-4e00-9efa-5607bab05e94" path="/var/lib/kubelet/pods/b41d3a86-c6af-4e00-9efa-5607bab05e94/volumes"
Nov 02 08:35:00.445552 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:00.445475    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688"]
Nov 02 08:35:00.446383 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:00.446359    6210 cpu_manager.go:414] "containerMap: removing container" podUID="397d6ce7-76ec-4915-8ef3-f48e0f5966c3" containerName="payload-pre-processing"
Nov 02 08:35:00.446499 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:00.446385    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="397d6ce7-76ec-4915-8ef3-f48e0f5966c3" containerName="payload-pre-processing"
Nov 02 08:35:00.446499 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:00.446430    6210 cpu_manager.go:414] "containerMap: removing container" podUID="b41d3a86-c6af-4e00-9efa-5607bab05e94" containerName="maas-api"
Nov 02 08:35:00.446499 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:00.446438    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b41d3a86-c6af-4e00-9efa-5607bab05e94" containerName="maas-api"
Nov 02 08:35:00.446499 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:00.446456    6210 cpu_manager.go:414] "containerMap: removing container" podUID="5f4322fc-b832-434a-a118-20f92c9469d6" containerName="istio-proxy"
Nov 02 08:35:00.446499 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:00.446463    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5f4322fc-b832-434a-a118-20f92c9469d6" containerName="istio-proxy"
Nov 02 08:35:00.446659 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:00.446639    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="b41d3a86-c6af-4e00-9efa-5607bab05e94" containerName="maas-api"
Nov 02 08:35:00.446659 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:00.446656    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="5f4322fc-b832-434a-a118-20f92c9469d6" containerName="istio-proxy"
Nov 02 08:35:00.446725 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:00.446676    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="397d6ce7-76ec-4915-8ef3-f48e0f5966c3" containerName="payload-pre-processing"
Nov 02 08:35:00.451814 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:00.451796    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688"
Nov 02 08:35:00.528337 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:00.528299    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/451e6b46-7c5a-4e3f-a367-c5acb443ad04-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688\" (UID: \"451e6b46-7c5a-4e3f-a367-c5acb443ad04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688"
Nov 02 08:35:00.528587 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:00.528345    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/451e6b46-7c5a-4e3f-a367-c5acb443ad04-maas-api-tls\") pod \"maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688\" (UID: \"451e6b46-7c5a-4e3f-a367-c5acb443ad04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688"
Nov 02 08:35:00.528587 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:00.528481    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pp75\" (UniqueName: \"kubernetes.io/projected/451e6b46-7c5a-4e3f-a367-c5acb443ad04-kube-api-access-8pp75\") pod \"maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688\" (UID: \"451e6b46-7c5a-4e3f-a367-c5acb443ad04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688"
Nov 02 08:35:00.528587 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:00.528545    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/451e6b46-7c5a-4e3f-a367-c5acb443ad04-metrics-certs\") pod \"maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688\" (UID: \"451e6b46-7c5a-4e3f-a367-c5acb443ad04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688"
Nov 02 08:35:00.547096 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:00.547066    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-b6a289-serving-cert\""
Nov 02 08:35:00.550277 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:00.550243    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688"]
Nov 02 08:35:00.630382 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:00.630343    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pp75\" (UniqueName: \"kubernetes.io/projected/451e6b46-7c5a-4e3f-a367-c5acb443ad04-kube-api-access-8pp75\") pod \"maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688\" (UID: \"451e6b46-7c5a-4e3f-a367-c5acb443ad04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688"
Nov 02 08:35:00.630561 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:00.630447    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/451e6b46-7c5a-4e3f-a367-c5acb443ad04-metrics-certs\") pod \"maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688\" (UID: \"451e6b46-7c5a-4e3f-a367-c5acb443ad04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688"
Nov 02 08:35:00.630696 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:00.630671    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/451e6b46-7c5a-4e3f-a367-c5acb443ad04-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688\" (UID: \"451e6b46-7c5a-4e3f-a367-c5acb443ad04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688"
Nov 02 08:35:00.630846 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:00.630720    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/451e6b46-7c5a-4e3f-a367-c5acb443ad04-maas-api-tls\") pod \"maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688\" (UID: \"451e6b46-7c5a-4e3f-a367-c5acb443ad04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688"
Nov 02 08:35:00.630942 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:35:00.630895    6210 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6a289-serving-cert: secret "maas-api-e2e-ipp-b-b6a289-serving-cert" not found
Nov 02 08:35:00.631010 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:35:00.630964    6210 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/451e6b46-7c5a-4e3f-a367-c5acb443ad04-maas-api-tls podName:451e6b46-7c5a-4e3f-a367-c5acb443ad04 nodeName:}" failed. No retries permitted until 2026-11-02 08:35:01.130943503 +0000 UTC m=+1690.889372236 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/451e6b46-7c5a-4e3f-a367-c5acb443ad04-maas-api-tls") pod "maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688" (UID: "451e6b46-7c5a-4e3f-a367-c5acb443ad04") : secret "maas-api-e2e-ipp-b-b6a289-serving-cert" not found
Nov 02 08:35:00.632496 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:00.632464    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/451e6b46-7c5a-4e3f-a367-c5acb443ad04-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688\" (UID: \"451e6b46-7c5a-4e3f-a367-c5acb443ad04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688"
Nov 02 08:35:00.639896 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:00.637603    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/451e6b46-7c5a-4e3f-a367-c5acb443ad04-metrics-certs\") pod \"maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688\" (UID: \"451e6b46-7c5a-4e3f-a367-c5acb443ad04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688"
Nov 02 08:35:00.685561 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:00.685522    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pp75\" (UniqueName: \"kubernetes.io/projected/451e6b46-7c5a-4e3f-a367-c5acb443ad04-kube-api-access-8pp75\") pod \"maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688\" (UID: \"451e6b46-7c5a-4e3f-a367-c5acb443ad04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688"
Nov 02 08:35:00.821735 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:35:00.821695    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:35:01.140195 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:01.140115    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/451e6b46-7c5a-4e3f-a367-c5acb443ad04-maas-api-tls\") pod \"maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688\" (UID: \"451e6b46-7c5a-4e3f-a367-c5acb443ad04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688"
Nov 02 08:35:01.142602 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:01.142574    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/451e6b46-7c5a-4e3f-a367-c5acb443ad04-maas-api-tls\") pod \"maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688\" (UID: \"451e6b46-7c5a-4e3f-a367-c5acb443ad04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688"
Nov 02 08:35:01.365992 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:01.365957    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688"
Nov 02 08:35:01.740989 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:01.740956    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688"]
Nov 02 08:35:01.742595 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:35:01.742557    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod451e6b46_7c5a_4e3f_a367_c5acb443ad04.slice/crio-17acf3e6690689f985bdd8126d2773077742e9999e3bd978fbf1788b41399e75 WatchSource:0}: Error finding container 17acf3e6690689f985bdd8126d2773077742e9999e3bd978fbf1788b41399e75: Status 404 returned error can't find the container with id 17acf3e6690689f985bdd8126d2773077742e9999e3bd978fbf1788b41399e75
Nov 02 08:35:02.277976 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:02.277942    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688" event={"ID":"451e6b46-7c5a-4e3f-a367-c5acb443ad04","Type":"ContainerStarted","Data":"17acf3e6690689f985bdd8126d2773077742e9999e3bd978fbf1788b41399e75"}
Nov 02 08:35:03.285930 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:03.285895    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688" event={"ID":"451e6b46-7c5a-4e3f-a367-c5acb443ad04","Type":"ContainerStarted","Data":"228ebeac28a204756ffeabe93aa7de20170e63b6ddcad033490d1030a94e3a5a"}
Nov 02 08:35:03.286392 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:03.286033    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688"
Nov 02 08:35:03.395314 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:03.395260    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688" podStartSLOduration=2.4990558959999998 podStartE2EDuration="3.395245485s" totalImagesPullingTime="896.189589ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:35:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:35:03.392661776 +0000 UTC m=+1693.151090513" watchObservedRunningTime="2026-11-02 08:35:03.395245485 +0000 UTC m=+1693.153674216"
Nov 02 08:35:09.303673 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:09.303639    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688"
Nov 02 08:35:30.824456 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:35:30.824412    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:35:51.996198 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:51.996158    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"]
Nov 02 08:35:51.997966 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:51.997862    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb" podUID="6a879a44-e608-4679-bb49-716d91dd10c7" containerName="istio-proxy" containerID="cri-o://086089ffd3d94fe11b68b91a79a29e06cb0edf4f4381d8d56dc87c8faed21869" gracePeriod=30
Nov 02 08:35:54.706446 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:54.706408    6210 patch_prober.go:29] interesting pod/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 08:35:54.706968 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:54.706475    6210 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb" podUID="6a879a44-e608-4679-bb49-716d91dd10c7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 08:35:54.953093 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:54.953059    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"]
Nov 02 08:35:54.953324 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:54.953278    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt" podUID="66da0bd1-7419-4297-ba9e-aadc1e834ebe" containerName="istio-proxy" containerID="cri-o://dadef0c46f5a58de244e08d01e7021394110b2e8d076ab1e8fdab8e78d02124a" gracePeriod=30
Nov 02 08:35:57.287500 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:57.287427    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"
Nov 02 08:35:57.338275 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:57.338244    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6a879a44-e608-4679-bb49-716d91dd10c7-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a879a44-e608-4679-bb49-716d91dd10c7-workload-certs\") pod \"6a879a44-e608-4679-bb49-716d91dd10c7\" (UID: \"6a879a44-e608-4679-bb49-716d91dd10c7\") "
Nov 02 08:35:57.338410 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:57.338300    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6a879a44-e608-4679-bb49-716d91dd10c7-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a879a44-e608-4679-bb49-716d91dd10c7-istio-envoy\") pod \"6a879a44-e608-4679-bb49-716d91dd10c7\" (UID: \"6a879a44-e608-4679-bb49-716d91dd10c7\") "
Nov 02 08:35:57.338410 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:57.338325    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6a879a44-e608-4679-bb49-716d91dd10c7-istio-token\" (UniqueName: \"kubernetes.io/projected/6a879a44-e608-4679-bb49-716d91dd10c7-istio-token\") pod \"6a879a44-e608-4679-bb49-716d91dd10c7\" (UID: \"6a879a44-e608-4679-bb49-716d91dd10c7\") "
Nov 02 08:35:57.338410 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:57.338364    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6a879a44-e608-4679-bb49-716d91dd10c7-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a879a44-e608-4679-bb49-716d91dd10c7-workload-socket\") pod \"6a879a44-e608-4679-bb49-716d91dd10c7\" (UID: \"6a879a44-e608-4679-bb49-716d91dd10c7\") "
Nov 02 08:35:57.338539 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:57.338463    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6a879a44-e608-4679-bb49-716d91dd10c7-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a879a44-e608-4679-bb49-716d91dd10c7-istio-podinfo\") pod \"6a879a44-e608-4679-bb49-716d91dd10c7\" (UID: \"6a879a44-e608-4679-bb49-716d91dd10c7\") "
Nov 02 08:35:57.338539 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:57.338482    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a879a44-e608-4679-bb49-716d91dd10c7-workload-certs" pod "6a879a44-e608-4679-bb49-716d91dd10c7" (UID: "6a879a44-e608-4679-bb49-716d91dd10c7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:35:57.338539 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:57.338501    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6a879a44-e608-4679-bb49-716d91dd10c7-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a879a44-e608-4679-bb49-716d91dd10c7-credential-socket\") pod \"6a879a44-e608-4679-bb49-716d91dd10c7\" (UID: \"6a879a44-e608-4679-bb49-716d91dd10c7\") "
Nov 02 08:35:57.338672 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:57.338597    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6a879a44-e608-4679-bb49-716d91dd10c7-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a879a44-e608-4679-bb49-716d91dd10c7-istio-data\") pod \"6a879a44-e608-4679-bb49-716d91dd10c7\" (UID: \"6a879a44-e608-4679-bb49-716d91dd10c7\") "
Nov 02 08:35:57.338729 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:57.338694    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6a879a44-e608-4679-bb49-716d91dd10c7-kube-api-access-gwhfs\" (UniqueName: \"kubernetes.io/projected/6a879a44-e608-4679-bb49-716d91dd10c7-kube-api-access-gwhfs\") pod \"6a879a44-e608-4679-bb49-716d91dd10c7\" (UID: \"6a879a44-e608-4679-bb49-716d91dd10c7\") "
Nov 02 08:35:57.338729 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:57.338724    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6a879a44-e608-4679-bb49-716d91dd10c7-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a879a44-e608-4679-bb49-716d91dd10c7-istiod-ca-cert\") pod \"6a879a44-e608-4679-bb49-716d91dd10c7\" (UID: \"6a879a44-e608-4679-bb49-716d91dd10c7\") "
Nov 02 08:35:57.338838 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:57.338723    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a879a44-e608-4679-bb49-716d91dd10c7-workload-socket" pod "6a879a44-e608-4679-bb49-716d91dd10c7" (UID: "6a879a44-e608-4679-bb49-716d91dd10c7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:35:57.338838 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:57.338791    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a879a44-e608-4679-bb49-716d91dd10c7-credential-socket" pod "6a879a44-e608-4679-bb49-716d91dd10c7" (UID: "6a879a44-e608-4679-bb49-716d91dd10c7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:35:57.338978 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:57.338921    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a879a44-e608-4679-bb49-716d91dd10c7-istio-data" pod "6a879a44-e608-4679-bb49-716d91dd10c7" (UID: "6a879a44-e608-4679-bb49-716d91dd10c7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:35:57.339380 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:57.339349    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a879a44-e608-4679-bb49-716d91dd10c7-istiod-ca-cert" pod "6a879a44-e608-4679-bb49-716d91dd10c7" (UID: "6a879a44-e608-4679-bb49-716d91dd10c7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:35:57.339645 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:57.339622    6210 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a879a44-e608-4679-bb49-716d91dd10c7-credential-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:35:57.339731 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:57.339653    6210 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a879a44-e608-4679-bb49-716d91dd10c7-istio-data\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:35:57.339731 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:57.339668    6210 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a879a44-e608-4679-bb49-716d91dd10c7-istiod-ca-cert\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:35:57.339731 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:57.339686    6210 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a879a44-e608-4679-bb49-716d91dd10c7-workload-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:35:57.339731 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:57.339700    6210 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a879a44-e608-4679-bb49-716d91dd10c7-workload-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:35:57.340597 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:57.340573    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a879a44-e608-4679-bb49-716d91dd10c7-istio-token" pod "6a879a44-e608-4679-bb49-716d91dd10c7" (UID: "6a879a44-e608-4679-bb49-716d91dd10c7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:35:57.340679 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:57.340626    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a879a44-e608-4679-bb49-716d91dd10c7-istio-envoy" pod "6a879a44-e608-4679-bb49-716d91dd10c7" (UID: "6a879a44-e608-4679-bb49-716d91dd10c7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:35:57.340775 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:57.340761    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a879a44-e608-4679-bb49-716d91dd10c7-kube-api-access-gwhfs" pod "6a879a44-e608-4679-bb49-716d91dd10c7" (UID: "6a879a44-e608-4679-bb49-716d91dd10c7"). InnerVolumeSpecName "kube-api-access-gwhfs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:35:57.340830 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:57.340776    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6a879a44-e608-4679-bb49-716d91dd10c7-istio-podinfo" pod "6a879a44-e608-4679-bb49-716d91dd10c7" (UID: "6a879a44-e608-4679-bb49-716d91dd10c7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 08:35:57.441224 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:57.441195    6210 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a879a44-e608-4679-bb49-716d91dd10c7-istio-envoy\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:35:57.441224 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:57.441220    6210 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a879a44-e608-4679-bb49-716d91dd10c7-istio-token\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:35:57.441390 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:57.441230    6210 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a879a44-e608-4679-bb49-716d91dd10c7-istio-podinfo\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:35:57.441390 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:57.441240    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwhfs\" (UniqueName: \"kubernetes.io/projected/6a879a44-e608-4679-bb49-716d91dd10c7-kube-api-access-gwhfs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:35:57.703065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:57.702983    6210 generic.go:356] "Generic (PLEG): container finished" podID="6a879a44-e608-4679-bb49-716d91dd10c7" containerID="086089ffd3d94fe11b68b91a79a29e06cb0edf4f4381d8d56dc87c8faed21869" exitCode=0
Nov 02 08:35:57.703065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:57.703031    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"
Nov 02 08:35:57.703257 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:57.703066    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb" event={"ID":"6a879a44-e608-4679-bb49-716d91dd10c7","Type":"ContainerDied","Data":"086089ffd3d94fe11b68b91a79a29e06cb0edf4f4381d8d56dc87c8faed21869"}
Nov 02 08:35:57.703257 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:57.703128    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb" event={"ID":"6a879a44-e608-4679-bb49-716d91dd10c7","Type":"ContainerDied","Data":"2f575df8fc95fc9b9303727e238af710a777d222dbe343aab18b2b30b8ec60ca"}
Nov 02 08:35:57.703257 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:57.703154    6210 scope.go:122] "RemoveContainer" containerID="086089ffd3d94fe11b68b91a79a29e06cb0edf4f4381d8d56dc87c8faed21869"
Nov 02 08:35:57.713793 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:57.713775    6210 scope.go:122] "RemoveContainer" containerID="086089ffd3d94fe11b68b91a79a29e06cb0edf4f4381d8d56dc87c8faed21869"
Nov 02 08:35:57.714086 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:35:57.714064    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"086089ffd3d94fe11b68b91a79a29e06cb0edf4f4381d8d56dc87c8faed21869\": container with ID starting with 086089ffd3d94fe11b68b91a79a29e06cb0edf4f4381d8d56dc87c8faed21869 not found: ID does not exist" containerID="086089ffd3d94fe11b68b91a79a29e06cb0edf4f4381d8d56dc87c8faed21869"
Nov 02 08:35:57.714157 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:57.714098    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"086089ffd3d94fe11b68b91a79a29e06cb0edf4f4381d8d56dc87c8faed21869"} err="failed to get container status \"086089ffd3d94fe11b68b91a79a29e06cb0edf4f4381d8d56dc87c8faed21869\": rpc error: code = NotFound desc = could not find container \"086089ffd3d94fe11b68b91a79a29e06cb0edf4f4381d8d56dc87c8faed21869\": container with ID starting with 086089ffd3d94fe11b68b91a79a29e06cb0edf4f4381d8d56dc87c8faed21869 not found: ID does not exist"
Nov 02 08:35:57.858595 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:57.858566    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"]
Nov 02 08:35:57.862727 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:57.862702    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb"]
Nov 02 08:35:58.353795 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:35:58.353764    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6a879a44-e608-4679-bb49-716d91dd10c7" path="/var/lib/kubelet/pods/6a879a44-e608-4679-bb49-716d91dd10c7/volumes"
Nov 02 08:36:00.244525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:00.244498    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"
Nov 02 08:36:00.280619 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:00.280585    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66da0bd1-7419-4297-ba9e-aadc1e834ebe-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66da0bd1-7419-4297-ba9e-aadc1e834ebe-workload-socket\") pod \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\" (UID: \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\") "
Nov 02 08:36:00.280807 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:00.280677    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/66da0bd1-7419-4297-ba9e-aadc1e834ebe-kube-api-access-rkqcn\" (UniqueName: \"kubernetes.io/projected/66da0bd1-7419-4297-ba9e-aadc1e834ebe-kube-api-access-rkqcn\") pod \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\" (UID: \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\") "
Nov 02 08:36:00.280807 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:00.280770    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/66da0bd1-7419-4297-ba9e-aadc1e834ebe-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66da0bd1-7419-4297-ba9e-aadc1e834ebe-istiod-ca-cert\") pod \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\" (UID: \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\") "
Nov 02 08:36:00.280966 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:00.280813    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66da0bd1-7419-4297-ba9e-aadc1e834ebe-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66da0bd1-7419-4297-ba9e-aadc1e834ebe-credential-socket\") pod \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\" (UID: \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\") "
Nov 02 08:36:00.280966 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:00.280873    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66da0bd1-7419-4297-ba9e-aadc1e834ebe-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66da0bd1-7419-4297-ba9e-aadc1e834ebe-workload-certs\") pod \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\" (UID: \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\") "
Nov 02 08:36:00.281084 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:00.280982    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/66da0bd1-7419-4297-ba9e-aadc1e834ebe-istio-token\" (UniqueName: \"kubernetes.io/projected/66da0bd1-7419-4297-ba9e-aadc1e834ebe-istio-token\") pod \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\" (UID: \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\") "
Nov 02 08:36:00.281084 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:00.280869    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66da0bd1-7419-4297-ba9e-aadc1e834ebe-workload-socket" pod "66da0bd1-7419-4297-ba9e-aadc1e834ebe" (UID: "66da0bd1-7419-4297-ba9e-aadc1e834ebe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:36:00.281084 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:00.281022    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66da0bd1-7419-4297-ba9e-aadc1e834ebe-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66da0bd1-7419-4297-ba9e-aadc1e834ebe-istio-data\") pod \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\" (UID: \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\") "
Nov 02 08:36:00.281224 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:00.281091    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/66da0bd1-7419-4297-ba9e-aadc1e834ebe-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66da0bd1-7419-4297-ba9e-aadc1e834ebe-istio-podinfo\") pod \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\" (UID: \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\") "
Nov 02 08:36:00.281224 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:00.281125    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66da0bd1-7419-4297-ba9e-aadc1e834ebe-credential-socket" pod "66da0bd1-7419-4297-ba9e-aadc1e834ebe" (UID: "66da0bd1-7419-4297-ba9e-aadc1e834ebe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:36:00.281224 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:00.281155    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66da0bd1-7419-4297-ba9e-aadc1e834ebe-workload-certs" pod "66da0bd1-7419-4297-ba9e-aadc1e834ebe" (UID: "66da0bd1-7419-4297-ba9e-aadc1e834ebe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:36:00.281224 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:00.281178    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66da0bd1-7419-4297-ba9e-aadc1e834ebe-istiod-ca-cert" pod "66da0bd1-7419-4297-ba9e-aadc1e834ebe" (UID: "66da0bd1-7419-4297-ba9e-aadc1e834ebe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:36:00.281416 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:00.281234    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66da0bd1-7419-4297-ba9e-aadc1e834ebe-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66da0bd1-7419-4297-ba9e-aadc1e834ebe-istio-envoy\") pod \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\" (UID: \"66da0bd1-7419-4297-ba9e-aadc1e834ebe\") "
Nov 02 08:36:00.281416 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:00.281304    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66da0bd1-7419-4297-ba9e-aadc1e834ebe-istio-data" pod "66da0bd1-7419-4297-ba9e-aadc1e834ebe" (UID: "66da0bd1-7419-4297-ba9e-aadc1e834ebe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:36:00.281838 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:00.281811    6210 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66da0bd1-7419-4297-ba9e-aadc1e834ebe-istiod-ca-cert\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:36:00.281998 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:00.281841    6210 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66da0bd1-7419-4297-ba9e-aadc1e834ebe-credential-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:36:00.281998 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:00.281855    6210 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66da0bd1-7419-4297-ba9e-aadc1e834ebe-workload-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:36:00.281998 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:00.281868    6210 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66da0bd1-7419-4297-ba9e-aadc1e834ebe-istio-data\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:36:00.281998 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:00.281897    6210 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66da0bd1-7419-4297-ba9e-aadc1e834ebe-workload-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:36:00.283124 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:00.283094    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66da0bd1-7419-4297-ba9e-aadc1e834ebe-kube-api-access-rkqcn" pod "66da0bd1-7419-4297-ba9e-aadc1e834ebe" (UID: "66da0bd1-7419-4297-ba9e-aadc1e834ebe"). InnerVolumeSpecName "kube-api-access-rkqcn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:36:00.283228 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:00.283146    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/66da0bd1-7419-4297-ba9e-aadc1e834ebe-istio-podinfo" pod "66da0bd1-7419-4297-ba9e-aadc1e834ebe" (UID: "66da0bd1-7419-4297-ba9e-aadc1e834ebe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 08:36:00.283228 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:00.283176    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66da0bd1-7419-4297-ba9e-aadc1e834ebe-istio-token" pod "66da0bd1-7419-4297-ba9e-aadc1e834ebe" (UID: "66da0bd1-7419-4297-ba9e-aadc1e834ebe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:36:00.283371 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:00.283357    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66da0bd1-7419-4297-ba9e-aadc1e834ebe-istio-envoy" pod "66da0bd1-7419-4297-ba9e-aadc1e834ebe" (UID: "66da0bd1-7419-4297-ba9e-aadc1e834ebe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:36:00.383273 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:00.383238    6210 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66da0bd1-7419-4297-ba9e-aadc1e834ebe-istio-podinfo\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:36:00.383273 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:00.383268    6210 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66da0bd1-7419-4297-ba9e-aadc1e834ebe-istio-envoy\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:36:00.383491 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:00.383282    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkqcn\" (UniqueName: \"kubernetes.io/projected/66da0bd1-7419-4297-ba9e-aadc1e834ebe-kube-api-access-rkqcn\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:36:00.383491 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:00.383294    6210 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66da0bd1-7419-4297-ba9e-aadc1e834ebe-istio-token\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:36:00.728558 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:00.728521    6210 generic.go:356] "Generic (PLEG): container finished" podID="66da0bd1-7419-4297-ba9e-aadc1e834ebe" containerID="dadef0c46f5a58de244e08d01e7021394110b2e8d076ab1e8fdab8e78d02124a" exitCode=0
Nov 02 08:36:00.729033 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:00.728772    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt" event={"ID":"66da0bd1-7419-4297-ba9e-aadc1e834ebe","Type":"ContainerDied","Data":"dadef0c46f5a58de244e08d01e7021394110b2e8d076ab1e8fdab8e78d02124a"}
Nov 02 08:36:00.737911 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:00.729235    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt" event={"ID":"66da0bd1-7419-4297-ba9e-aadc1e834ebe","Type":"ContainerDied","Data":"881f133800ce3dd6e388e6c56f5081aab8bffacc5a2755239e8425ff81c7fdce"}
Nov 02 08:36:00.738294 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:00.728907    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"
Nov 02 08:36:00.741284 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:00.738131    6210 scope.go:122] "RemoveContainer" containerID="dadef0c46f5a58de244e08d01e7021394110b2e8d076ab1e8fdab8e78d02124a"
Nov 02 08:36:00.791326 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:00.791303    6210 scope.go:122] "RemoveContainer" containerID="dadef0c46f5a58de244e08d01e7021394110b2e8d076ab1e8fdab8e78d02124a"
Nov 02 08:36:00.791670 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:36:00.791650    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dadef0c46f5a58de244e08d01e7021394110b2e8d076ab1e8fdab8e78d02124a\": container with ID starting with dadef0c46f5a58de244e08d01e7021394110b2e8d076ab1e8fdab8e78d02124a not found: ID does not exist" containerID="dadef0c46f5a58de244e08d01e7021394110b2e8d076ab1e8fdab8e78d02124a"
Nov 02 08:36:00.791710 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:00.791686    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dadef0c46f5a58de244e08d01e7021394110b2e8d076ab1e8fdab8e78d02124a"} err="failed to get container status \"dadef0c46f5a58de244e08d01e7021394110b2e8d076ab1e8fdab8e78d02124a\": rpc error: code = NotFound desc = could not find container \"dadef0c46f5a58de244e08d01e7021394110b2e8d076ab1e8fdab8e78d02124a\": container with ID starting with dadef0c46f5a58de244e08d01e7021394110b2e8d076ab1e8fdab8e78d02124a not found: ID does not exist"
Nov 02 08:36:00.823219 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:36:00.823183    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:36:00.908028 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:00.907973    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"]
Nov 02 08:36:00.911856 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:00.911830    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt"]
Nov 02 08:36:02.354466 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:02.354428    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="66da0bd1-7419-4297-ba9e-aadc1e834ebe" path="/var/lib/kubelet/pods/66da0bd1-7419-4297-ba9e-aadc1e834ebe/volumes"
Nov 02 08:36:02.407070 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:02.406952    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"]
Nov 02 08:36:02.407287 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:02.407217    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt" podUID="0cbcc23b-e29d-4a1c-9905-17f483872413" containerName="istio-proxy" containerID="cri-o://238c03fdbe4115758547685b8aa5ff49a2d28e3d12725f17cb8e1dc89ae01e2c" gracePeriod=30
Nov 02 08:36:05.382917 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.374627    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"]
Nov 02 08:36:05.382917 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.375664    6210 cpu_manager.go:414] "containerMap: removing container" podUID="6a879a44-e608-4679-bb49-716d91dd10c7" containerName="istio-proxy"
Nov 02 08:36:05.382917 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.375684    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6a879a44-e608-4679-bb49-716d91dd10c7" containerName="istio-proxy"
Nov 02 08:36:05.382917 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.375700    6210 cpu_manager.go:414] "containerMap: removing container" podUID="66da0bd1-7419-4297-ba9e-aadc1e834ebe" containerName="istio-proxy"
Nov 02 08:36:05.382917 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.375708    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="66da0bd1-7419-4297-ba9e-aadc1e834ebe" containerName="istio-proxy"
Nov 02 08:36:05.382917 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.375859    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="6a879a44-e608-4679-bb49-716d91dd10c7" containerName="istio-proxy"
Nov 02 08:36:05.382917 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.375872    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="66da0bd1-7419-4297-ba9e-aadc1e834ebe" containerName="istio-proxy"
Nov 02 08:36:05.389916 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.389846    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"
Nov 02 08:36:05.461072 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.461040    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"]
Nov 02 08:36:05.495062 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.495024    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/744edbc8-e19d-4047-a841-a5b0f9b51562-istio-token\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s\" (UID: \"744edbc8-e19d-4047-a841-a5b0f9b51562\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"
Nov 02 08:36:05.495258 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.495087    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/744edbc8-e19d-4047-a841-a5b0f9b51562-istio-envoy\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s\" (UID: \"744edbc8-e19d-4047-a841-a5b0f9b51562\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"
Nov 02 08:36:05.495429 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.495405    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njkp5\" (UniqueName: \"kubernetes.io/projected/744edbc8-e19d-4047-a841-a5b0f9b51562-kube-api-access-njkp5\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s\" (UID: \"744edbc8-e19d-4047-a841-a5b0f9b51562\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"
Nov 02 08:36:05.495484 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.495464    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/744edbc8-e19d-4047-a841-a5b0f9b51562-istio-data\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s\" (UID: \"744edbc8-e19d-4047-a841-a5b0f9b51562\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"
Nov 02 08:36:05.495534 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.495502    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/744edbc8-e19d-4047-a841-a5b0f9b51562-istiod-ca-cert\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s\" (UID: \"744edbc8-e19d-4047-a841-a5b0f9b51562\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"
Nov 02 08:36:05.495608 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.495586    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/744edbc8-e19d-4047-a841-a5b0f9b51562-credential-socket\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s\" (UID: \"744edbc8-e19d-4047-a841-a5b0f9b51562\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"
Nov 02 08:36:05.495695 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.495679    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/744edbc8-e19d-4047-a841-a5b0f9b51562-workload-socket\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s\" (UID: \"744edbc8-e19d-4047-a841-a5b0f9b51562\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"
Nov 02 08:36:05.495755 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.495741    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/744edbc8-e19d-4047-a841-a5b0f9b51562-workload-certs\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s\" (UID: \"744edbc8-e19d-4047-a841-a5b0f9b51562\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"
Nov 02 08:36:05.495808 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.495769    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/744edbc8-e19d-4047-a841-a5b0f9b51562-istio-podinfo\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s\" (UID: \"744edbc8-e19d-4047-a841-a5b0f9b51562\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"
Nov 02 08:36:05.504140 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.504117    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-b9eea3-openshift-default-dockercfg-lt5rj\""
Nov 02 08:36:05.601901 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.599781    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/744edbc8-e19d-4047-a841-a5b0f9b51562-istio-token\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s\" (UID: \"744edbc8-e19d-4047-a841-a5b0f9b51562\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"
Nov 02 08:36:05.601901 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.599848    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/744edbc8-e19d-4047-a841-a5b0f9b51562-istio-envoy\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s\" (UID: \"744edbc8-e19d-4047-a841-a5b0f9b51562\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"
Nov 02 08:36:05.601901 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.600046    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njkp5\" (UniqueName: \"kubernetes.io/projected/744edbc8-e19d-4047-a841-a5b0f9b51562-kube-api-access-njkp5\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s\" (UID: \"744edbc8-e19d-4047-a841-a5b0f9b51562\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"
Nov 02 08:36:05.601901 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.600097    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/744edbc8-e19d-4047-a841-a5b0f9b51562-istio-data\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s\" (UID: \"744edbc8-e19d-4047-a841-a5b0f9b51562\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"
Nov 02 08:36:05.601901 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.600124    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/744edbc8-e19d-4047-a841-a5b0f9b51562-istiod-ca-cert\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s\" (UID: \"744edbc8-e19d-4047-a841-a5b0f9b51562\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"
Nov 02 08:36:05.601901 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.600151    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/744edbc8-e19d-4047-a841-a5b0f9b51562-credential-socket\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s\" (UID: \"744edbc8-e19d-4047-a841-a5b0f9b51562\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"
Nov 02 08:36:05.601901 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.600231    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/744edbc8-e19d-4047-a841-a5b0f9b51562-workload-socket\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s\" (UID: \"744edbc8-e19d-4047-a841-a5b0f9b51562\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"
Nov 02 08:36:05.601901 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.600305    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/744edbc8-e19d-4047-a841-a5b0f9b51562-workload-certs\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s\" (UID: \"744edbc8-e19d-4047-a841-a5b0f9b51562\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"
Nov 02 08:36:05.601901 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.600336    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/744edbc8-e19d-4047-a841-a5b0f9b51562-istio-podinfo\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s\" (UID: \"744edbc8-e19d-4047-a841-a5b0f9b51562\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"
Nov 02 08:36:05.623901 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.621383    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/744edbc8-e19d-4047-a841-a5b0f9b51562-istio-data\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s\" (UID: \"744edbc8-e19d-4047-a841-a5b0f9b51562\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"
Nov 02 08:36:05.652173 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.648984    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/744edbc8-e19d-4047-a841-a5b0f9b51562-istiod-ca-cert\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s\" (UID: \"744edbc8-e19d-4047-a841-a5b0f9b51562\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"
Nov 02 08:36:05.652173 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.649265    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/744edbc8-e19d-4047-a841-a5b0f9b51562-credential-socket\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s\" (UID: \"744edbc8-e19d-4047-a841-a5b0f9b51562\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"
Nov 02 08:36:05.652173 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.649546    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/744edbc8-e19d-4047-a841-a5b0f9b51562-workload-socket\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s\" (UID: \"744edbc8-e19d-4047-a841-a5b0f9b51562\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"
Nov 02 08:36:05.652173 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.649778    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/744edbc8-e19d-4047-a841-a5b0f9b51562-workload-certs\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s\" (UID: \"744edbc8-e19d-4047-a841-a5b0f9b51562\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"
Nov 02 08:36:05.663900 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.657929    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/744edbc8-e19d-4047-a841-a5b0f9b51562-istio-podinfo\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s\" (UID: \"744edbc8-e19d-4047-a841-a5b0f9b51562\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"
Nov 02 08:36:05.677453 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.668286    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/744edbc8-e19d-4047-a841-a5b0f9b51562-istio-envoy\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s\" (UID: \"744edbc8-e19d-4047-a841-a5b0f9b51562\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"
Nov 02 08:36:05.700482 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.700446    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/744edbc8-e19d-4047-a841-a5b0f9b51562-istio-token\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s\" (UID: \"744edbc8-e19d-4047-a841-a5b0f9b51562\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"
Nov 02 08:36:05.712428 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.712395    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njkp5\" (UniqueName: \"kubernetes.io/projected/744edbc8-e19d-4047-a841-a5b0f9b51562-kube-api-access-njkp5\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s\" (UID: \"744edbc8-e19d-4047-a841-a5b0f9b51562\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"
Nov 02 08:36:05.723475 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:05.723447    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"
Nov 02 08:36:06.144638 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:06.144605    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"]
Nov 02 08:36:06.146228 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:36:06.146195    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod744edbc8_e19d_4047_a841_a5b0f9b51562.slice/crio-068d85f3ca482bf4fe8ff189b637d137537486d62c32701e3d5ffee406f5c136 WatchSource:0}: Error finding container 068d85f3ca482bf4fe8ff189b637d137537486d62c32701e3d5ffee406f5c136: Status 404 returned error can't find the container with id 068d85f3ca482bf4fe8ff189b637d137537486d62c32701e3d5ffee406f5c136
Nov 02 08:36:06.148989 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:06.148953    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:36:06.149078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:06.149028    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:36:06.149078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:06.149061    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:36:06.771121 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:06.771083    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s" event={"ID":"744edbc8-e19d-4047-a841-a5b0f9b51562","Type":"ContainerStarted","Data":"33fd284f0cf723aef1e07f1525926b31c3ed2044fd29b21347234d46935aa8e8"}
Nov 02 08:36:06.771537 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:06.771171    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s" event={"ID":"744edbc8-e19d-4047-a841-a5b0f9b51562","Type":"ContainerStarted","Data":"068d85f3ca482bf4fe8ff189b637d137537486d62c32701e3d5ffee406f5c136"}
Nov 02 08:36:06.931437 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:06.931380    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s" podStartSLOduration=1.931364874 podStartE2EDuration="1.931364874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:36:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:36:06.92650052 +0000 UTC m=+1756.684929290" watchObservedRunningTime="2026-11-02 08:36:06.931364874 +0000 UTC m=+1756.689793606"
Nov 02 08:36:07.646469 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.646437    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"
Nov 02 08:36:07.724061 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.724029    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"
Nov 02 08:36:07.725676 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.725649    6210 patch_prober.go:29] interesting pod/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body=
Nov 02 08:36:07.725834 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.725698    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s" podUID="744edbc8-e19d-4047-a841-a5b0f9b51562" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused"
Nov 02 08:36:07.736701 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.736677    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0cbcc23b-e29d-4a1c-9905-17f483872413-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cbcc23b-e29d-4a1c-9905-17f483872413-workload-socket\") pod \"0cbcc23b-e29d-4a1c-9905-17f483872413\" (UID: \"0cbcc23b-e29d-4a1c-9905-17f483872413\") "
Nov 02 08:36:07.736843 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.736712    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0cbcc23b-e29d-4a1c-9905-17f483872413-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cbcc23b-e29d-4a1c-9905-17f483872413-workload-certs\") pod \"0cbcc23b-e29d-4a1c-9905-17f483872413\" (UID: \"0cbcc23b-e29d-4a1c-9905-17f483872413\") "
Nov 02 08:36:07.736843 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.736737    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0cbcc23b-e29d-4a1c-9905-17f483872413-kube-api-access-kch6j\" (UniqueName: \"kubernetes.io/projected/0cbcc23b-e29d-4a1c-9905-17f483872413-kube-api-access-kch6j\") pod \"0cbcc23b-e29d-4a1c-9905-17f483872413\" (UID: \"0cbcc23b-e29d-4a1c-9905-17f483872413\") "
Nov 02 08:36:07.736843 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.736836    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0cbcc23b-e29d-4a1c-9905-17f483872413-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cbcc23b-e29d-4a1c-9905-17f483872413-credential-socket\") pod \"0cbcc23b-e29d-4a1c-9905-17f483872413\" (UID: \"0cbcc23b-e29d-4a1c-9905-17f483872413\") "
Nov 02 08:36:07.737008 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.736872    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0cbcc23b-e29d-4a1c-9905-17f483872413-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cbcc23b-e29d-4a1c-9905-17f483872413-istiod-ca-cert\") pod \"0cbcc23b-e29d-4a1c-9905-17f483872413\" (UID: \"0cbcc23b-e29d-4a1c-9905-17f483872413\") "
Nov 02 08:36:07.737008 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.736935    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0cbcc23b-e29d-4a1c-9905-17f483872413-istio-token\" (UniqueName: \"kubernetes.io/projected/0cbcc23b-e29d-4a1c-9905-17f483872413-istio-token\") pod \"0cbcc23b-e29d-4a1c-9905-17f483872413\" (UID: \"0cbcc23b-e29d-4a1c-9905-17f483872413\") "
Nov 02 08:36:07.737008 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.736988    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cbcc23b-e29d-4a1c-9905-17f483872413-workload-certs" pod "0cbcc23b-e29d-4a1c-9905-17f483872413" (UID: "0cbcc23b-e29d-4a1c-9905-17f483872413"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:36:07.737157 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.737023    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0cbcc23b-e29d-4a1c-9905-17f483872413-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cbcc23b-e29d-4a1c-9905-17f483872413-istio-data\") pod \"0cbcc23b-e29d-4a1c-9905-17f483872413\" (UID: \"0cbcc23b-e29d-4a1c-9905-17f483872413\") "
Nov 02 08:36:07.737157 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.737058    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cbcc23b-e29d-4a1c-9905-17f483872413-workload-socket" pod "0cbcc23b-e29d-4a1c-9905-17f483872413" (UID: "0cbcc23b-e29d-4a1c-9905-17f483872413"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:36:07.737157 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.737076    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0cbcc23b-e29d-4a1c-9905-17f483872413-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cbcc23b-e29d-4a1c-9905-17f483872413-istio-podinfo\") pod \"0cbcc23b-e29d-4a1c-9905-17f483872413\" (UID: \"0cbcc23b-e29d-4a1c-9905-17f483872413\") "
Nov 02 08:36:07.737157 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.737151    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cbcc23b-e29d-4a1c-9905-17f483872413-credential-socket" pod "0cbcc23b-e29d-4a1c-9905-17f483872413" (UID: "0cbcc23b-e29d-4a1c-9905-17f483872413"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:36:07.737363 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.737208    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0cbcc23b-e29d-4a1c-9905-17f483872413-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cbcc23b-e29d-4a1c-9905-17f483872413-istio-envoy\") pod \"0cbcc23b-e29d-4a1c-9905-17f483872413\" (UID: \"0cbcc23b-e29d-4a1c-9905-17f483872413\") "
Nov 02 08:36:07.737363 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.737309    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cbcc23b-e29d-4a1c-9905-17f483872413-istio-data" pod "0cbcc23b-e29d-4a1c-9905-17f483872413" (UID: "0cbcc23b-e29d-4a1c-9905-17f483872413"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:36:07.737457 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.737402    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cbcc23b-e29d-4a1c-9905-17f483872413-istiod-ca-cert" pod "0cbcc23b-e29d-4a1c-9905-17f483872413" (UID: "0cbcc23b-e29d-4a1c-9905-17f483872413"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:36:07.737853 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.737790    6210 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cbcc23b-e29d-4a1c-9905-17f483872413-credential-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:36:07.737853 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.737810    6210 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cbcc23b-e29d-4a1c-9905-17f483872413-istiod-ca-cert\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:36:07.737853 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.737819    6210 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cbcc23b-e29d-4a1c-9905-17f483872413-istio-data\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:36:07.737853 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.737828    6210 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cbcc23b-e29d-4a1c-9905-17f483872413-workload-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:36:07.737853 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.737837    6210 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cbcc23b-e29d-4a1c-9905-17f483872413-workload-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:36:07.739240 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.739212    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0cbcc23b-e29d-4a1c-9905-17f483872413-istio-podinfo" pod "0cbcc23b-e29d-4a1c-9905-17f483872413" (UID: "0cbcc23b-e29d-4a1c-9905-17f483872413"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 08:36:07.739323 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.739302    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cbcc23b-e29d-4a1c-9905-17f483872413-istio-token" pod "0cbcc23b-e29d-4a1c-9905-17f483872413" (UID: "0cbcc23b-e29d-4a1c-9905-17f483872413"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:36:07.739509 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.739496    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cbcc23b-e29d-4a1c-9905-17f483872413-kube-api-access-kch6j" pod "0cbcc23b-e29d-4a1c-9905-17f483872413" (UID: "0cbcc23b-e29d-4a1c-9905-17f483872413"). InnerVolumeSpecName "kube-api-access-kch6j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:36:07.739675 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.739662    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cbcc23b-e29d-4a1c-9905-17f483872413-istio-envoy" pod "0cbcc23b-e29d-4a1c-9905-17f483872413" (UID: "0cbcc23b-e29d-4a1c-9905-17f483872413"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:36:07.779057 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.779032    6210 generic.go:356] "Generic (PLEG): container finished" podID="0cbcc23b-e29d-4a1c-9905-17f483872413" containerID="238c03fdbe4115758547685b8aa5ff49a2d28e3d12725f17cb8e1dc89ae01e2c" exitCode=0
Nov 02 08:36:07.779405 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.779079    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"
Nov 02 08:36:07.779405 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.779121    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt" event={"ID":"0cbcc23b-e29d-4a1c-9905-17f483872413","Type":"ContainerDied","Data":"238c03fdbe4115758547685b8aa5ff49a2d28e3d12725f17cb8e1dc89ae01e2c"}
Nov 02 08:36:07.779405 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.779172    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt" event={"ID":"0cbcc23b-e29d-4a1c-9905-17f483872413","Type":"ContainerDied","Data":"427afce910df838967cce573e8f0f95c1b51c0be2f149e68876cbf322a6304a6"}
Nov 02 08:36:07.779405 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.779194    6210 scope.go:122] "RemoveContainer" containerID="238c03fdbe4115758547685b8aa5ff49a2d28e3d12725f17cb8e1dc89ae01e2c"
Nov 02 08:36:07.789912 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.789892    6210 scope.go:122] "RemoveContainer" containerID="238c03fdbe4115758547685b8aa5ff49a2d28e3d12725f17cb8e1dc89ae01e2c"
Nov 02 08:36:07.790189 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:36:07.790169    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"238c03fdbe4115758547685b8aa5ff49a2d28e3d12725f17cb8e1dc89ae01e2c\": container with ID starting with 238c03fdbe4115758547685b8aa5ff49a2d28e3d12725f17cb8e1dc89ae01e2c not found: ID does not exist" containerID="238c03fdbe4115758547685b8aa5ff49a2d28e3d12725f17cb8e1dc89ae01e2c"
Nov 02 08:36:07.790261 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.790201    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"238c03fdbe4115758547685b8aa5ff49a2d28e3d12725f17cb8e1dc89ae01e2c"} err="failed to get container status \"238c03fdbe4115758547685b8aa5ff49a2d28e3d12725f17cb8e1dc89ae01e2c\": rpc error: code = NotFound desc = could not find container \"238c03fdbe4115758547685b8aa5ff49a2d28e3d12725f17cb8e1dc89ae01e2c\": container with ID starting with 238c03fdbe4115758547685b8aa5ff49a2d28e3d12725f17cb8e1dc89ae01e2c not found: ID does not exist"
Nov 02 08:36:07.839179 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.839148    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kch6j\" (UniqueName: \"kubernetes.io/projected/0cbcc23b-e29d-4a1c-9905-17f483872413-kube-api-access-kch6j\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:36:07.839179 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.839177    6210 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cbcc23b-e29d-4a1c-9905-17f483872413-istio-token\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:36:07.839389 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.839191    6210 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cbcc23b-e29d-4a1c-9905-17f483872413-istio-podinfo\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:36:07.839389 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.839204    6210 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cbcc23b-e29d-4a1c-9905-17f483872413-istio-envoy\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:36:07.938998 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.936912    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"]
Nov 02 08:36:07.972901 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:07.967043    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt"]
Nov 02 08:36:08.354451 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:08.354418    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0cbcc23b-e29d-4a1c-9905-17f483872413" path="/var/lib/kubelet/pods/0cbcc23b-e29d-4a1c-9905-17f483872413/volumes"
Nov 02 08:36:08.625751 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:08.625624    6210 patch_prober.go:29] interesting pod/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 08:36:08.625751 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:08.625736    6210 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt" podUID="0cbcc23b-e29d-4a1c-9905-17f483872413" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 08:36:08.724343 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:08.724307    6210 patch_prober.go:29] interesting pod/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body=
Nov 02 08:36:08.724552 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:08.724363    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s" podUID="744edbc8-e19d-4047-a841-a5b0f9b51562" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused"
Nov 02 08:36:09.541788 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:09.541752    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9"]
Nov 02 08:36:09.724299 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:09.724264    6210 patch_prober.go:29] interesting pod/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body=
Nov 02 08:36:09.724518 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:09.724329    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s" podUID="744edbc8-e19d-4047-a841-a5b0f9b51562" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused"
Nov 02 08:36:10.727859 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:10.724270    6210 patch_prober.go:29] interesting pod/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body=
Nov 02 08:36:10.727859 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:10.724337    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s" podUID="744edbc8-e19d-4047-a841-a5b0f9b51562" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused"
Nov 02 08:36:11.724350 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:11.724308    6210 patch_prober.go:29] interesting pod/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body=
Nov 02 08:36:11.724549 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:11.724387    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s" podUID="744edbc8-e19d-4047-a841-a5b0f9b51562" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused"
Nov 02 08:36:12.731262 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:12.729672    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"
Nov 02 08:36:12.732558 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:12.732394    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"
Nov 02 08:36:12.734390 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:12.734352    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"
Nov 02 08:36:13.912856 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:13.912822    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k"]
Nov 02 08:36:13.913376 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:13.913085    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k" podUID="c0c5f4a3-f303-4dcb-96e7-302bacfee1ab" containerName="maas-api" containerID="cri-o://dae4bd4f189feb8ee0811840064356775b73b0edc04d0bfa083a9ff35169d68b" gracePeriod=30
Nov 02 08:36:14.291342 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:14.291314    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k"
Nov 02 08:36:14.449919 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:14.449053    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c0c5f4a3-f303-4dcb-96e7-302bacfee1ab-kube-api-access-vs86m\" (UniqueName: \"kubernetes.io/projected/c0c5f4a3-f303-4dcb-96e7-302bacfee1ab-kube-api-access-vs86m\") pod \"c0c5f4a3-f303-4dcb-96e7-302bacfee1ab\" (UID: \"c0c5f4a3-f303-4dcb-96e7-302bacfee1ab\") "
Nov 02 08:36:14.449919 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:14.449125    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c0c5f4a3-f303-4dcb-96e7-302bacfee1ab-metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0c5f4a3-f303-4dcb-96e7-302bacfee1ab-metrics-certs\") pod \"c0c5f4a3-f303-4dcb-96e7-302bacfee1ab\" (UID: \"c0c5f4a3-f303-4dcb-96e7-302bacfee1ab\") "
Nov 02 08:36:14.449919 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:14.449190    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c0c5f4a3-f303-4dcb-96e7-302bacfee1ab-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0c5f4a3-f303-4dcb-96e7-302bacfee1ab-openshift-service-ca\") pod \"c0c5f4a3-f303-4dcb-96e7-302bacfee1ab\" (UID: \"c0c5f4a3-f303-4dcb-96e7-302bacfee1ab\") "
Nov 02 08:36:14.449919 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:14.449374    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c0c5f4a3-f303-4dcb-96e7-302bacfee1ab-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0c5f4a3-f303-4dcb-96e7-302bacfee1ab-maas-api-tls\") pod \"c0c5f4a3-f303-4dcb-96e7-302bacfee1ab\" (UID: \"c0c5f4a3-f303-4dcb-96e7-302bacfee1ab\") "
Nov 02 08:36:14.452932 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:14.451132    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0c5f4a3-f303-4dcb-96e7-302bacfee1ab-openshift-service-ca" pod "c0c5f4a3-f303-4dcb-96e7-302bacfee1ab" (UID: "c0c5f4a3-f303-4dcb-96e7-302bacfee1ab"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:36:14.458903 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:14.456122    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0c5f4a3-f303-4dcb-96e7-302bacfee1ab-metrics-certs" pod "c0c5f4a3-f303-4dcb-96e7-302bacfee1ab" (UID: "c0c5f4a3-f303-4dcb-96e7-302bacfee1ab"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:36:14.467654 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:14.467529    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0c5f4a3-f303-4dcb-96e7-302bacfee1ab-maas-api-tls" pod "c0c5f4a3-f303-4dcb-96e7-302bacfee1ab" (UID: "c0c5f4a3-f303-4dcb-96e7-302bacfee1ab"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:36:14.469325 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:14.469293    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0c5f4a3-f303-4dcb-96e7-302bacfee1ab-kube-api-access-vs86m" pod "c0c5f4a3-f303-4dcb-96e7-302bacfee1ab" (UID: "c0c5f4a3-f303-4dcb-96e7-302bacfee1ab"). InnerVolumeSpecName "kube-api-access-vs86m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:36:14.546591 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:14.546313    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9" podUID="ca605614-76a4-4da3-aaef-b077c7fc867c" containerName="payload-pre-processing" containerID="cri-o://09c1fbbf16b25858af417256f30e2962d668339d0aeb635d4841a09b394e1cfe" gracePeriod=25
Nov 02 08:36:14.569846 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:14.568718    6210 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0c5f4a3-f303-4dcb-96e7-302bacfee1ab-openshift-service-ca\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:36:14.569846 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:14.568761    6210 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0c5f4a3-f303-4dcb-96e7-302bacfee1ab-maas-api-tls\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:36:14.569846 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:14.568776    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vs86m\" (UniqueName: \"kubernetes.io/projected/c0c5f4a3-f303-4dcb-96e7-302bacfee1ab-kube-api-access-vs86m\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:36:14.569846 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:14.568802    6210 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0c5f4a3-f303-4dcb-96e7-302bacfee1ab-metrics-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:36:14.837681 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:14.837656    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9"
Nov 02 08:36:14.980900 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:14.978704    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ca605614-76a4-4da3-aaef-b077c7fc867c-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca605614-76a4-4da3-aaef-b077c7fc867c-plugins-config-volume\") pod \"ca605614-76a4-4da3-aaef-b077c7fc867c\" (UID: \"ca605614-76a4-4da3-aaef-b077c7fc867c\") "
Nov 02 08:36:14.980900 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:14.978823    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ca605614-76a4-4da3-aaef-b077c7fc867c-kube-api-access-bjp7b\" (UniqueName: \"kubernetes.io/projected/ca605614-76a4-4da3-aaef-b077c7fc867c-kube-api-access-bjp7b\") pod \"ca605614-76a4-4da3-aaef-b077c7fc867c\" (UID: \"ca605614-76a4-4da3-aaef-b077c7fc867c\") "
Nov 02 08:36:15.016001 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:15.006053    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca605614-76a4-4da3-aaef-b077c7fc867c-plugins-config-volume" pod "ca605614-76a4-4da3-aaef-b077c7fc867c" (UID: "ca605614-76a4-4da3-aaef-b077c7fc867c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:36:15.027959 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:15.018267    6210 generic.go:356] "Generic (PLEG): container finished" podID="c0c5f4a3-f303-4dcb-96e7-302bacfee1ab" containerID="dae4bd4f189feb8ee0811840064356775b73b0edc04d0bfa083a9ff35169d68b" exitCode=0
Nov 02 08:36:15.031900 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:15.018391    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k" event={"ID":"c0c5f4a3-f303-4dcb-96e7-302bacfee1ab","Type":"ContainerDied","Data":"dae4bd4f189feb8ee0811840064356775b73b0edc04d0bfa083a9ff35169d68b"}
Nov 02 08:36:15.032167 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:15.032128    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k" event={"ID":"c0c5f4a3-f303-4dcb-96e7-302bacfee1ab","Type":"ContainerDied","Data":"f2753c9a12f13c3a86eb80896071670a56c80e2093af401bbba39fadc118f4ad"}
Nov 02 08:36:15.032275 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:15.032187    6210 scope.go:122] "RemoveContainer" containerID="dae4bd4f189feb8ee0811840064356775b73b0edc04d0bfa083a9ff35169d68b"
Nov 02 08:36:15.032349 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:15.018509    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k"
Nov 02 08:36:15.044419 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:15.044387    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca605614-76a4-4da3-aaef-b077c7fc867c-kube-api-access-bjp7b" pod "ca605614-76a4-4da3-aaef-b077c7fc867c" (UID: "ca605614-76a4-4da3-aaef-b077c7fc867c"). InnerVolumeSpecName "kube-api-access-bjp7b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:36:15.047513 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:15.047486    6210 generic.go:356] "Generic (PLEG): container finished" podID="ca605614-76a4-4da3-aaef-b077c7fc867c" containerID="09c1fbbf16b25858af417256f30e2962d668339d0aeb635d4841a09b394e1cfe" exitCode=0
Nov 02 08:36:15.047703 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:15.047548    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9"
Nov 02 08:36:15.048619 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:15.047567    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9" event={"ID":"ca605614-76a4-4da3-aaef-b077c7fc867c","Type":"ContainerDied","Data":"09c1fbbf16b25858af417256f30e2962d668339d0aeb635d4841a09b394e1cfe"}
Nov 02 08:36:15.048619 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:15.048559    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9" event={"ID":"ca605614-76a4-4da3-aaef-b077c7fc867c","Type":"ContainerDied","Data":"a47e1ffdf88de6d115fe40e283213fb583b692414e18dc844b0ef2a50fe116c0"}
Nov 02 08:36:15.061269 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:15.061250    6210 scope.go:122] "RemoveContainer" containerID="dae4bd4f189feb8ee0811840064356775b73b0edc04d0bfa083a9ff35169d68b"
Nov 02 08:36:15.061589 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:36:15.061562    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dae4bd4f189feb8ee0811840064356775b73b0edc04d0bfa083a9ff35169d68b\": container with ID starting with dae4bd4f189feb8ee0811840064356775b73b0edc04d0bfa083a9ff35169d68b not found: ID does not exist" containerID="dae4bd4f189feb8ee0811840064356775b73b0edc04d0bfa083a9ff35169d68b"
Nov 02 08:36:15.061673 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:15.061600    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dae4bd4f189feb8ee0811840064356775b73b0edc04d0bfa083a9ff35169d68b"} err="failed to get container status \"dae4bd4f189feb8ee0811840064356775b73b0edc04d0bfa083a9ff35169d68b\": rpc error: code = NotFound desc = could not find container \"dae4bd4f189feb8ee0811840064356775b73b0edc04d0bfa083a9ff35169d68b\": container with ID starting with dae4bd4f189feb8ee0811840064356775b73b0edc04d0bfa083a9ff35169d68b not found: ID does not exist"
Nov 02 08:36:15.061673 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:15.061625    6210 scope.go:122] "RemoveContainer" containerID="09c1fbbf16b25858af417256f30e2962d668339d0aeb635d4841a09b394e1cfe"
Nov 02 08:36:15.074601 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:15.074577    6210 scope.go:122] "RemoveContainer" containerID="09c1fbbf16b25858af417256f30e2962d668339d0aeb635d4841a09b394e1cfe"
Nov 02 08:36:15.074932 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:36:15.074871    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09c1fbbf16b25858af417256f30e2962d668339d0aeb635d4841a09b394e1cfe\": container with ID starting with 09c1fbbf16b25858af417256f30e2962d668339d0aeb635d4841a09b394e1cfe not found: ID does not exist" containerID="09c1fbbf16b25858af417256f30e2962d668339d0aeb635d4841a09b394e1cfe"
Nov 02 08:36:15.075024 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:15.074940    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09c1fbbf16b25858af417256f30e2962d668339d0aeb635d4841a09b394e1cfe"} err="failed to get container status \"09c1fbbf16b25858af417256f30e2962d668339d0aeb635d4841a09b394e1cfe\": rpc error: code = NotFound desc = could not find container \"09c1fbbf16b25858af417256f30e2962d668339d0aeb635d4841a09b394e1cfe\": container with ID starting with 09c1fbbf16b25858af417256f30e2962d668339d0aeb635d4841a09b394e1cfe not found: ID does not exist"
Nov 02 08:36:15.080810 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:15.080754    6210 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca605614-76a4-4da3-aaef-b077c7fc867c-plugins-config-volume\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:36:15.080810 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:15.080779    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjp7b\" (UniqueName: \"kubernetes.io/projected/ca605614-76a4-4da3-aaef-b077c7fc867c-kube-api-access-bjp7b\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:36:15.200226 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:15.200186    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k"]
Nov 02 08:36:15.203909 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:15.203866    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b26f03-5574d97c68-6hk6k"]
Nov 02 08:36:15.305831 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:15.305801    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9"]
Nov 02 08:36:15.308834 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:15.308809    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9"]
Nov 02 08:36:16.354253 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:16.354222    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c0c5f4a3-f303-4dcb-96e7-302bacfee1ab" path="/var/lib/kubelet/pods/c0c5f4a3-f303-4dcb-96e7-302bacfee1ab/volumes"
Nov 02 08:36:16.354818 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:16.354710    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ca605614-76a4-4da3-aaef-b077c7fc867c" path="/var/lib/kubelet/pods/ca605614-76a4-4da3-aaef-b077c7fc867c/volumes"
Nov 02 08:36:26.062757 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:26.062720    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4"]
Nov 02 08:36:26.063411 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:26.063392    6210 cpu_manager.go:414] "containerMap: removing container" podUID="c0c5f4a3-f303-4dcb-96e7-302bacfee1ab" containerName="maas-api"
Nov 02 08:36:26.063456 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:26.063412    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c0c5f4a3-f303-4dcb-96e7-302bacfee1ab" containerName="maas-api"
Nov 02 08:36:26.063456 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:26.063433    6210 cpu_manager.go:414] "containerMap: removing container" podUID="0cbcc23b-e29d-4a1c-9905-17f483872413" containerName="istio-proxy"
Nov 02 08:36:26.063456 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:26.063438    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0cbcc23b-e29d-4a1c-9905-17f483872413" containerName="istio-proxy"
Nov 02 08:36:26.063555 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:26.063456    6210 cpu_manager.go:414] "containerMap: removing container" podUID="ca605614-76a4-4da3-aaef-b077c7fc867c" containerName="payload-pre-processing"
Nov 02 08:36:26.063555 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:26.063463    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ca605614-76a4-4da3-aaef-b077c7fc867c" containerName="payload-pre-processing"
Nov 02 08:36:26.063622 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:26.063562    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="c0c5f4a3-f303-4dcb-96e7-302bacfee1ab" containerName="maas-api"
Nov 02 08:36:26.063622 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:26.063572    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="0cbcc23b-e29d-4a1c-9905-17f483872413" containerName="istio-proxy"
Nov 02 08:36:26.063622 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:26.063581    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="ca605614-76a4-4da3-aaef-b077c7fc867c" containerName="payload-pre-processing"
Nov 02 08:36:26.069030 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:26.069006    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4"
Nov 02 08:36:26.118981 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:26.118947    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-cba6f9af-serving-cert\""
Nov 02 08:36:26.143831 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:26.143799    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eba9e1b0-c9f1-4ecf-994b-750dfd592c2f-metrics-certs\") pod \"maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4\" (UID: \"eba9e1b0-c9f1-4ecf-994b-750dfd592c2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4"
Nov 02 08:36:26.143998 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:26.143859    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eba9e1b0-c9f1-4ecf-994b-750dfd592c2f-maas-api-tls\") pod \"maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4\" (UID: \"eba9e1b0-c9f1-4ecf-994b-750dfd592c2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4"
Nov 02 08:36:26.144061 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:26.144025    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25f6t\" (UniqueName: \"kubernetes.io/projected/eba9e1b0-c9f1-4ecf-994b-750dfd592c2f-kube-api-access-25f6t\") pod \"maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4\" (UID: \"eba9e1b0-c9f1-4ecf-994b-750dfd592c2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4"
Nov 02 08:36:26.144120 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:26.144099    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eba9e1b0-c9f1-4ecf-994b-750dfd592c2f-openshift-service-ca\") pod \"maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4\" (UID: \"eba9e1b0-c9f1-4ecf-994b-750dfd592c2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4"
Nov 02 08:36:26.167831 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:26.167797    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4"]
Nov 02 08:36:26.245481 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:26.245449    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eba9e1b0-c9f1-4ecf-994b-750dfd592c2f-openshift-service-ca\") pod \"maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4\" (UID: \"eba9e1b0-c9f1-4ecf-994b-750dfd592c2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4"
Nov 02 08:36:26.245637 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:26.245581    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eba9e1b0-c9f1-4ecf-994b-750dfd592c2f-metrics-certs\") pod \"maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4\" (UID: \"eba9e1b0-c9f1-4ecf-994b-750dfd592c2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4"
Nov 02 08:36:26.245688 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:26.245639    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eba9e1b0-c9f1-4ecf-994b-750dfd592c2f-maas-api-tls\") pod \"maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4\" (UID: \"eba9e1b0-c9f1-4ecf-994b-750dfd592c2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4"
Nov 02 08:36:26.245799 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:26.245781    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25f6t\" (UniqueName: \"kubernetes.io/projected/eba9e1b0-c9f1-4ecf-994b-750dfd592c2f-kube-api-access-25f6t\") pod \"maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4\" (UID: \"eba9e1b0-c9f1-4ecf-994b-750dfd592c2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4"
Nov 02 08:36:26.245865 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:36:26.245795    6210 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-serving-cert: secret "maas-api-e2e-mt-cba6f9af-serving-cert" not found
Nov 02 08:36:26.245954 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:36:26.245910    6210 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eba9e1b0-c9f1-4ecf-994b-750dfd592c2f-maas-api-tls podName:eba9e1b0-c9f1-4ecf-994b-750dfd592c2f nodeName:}" failed. No retries permitted until 2026-11-02 08:36:26.745858156 +0000 UTC m=+1776.504286888 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/eba9e1b0-c9f1-4ecf-994b-750dfd592c2f-maas-api-tls") pod "maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4" (UID: "eba9e1b0-c9f1-4ecf-994b-750dfd592c2f") : secret "maas-api-e2e-mt-cba6f9af-serving-cert" not found
Nov 02 08:36:26.246242 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:26.246219    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eba9e1b0-c9f1-4ecf-994b-750dfd592c2f-openshift-service-ca\") pod \"maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4\" (UID: \"eba9e1b0-c9f1-4ecf-994b-750dfd592c2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4"
Nov 02 08:36:26.248103 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:26.248079    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eba9e1b0-c9f1-4ecf-994b-750dfd592c2f-metrics-certs\") pod \"maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4\" (UID: \"eba9e1b0-c9f1-4ecf-994b-750dfd592c2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4"
Nov 02 08:36:26.299462 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:26.299429    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25f6t\" (UniqueName: \"kubernetes.io/projected/eba9e1b0-c9f1-4ecf-994b-750dfd592c2f-kube-api-access-25f6t\") pod \"maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4\" (UID: \"eba9e1b0-c9f1-4ecf-994b-750dfd592c2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4"
Nov 02 08:36:26.766394 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:26.766352    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eba9e1b0-c9f1-4ecf-994b-750dfd592c2f-maas-api-tls\") pod \"maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4\" (UID: \"eba9e1b0-c9f1-4ecf-994b-750dfd592c2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4"
Nov 02 08:36:26.769095 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:26.769067    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eba9e1b0-c9f1-4ecf-994b-750dfd592c2f-maas-api-tls\") pod \"maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4\" (UID: \"eba9e1b0-c9f1-4ecf-994b-750dfd592c2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4"
Nov 02 08:36:26.982504 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:26.982468    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4"
Nov 02 08:36:27.356825 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:27.356793    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4"]
Nov 02 08:36:27.358115 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:36:27.358090    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeba9e1b0_c9f1_4ecf_994b_750dfd592c2f.slice/crio-1589859f7df38b26db73741ff2a2d030214a504a59a46659e023ebf16d459f58 WatchSource:0}: Error finding container 1589859f7df38b26db73741ff2a2d030214a504a59a46659e023ebf16d459f58: Status 404 returned error can't find the container with id 1589859f7df38b26db73741ff2a2d030214a504a59a46659e023ebf16d459f58
Nov 02 08:36:28.134903 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:28.134840    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4" event={"ID":"eba9e1b0-c9f1-4ecf-994b-750dfd592c2f","Type":"ContainerStarted","Data":"1589859f7df38b26db73741ff2a2d030214a504a59a46659e023ebf16d459f58"}
Nov 02 08:36:29.142955 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:29.142914    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4" event={"ID":"eba9e1b0-c9f1-4ecf-994b-750dfd592c2f","Type":"ContainerStarted","Data":"aa77023b419de5ba9b2661be954d68221bbc280376ed722bc4194e69a5e47f14"}
Nov 02 08:36:29.143411 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:29.142988    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4"
Nov 02 08:36:29.253573 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:29.253522    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4" podStartSLOduration=2.211174388 podStartE2EDuration="3.253507868s" totalImagesPullingTime="1.04233348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:36:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:36:29.251125702 +0000 UTC m=+1779.009554436" watchObservedRunningTime="2026-11-02 08:36:29.253507868 +0000 UTC m=+1779.011936655"
Nov 02 08:36:30.920137 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:36:30.920098    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:36:35.155353 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:35.155325    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4"
Nov 02 08:36:50.589756 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:50.589723    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q_f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae/extract/0.log"
Nov 02 08:36:50.591793 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:50.591766    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q_f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae/extract/0.log"
Nov 02 08:36:50.604423 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:50.604395    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb77f_3e7ae74c-fcd8-4820-a8b7-769a5fff9f15/ovn-acl-logging/0.log"
Nov 02 08:36:50.606469 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:50.606451    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb77f_3e7ae74c-fcd8-4820-a8b7-769a5fff9f15/ovn-acl-logging/0.log"
Nov 02 08:36:50.675902 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:50.675860    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"]
Nov 02 08:36:50.681983 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:50.681960    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"
Nov 02 08:36:50.745542 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:50.745500    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-workload-socket\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr\" (UID: \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"
Nov 02 08:36:50.745734 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:50.745611    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-workload-certs\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr\" (UID: \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"
Nov 02 08:36:50.745734 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:50.745656    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-istiod-ca-cert\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr\" (UID: \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"
Nov 02 08:36:50.745846 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:50.745748    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-istio-podinfo\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr\" (UID: \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"
Nov 02 08:36:50.745846 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:50.745824    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-istio-data\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr\" (UID: \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"
Nov 02 08:36:50.746032 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:50.746009    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-istio-token\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr\" (UID: \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"
Nov 02 08:36:50.746074 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:50.746043    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq4vn\" (UniqueName: \"kubernetes.io/projected/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-kube-api-access-jq4vn\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr\" (UID: \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"
Nov 02 08:36:50.746138 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:50.746125    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-credential-socket\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr\" (UID: \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"
Nov 02 08:36:50.746182 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:50.746165    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-istio-envoy\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr\" (UID: \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"
Nov 02 08:36:50.782736 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:50.782700    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"]
Nov 02 08:36:50.847394 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:50.847310    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-istio-data\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr\" (UID: \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"
Nov 02 08:36:50.847551 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:50.847475    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-istio-token\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr\" (UID: \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"
Nov 02 08:36:50.847551 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:50.847506    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq4vn\" (UniqueName: \"kubernetes.io/projected/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-kube-api-access-jq4vn\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr\" (UID: \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"
Nov 02 08:36:50.847669 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:50.847571    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-credential-socket\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr\" (UID: \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"
Nov 02 08:36:50.847669 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:50.847613    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-istio-envoy\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr\" (UID: \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"
Nov 02 08:36:50.847776 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:50.847668    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-istio-data\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr\" (UID: \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"
Nov 02 08:36:50.847776 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:50.847670    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-workload-socket\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr\" (UID: \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"
Nov 02 08:36:50.847776 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:50.847747    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-workload-certs\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr\" (UID: \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"
Nov 02 08:36:50.848016 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:50.847780    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-istiod-ca-cert\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr\" (UID: \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"
Nov 02 08:36:50.848016 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:50.847832    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-istio-podinfo\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr\" (UID: \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"
Nov 02 08:36:50.848016 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:50.847919    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-credential-socket\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr\" (UID: \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"
Nov 02 08:36:50.848197 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:50.848115    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-workload-socket\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr\" (UID: \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"
Nov 02 08:36:50.848197 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:50.848178    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-workload-certs\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr\" (UID: \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"
Nov 02 08:36:50.848848 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:50.848825    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-istiod-ca-cert\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr\" (UID: \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"
Nov 02 08:36:50.849961 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:50.849936    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-istio-envoy\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr\" (UID: \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"
Nov 02 08:36:50.850222 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:50.850199    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-istio-podinfo\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr\" (UID: \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"
Nov 02 08:36:50.900648 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:50.900619    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-istio-token\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr\" (UID: \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"
Nov 02 08:36:50.901180 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:50.901159    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq4vn\" (UniqueName: \"kubernetes.io/projected/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-kube-api-access-jq4vn\") pod \"e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr\" (UID: \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\") " pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"
Nov 02 08:36:51.000591 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:51.000550    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"
Nov 02 08:36:51.422513 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:51.422483    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"]
Nov 02 08:36:51.423357 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:36:51.423333    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50c20741_ec88_47cf_8b93_23f3ff1ed7cd.slice/crio-3669e9e24dabbfe74458229cf94a8ca3bcbe3a34855da21c4cbdf702ce4176ce WatchSource:0}: Error finding container 3669e9e24dabbfe74458229cf94a8ca3bcbe3a34855da21c4cbdf702ce4176ce: Status 404 returned error can't find the container with id 3669e9e24dabbfe74458229cf94a8ca3bcbe3a34855da21c4cbdf702ce4176ce
Nov 02 08:36:51.426131 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:51.426097    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:36:51.426200 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:51.426163    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:36:51.426200 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:51.426191    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:36:52.343335 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:52.343298    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr" event={"ID":"50c20741-ec88-47cf-8b93-23f3ff1ed7cd","Type":"ContainerStarted","Data":"3b6acf8239f6c4de72ec0be298863dac03e396b1d7a504901c760e2fe9c0afcd"}
Nov 02 08:36:52.343761 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:52.343355    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr" event={"ID":"50c20741-ec88-47cf-8b93-23f3ff1ed7cd","Type":"ContainerStarted","Data":"3669e9e24dabbfe74458229cf94a8ca3bcbe3a34855da21c4cbdf702ce4176ce"}
Nov 02 08:36:53.021833 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:53.021799    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"
Nov 02 08:36:53.022990 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:53.022961    6210 patch_prober.go:29] interesting pod/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.91:15021/healthz/ready\": dial tcp 10.134.0.91:15021: connect: connection refused" start-of-body=
Nov 02 08:36:53.023227 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:53.023201    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr" podUID="50c20741-ec88-47cf-8b93-23f3ff1ed7cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.91:15021/healthz/ready\": dial tcp 10.134.0.91:15021: connect: connection refused"
Nov 02 08:36:54.021906 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:54.020982    6210 patch_prober.go:29] interesting pod/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.91:15021/healthz/ready\": dial tcp 10.134.0.91:15021: connect: connection refused" start-of-body=
Nov 02 08:36:54.021906 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:54.021049    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr" podUID="50c20741-ec88-47cf-8b93-23f3ff1ed7cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.91:15021/healthz/ready\": dial tcp 10.134.0.91:15021: connect: connection refused"
Nov 02 08:36:55.019904 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:55.018263    6210 patch_prober.go:29] interesting pod/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.91:15021/healthz/ready\": dial tcp 10.134.0.91:15021: connect: connection refused" start-of-body=
Nov 02 08:36:55.019904 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:55.018341    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr" podUID="50c20741-ec88-47cf-8b93-23f3ff1ed7cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.91:15021/healthz/ready\": dial tcp 10.134.0.91:15021: connect: connection refused"
Nov 02 08:36:55.396306 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:55.396193    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr" podStartSLOduration=5.396178423 podStartE2EDuration="5.396178423s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:36:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:36:52.545384466 +0000 UTC m=+1802.303813199" watchObservedRunningTime="2026-11-02 08:36:55.396178423 +0000 UTC m=+1805.154607155"
Nov 02 08:36:55.397076 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:55.397050    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj"]
Nov 02 08:36:56.010916 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:56.006977    6210 patch_prober.go:29] interesting pod/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.91:15021/healthz/ready\": dial tcp 10.134.0.91:15021: connect: connection refused" start-of-body=
Nov 02 08:36:56.010916 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:56.007038    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr" podUID="50c20741-ec88-47cf-8b93-23f3ff1ed7cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.91:15021/healthz/ready\": dial tcp 10.134.0.91:15021: connect: connection refused"
Nov 02 08:36:57.019903 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:57.016593    6210 patch_prober.go:29] interesting pod/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.91:15021/healthz/ready\": dial tcp 10.134.0.91:15021: connect: connection refused" start-of-body=
Nov 02 08:36:57.019903 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:57.016660    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr" podUID="50c20741-ec88-47cf-8b93-23f3ff1ed7cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.91:15021/healthz/ready\": dial tcp 10.134.0.91:15021: connect: connection refused"
Nov 02 08:36:58.005985 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:58.005951    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"
Nov 02 08:36:58.006444 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:58.006426    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"
Nov 02 08:36:58.007156 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:36:58.007128    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"
Nov 02 08:37:00.397914 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:00.397856    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj" podUID="7c7034e7-ee65-4f14-8731-21d93d7fa08c" containerName="payload-processing" containerID="cri-o://7620ca5f7cc4b7ecbcd125f85ee9bf9286d344ad159d990e785d690b38d4a0e6" gracePeriod=25
Nov 02 08:37:00.672465 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:00.672436    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj"
Nov 02 08:37:00.778608 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:00.778576    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7c7034e7-ee65-4f14-8731-21d93d7fa08c-kube-api-access-h9mv5\" (UniqueName: \"kubernetes.io/projected/7c7034e7-ee65-4f14-8731-21d93d7fa08c-kube-api-access-h9mv5\") pod \"7c7034e7-ee65-4f14-8731-21d93d7fa08c\" (UID: \"7c7034e7-ee65-4f14-8731-21d93d7fa08c\") "
Nov 02 08:37:00.778888 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:00.778775    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7c7034e7-ee65-4f14-8731-21d93d7fa08c-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c7034e7-ee65-4f14-8731-21d93d7fa08c-plugins-config-volume\") pod \"7c7034e7-ee65-4f14-8731-21d93d7fa08c\" (UID: \"7c7034e7-ee65-4f14-8731-21d93d7fa08c\") "
Nov 02 08:37:00.779399 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:00.779367    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c7034e7-ee65-4f14-8731-21d93d7fa08c-plugins-config-volume" pod "7c7034e7-ee65-4f14-8731-21d93d7fa08c" (UID: "7c7034e7-ee65-4f14-8731-21d93d7fa08c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:37:00.779713 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:00.779672    6210 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c7034e7-ee65-4f14-8731-21d93d7fa08c-plugins-config-volume\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:37:00.781301 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:00.781273    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c7034e7-ee65-4f14-8731-21d93d7fa08c-kube-api-access-h9mv5" pod "7c7034e7-ee65-4f14-8731-21d93d7fa08c" (UID: "7c7034e7-ee65-4f14-8731-21d93d7fa08c"). InnerVolumeSpecName "kube-api-access-h9mv5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:37:00.827765 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:37:00.827720    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:37:00.881081 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:00.881047    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9mv5\" (UniqueName: \"kubernetes.io/projected/7c7034e7-ee65-4f14-8731-21d93d7fa08c-kube-api-access-h9mv5\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:37:01.427593 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:01.427507    6210 generic.go:356] "Generic (PLEG): container finished" podID="7c7034e7-ee65-4f14-8731-21d93d7fa08c" containerID="7620ca5f7cc4b7ecbcd125f85ee9bf9286d344ad159d990e785d690b38d4a0e6" exitCode=0
Nov 02 08:37:01.427593 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:01.427557    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj"
Nov 02 08:37:01.428084 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:01.427596    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj" event={"ID":"7c7034e7-ee65-4f14-8731-21d93d7fa08c","Type":"ContainerDied","Data":"7620ca5f7cc4b7ecbcd125f85ee9bf9286d344ad159d990e785d690b38d4a0e6"}
Nov 02 08:37:01.428084 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:01.427668    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj" event={"ID":"7c7034e7-ee65-4f14-8731-21d93d7fa08c","Type":"ContainerDied","Data":"f32061a1b918f9241a0c8e77aed112d99006c4f8af549da4754df552c1b6698e"}
Nov 02 08:37:01.428084 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:01.427699    6210 scope.go:122] "RemoveContainer" containerID="7620ca5f7cc4b7ecbcd125f85ee9bf9286d344ad159d990e785d690b38d4a0e6"
Nov 02 08:37:01.437814 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:01.437794    6210 scope.go:122] "RemoveContainer" containerID="7620ca5f7cc4b7ecbcd125f85ee9bf9286d344ad159d990e785d690b38d4a0e6"
Nov 02 08:37:01.438115 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:37:01.438095    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7620ca5f7cc4b7ecbcd125f85ee9bf9286d344ad159d990e785d690b38d4a0e6\": container with ID starting with 7620ca5f7cc4b7ecbcd125f85ee9bf9286d344ad159d990e785d690b38d4a0e6 not found: ID does not exist" containerID="7620ca5f7cc4b7ecbcd125f85ee9bf9286d344ad159d990e785d690b38d4a0e6"
Nov 02 08:37:01.438180 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:01.438127    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7620ca5f7cc4b7ecbcd125f85ee9bf9286d344ad159d990e785d690b38d4a0e6"} err="failed to get container status \"7620ca5f7cc4b7ecbcd125f85ee9bf9286d344ad159d990e785d690b38d4a0e6\": rpc error: code = NotFound desc = could not find container \"7620ca5f7cc4b7ecbcd125f85ee9bf9286d344ad159d990e785d690b38d4a0e6\": container with ID starting with 7620ca5f7cc4b7ecbcd125f85ee9bf9286d344ad159d990e785d690b38d4a0e6 not found: ID does not exist"
Nov 02 08:37:01.582646 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:01.582602    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj"]
Nov 02 08:37:01.588165 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:01.588139    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj"]
Nov 02 08:37:02.356590 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:02.356548    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7c7034e7-ee65-4f14-8731-21d93d7fa08c" path="/var/lib/kubelet/pods/7c7034e7-ee65-4f14-8731-21d93d7fa08c/volumes"
Nov 02 08:37:12.494397 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:12.494360    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q"]
Nov 02 08:37:12.503370 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:12.503320    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q" podUID="5356cab6-ae06-4027-a75f-9b3f74cb7318" containerName="payload-processing" containerID="cri-o://d83e61998b146ce83cc3a8c1fea9031e37235e47e88d4bebbc000f031a04e297" gracePeriod=30
Nov 02 08:37:12.785348 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:12.785314    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q"
Nov 02 08:37:12.881794 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:12.881757    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5356cab6-ae06-4027-a75f-9b3f74cb7318-kube-api-access-nkmhq\" (UniqueName: \"kubernetes.io/projected/5356cab6-ae06-4027-a75f-9b3f74cb7318-kube-api-access-nkmhq\") pod \"5356cab6-ae06-4027-a75f-9b3f74cb7318\" (UID: \"5356cab6-ae06-4027-a75f-9b3f74cb7318\") "
Nov 02 08:37:12.882008 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:12.881920    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5356cab6-ae06-4027-a75f-9b3f74cb7318-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5356cab6-ae06-4027-a75f-9b3f74cb7318-plugins-config-volume\") pod \"5356cab6-ae06-4027-a75f-9b3f74cb7318\" (UID: \"5356cab6-ae06-4027-a75f-9b3f74cb7318\") "
Nov 02 08:37:12.883074 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:12.883045    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5356cab6-ae06-4027-a75f-9b3f74cb7318-plugins-config-volume" pod "5356cab6-ae06-4027-a75f-9b3f74cb7318" (UID: "5356cab6-ae06-4027-a75f-9b3f74cb7318"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:37:12.884603 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:12.884575    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5356cab6-ae06-4027-a75f-9b3f74cb7318-kube-api-access-nkmhq" pod "5356cab6-ae06-4027-a75f-9b3f74cb7318" (UID: "5356cab6-ae06-4027-a75f-9b3f74cb7318"). InnerVolumeSpecName "kube-api-access-nkmhq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:37:13.027861 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:13.027770    6210 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5356cab6-ae06-4027-a75f-9b3f74cb7318-plugins-config-volume\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:37:13.039900 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:13.036493    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkmhq\" (UniqueName: \"kubernetes.io/projected/5356cab6-ae06-4027-a75f-9b3f74cb7318-kube-api-access-nkmhq\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:37:13.522631 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:13.522599    6210 generic.go:356] "Generic (PLEG): container finished" podID="5356cab6-ae06-4027-a75f-9b3f74cb7318" containerID="d83e61998b146ce83cc3a8c1fea9031e37235e47e88d4bebbc000f031a04e297" exitCode=0
Nov 02 08:37:13.523148 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:13.522644    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q"
Nov 02 08:37:13.523148 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:13.522689    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q" event={"ID":"5356cab6-ae06-4027-a75f-9b3f74cb7318","Type":"ContainerDied","Data":"d83e61998b146ce83cc3a8c1fea9031e37235e47e88d4bebbc000f031a04e297"}
Nov 02 08:37:13.523148 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:13.522748    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q" event={"ID":"5356cab6-ae06-4027-a75f-9b3f74cb7318","Type":"ContainerDied","Data":"25dab6816bca1d300d927d04335b92dd5e53ffec69f4d835e13ea88d8f8faa88"}
Nov 02 08:37:13.523148 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:13.522785    6210 scope.go:122] "RemoveContainer" containerID="d83e61998b146ce83cc3a8c1fea9031e37235e47e88d4bebbc000f031a04e297"
Nov 02 08:37:13.532850 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:13.532833    6210 scope.go:122] "RemoveContainer" containerID="d83e61998b146ce83cc3a8c1fea9031e37235e47e88d4bebbc000f031a04e297"
Nov 02 08:37:13.533146 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:37:13.533124    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d83e61998b146ce83cc3a8c1fea9031e37235e47e88d4bebbc000f031a04e297\": container with ID starting with d83e61998b146ce83cc3a8c1fea9031e37235e47e88d4bebbc000f031a04e297 not found: ID does not exist" containerID="d83e61998b146ce83cc3a8c1fea9031e37235e47e88d4bebbc000f031a04e297"
Nov 02 08:37:13.533212 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:13.533152    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d83e61998b146ce83cc3a8c1fea9031e37235e47e88d4bebbc000f031a04e297"} err="failed to get container status \"d83e61998b146ce83cc3a8c1fea9031e37235e47e88d4bebbc000f031a04e297\": rpc error: code = NotFound desc = could not find container \"d83e61998b146ce83cc3a8c1fea9031e37235e47e88d4bebbc000f031a04e297\": container with ID starting with d83e61998b146ce83cc3a8c1fea9031e37235e47e88d4bebbc000f031a04e297 not found: ID does not exist"
Nov 02 08:37:13.681852 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:13.681819    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q"]
Nov 02 08:37:13.723605 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:13.723575    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q"]
Nov 02 08:37:14.353239 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:14.353205    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5356cab6-ae06-4027-a75f-9b3f74cb7318" path="/var/lib/kubelet/pods/5356cab6-ae06-4027-a75f-9b3f74cb7318/volumes"
Nov 02 08:37:20.790992 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:20.790955    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"]
Nov 02 08:37:20.791490 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:20.791219    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj" podUID="d2b3bbf0-2054-45ee-b135-fbc431f02a09" containerName="istio-proxy" containerID="cri-o://e74be045d174cafb5bf5dc0ff509a957bf92ace6fafd76f0edd17e7a20065ca0" gracePeriod=30
Nov 02 08:37:21.259855 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:21.259822    6210 patch_prober.go:29] interesting pod/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 08:37:21.260022 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:21.259899    6210 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj" podUID="d2b3bbf0-2054-45ee-b135-fbc431f02a09" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 08:37:23.687242 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:23.687205    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a25202-6c4578db76-gkrqv"]
Nov 02 08:37:23.687722 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:23.687458    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a25202-6c4578db76-gkrqv" podUID="2e080b58-6116-41f4-a940-0b18c2d15049" containerName="maas-api" containerID="cri-o://a6295723cdfc82db16e276f83b3ad93fcfe37c0cd80c702b51870dc14076b6ce" gracePeriod=30
Nov 02 08:37:24.056134 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:24.056097    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a25202-6c4578db76-gkrqv"
Nov 02 08:37:24.076208 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:24.076181    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2e080b58-6116-41f4-a940-0b18c2d15049-kube-api-access-kqbw6\" (UniqueName: \"kubernetes.io/projected/2e080b58-6116-41f4-a940-0b18c2d15049-kube-api-access-kqbw6\") pod \"2e080b58-6116-41f4-a940-0b18c2d15049\" (UID: \"2e080b58-6116-41f4-a940-0b18c2d15049\") "
Nov 02 08:37:24.076412 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:24.076398    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2e080b58-6116-41f4-a940-0b18c2d15049-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e080b58-6116-41f4-a940-0b18c2d15049-maas-api-tls\") pod \"2e080b58-6116-41f4-a940-0b18c2d15049\" (UID: \"2e080b58-6116-41f4-a940-0b18c2d15049\") "
Nov 02 08:37:24.076457 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:24.076429    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2e080b58-6116-41f4-a940-0b18c2d15049-metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e080b58-6116-41f4-a940-0b18c2d15049-metrics-certs\") pod \"2e080b58-6116-41f4-a940-0b18c2d15049\" (UID: \"2e080b58-6116-41f4-a940-0b18c2d15049\") "
Nov 02 08:37:24.076496 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:24.076482    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2e080b58-6116-41f4-a940-0b18c2d15049-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e080b58-6116-41f4-a940-0b18c2d15049-openshift-service-ca\") pod \"2e080b58-6116-41f4-a940-0b18c2d15049\" (UID: \"2e080b58-6116-41f4-a940-0b18c2d15049\") "
Nov 02 08:37:24.076977 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:24.076946    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e080b58-6116-41f4-a940-0b18c2d15049-openshift-service-ca" pod "2e080b58-6116-41f4-a940-0b18c2d15049" (UID: "2e080b58-6116-41f4-a940-0b18c2d15049"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:37:24.077122 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:24.077095    6210 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e080b58-6116-41f4-a940-0b18c2d15049-openshift-service-ca\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:37:24.078597 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:24.078569    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e080b58-6116-41f4-a940-0b18c2d15049-metrics-certs" pod "2e080b58-6116-41f4-a940-0b18c2d15049" (UID: "2e080b58-6116-41f4-a940-0b18c2d15049"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:37:24.078873 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:24.078849    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e080b58-6116-41f4-a940-0b18c2d15049-maas-api-tls" pod "2e080b58-6116-41f4-a940-0b18c2d15049" (UID: "2e080b58-6116-41f4-a940-0b18c2d15049"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:37:24.079672 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:24.079644    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e080b58-6116-41f4-a940-0b18c2d15049-kube-api-access-kqbw6" pod "2e080b58-6116-41f4-a940-0b18c2d15049" (UID: "2e080b58-6116-41f4-a940-0b18c2d15049"). InnerVolumeSpecName "kube-api-access-kqbw6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:37:24.192627 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:24.192540    6210 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e080b58-6116-41f4-a940-0b18c2d15049-maas-api-tls\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:37:24.192627 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:24.192576    6210 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e080b58-6116-41f4-a940-0b18c2d15049-metrics-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:37:24.192627 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:24.192593    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqbw6\" (UniqueName: \"kubernetes.io/projected/2e080b58-6116-41f4-a940-0b18c2d15049-kube-api-access-kqbw6\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:37:24.596730 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:24.596699    6210 generic.go:356] "Generic (PLEG): container finished" podID="2e080b58-6116-41f4-a940-0b18c2d15049" containerID="a6295723cdfc82db16e276f83b3ad93fcfe37c0cd80c702b51870dc14076b6ce" exitCode=0
Nov 02 08:37:24.596930 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:24.596738    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a25202-6c4578db76-gkrqv"
Nov 02 08:37:24.596930 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:24.596783    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a25202-6c4578db76-gkrqv" event={"ID":"2e080b58-6116-41f4-a940-0b18c2d15049","Type":"ContainerDied","Data":"a6295723cdfc82db16e276f83b3ad93fcfe37c0cd80c702b51870dc14076b6ce"}
Nov 02 08:37:24.596930 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:24.596844    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a25202-6c4578db76-gkrqv" event={"ID":"2e080b58-6116-41f4-a940-0b18c2d15049","Type":"ContainerDied","Data":"8130ad91ed1115fa8694753ffdf90511346ed6f3f1e0a4c4c3075d5639729cef"}
Nov 02 08:37:24.596930 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:24.596873    6210 scope.go:122] "RemoveContainer" containerID="a6295723cdfc82db16e276f83b3ad93fcfe37c0cd80c702b51870dc14076b6ce"
Nov 02 08:37:24.609256 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:24.609217    6210 scope.go:122] "RemoveContainer" containerID="a6295723cdfc82db16e276f83b3ad93fcfe37c0cd80c702b51870dc14076b6ce"
Nov 02 08:37:24.609614 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:37:24.609588    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6295723cdfc82db16e276f83b3ad93fcfe37c0cd80c702b51870dc14076b6ce\": container with ID starting with a6295723cdfc82db16e276f83b3ad93fcfe37c0cd80c702b51870dc14076b6ce not found: ID does not exist" containerID="a6295723cdfc82db16e276f83b3ad93fcfe37c0cd80c702b51870dc14076b6ce"
Nov 02 08:37:24.609684 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:24.609616    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6295723cdfc82db16e276f83b3ad93fcfe37c0cd80c702b51870dc14076b6ce"} err="failed to get container status \"a6295723cdfc82db16e276f83b3ad93fcfe37c0cd80c702b51870dc14076b6ce\": rpc error: code = NotFound desc = could not find container \"a6295723cdfc82db16e276f83b3ad93fcfe37c0cd80c702b51870dc14076b6ce\": container with ID starting with a6295723cdfc82db16e276f83b3ad93fcfe37c0cd80c702b51870dc14076b6ce not found: ID does not exist"
Nov 02 08:37:24.750969 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:24.750930    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a25202-6c4578db76-gkrqv"]
Nov 02 08:37:24.831903 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:24.822872    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a25202-6c4578db76-gkrqv"]
Nov 02 08:37:26.119159 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.119130    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:37:26.351954 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.351407    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2b3bbf0-2054-45ee-b135-fbc431f02a09-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2b3bbf0-2054-45ee-b135-fbc431f02a09-istio-envoy\") pod \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\" (UID: \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\") "
Nov 02 08:37:26.351954 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.351462    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d2b3bbf0-2054-45ee-b135-fbc431f02a09-kube-api-access-gfsqt\" (UniqueName: \"kubernetes.io/projected/d2b3bbf0-2054-45ee-b135-fbc431f02a09-kube-api-access-gfsqt\") pod \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\" (UID: \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\") "
Nov 02 08:37:26.351954 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.351580    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d2b3bbf0-2054-45ee-b135-fbc431f02a09-istio-token\" (UniqueName: \"kubernetes.io/projected/d2b3bbf0-2054-45ee-b135-fbc431f02a09-istio-token\") pod \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\" (UID: \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\") "
Nov 02 08:37:26.351954 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.351637    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d2b3bbf0-2054-45ee-b135-fbc431f02a09-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2b3bbf0-2054-45ee-b135-fbc431f02a09-istiod-ca-cert\") pod \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\" (UID: \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\") "
Nov 02 08:37:26.351954 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.351679    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d2b3bbf0-2054-45ee-b135-fbc431f02a09-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2b3bbf0-2054-45ee-b135-fbc431f02a09-istio-podinfo\") pod \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\" (UID: \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\") "
Nov 02 08:37:26.351954 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.351727    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2b3bbf0-2054-45ee-b135-fbc431f02a09-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2b3bbf0-2054-45ee-b135-fbc431f02a09-istio-data\") pod \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\" (UID: \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\") "
Nov 02 08:37:26.351954 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.351803    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2b3bbf0-2054-45ee-b135-fbc431f02a09-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2b3bbf0-2054-45ee-b135-fbc431f02a09-workload-certs\") pod \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\" (UID: \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\") "
Nov 02 08:37:26.352454 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.351984    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2b3bbf0-2054-45ee-b135-fbc431f02a09-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2b3bbf0-2054-45ee-b135-fbc431f02a09-workload-socket\") pod \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\" (UID: \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\") "
Nov 02 08:37:26.352454 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.352014    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2b3bbf0-2054-45ee-b135-fbc431f02a09-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2b3bbf0-2054-45ee-b135-fbc431f02a09-credential-socket\") pod \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\" (UID: \"d2b3bbf0-2054-45ee-b135-fbc431f02a09\") "
Nov 02 08:37:26.372013 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.371971    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2b3bbf0-2054-45ee-b135-fbc431f02a09-credential-socket" pod "d2b3bbf0-2054-45ee-b135-fbc431f02a09" (UID: "d2b3bbf0-2054-45ee-b135-fbc431f02a09"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:37:26.372232 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.372208    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2b3bbf0-2054-45ee-b135-fbc431f02a09-istio-data" pod "d2b3bbf0-2054-45ee-b135-fbc431f02a09" (UID: "d2b3bbf0-2054-45ee-b135-fbc431f02a09"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:37:26.395958 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.390923    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2b3bbf0-2054-45ee-b135-fbc431f02a09-istio-token" pod "d2b3bbf0-2054-45ee-b135-fbc431f02a09" (UID: "d2b3bbf0-2054-45ee-b135-fbc431f02a09"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:37:26.395958 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.391064    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2b3bbf0-2054-45ee-b135-fbc431f02a09-istiod-ca-cert" pod "d2b3bbf0-2054-45ee-b135-fbc431f02a09" (UID: "d2b3bbf0-2054-45ee-b135-fbc431f02a09"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:37:26.399698 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.399585    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2b3bbf0-2054-45ee-b135-fbc431f02a09-workload-certs" pod "d2b3bbf0-2054-45ee-b135-fbc431f02a09" (UID: "d2b3bbf0-2054-45ee-b135-fbc431f02a09"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:37:26.399698 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.399672    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2b3bbf0-2054-45ee-b135-fbc431f02a09-workload-socket" pod "d2b3bbf0-2054-45ee-b135-fbc431f02a09" (UID: "d2b3bbf0-2054-45ee-b135-fbc431f02a09"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:37:26.412530 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.404006    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2b3bbf0-2054-45ee-b135-fbc431f02a09-istio-envoy" pod "d2b3bbf0-2054-45ee-b135-fbc431f02a09" (UID: "d2b3bbf0-2054-45ee-b135-fbc431f02a09"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:37:26.468906 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.467002    6210 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2b3bbf0-2054-45ee-b135-fbc431f02a09-istio-data\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:37:26.468906 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.467037    6210 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2b3bbf0-2054-45ee-b135-fbc431f02a09-workload-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:37:26.468906 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.467050    6210 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2b3bbf0-2054-45ee-b135-fbc431f02a09-workload-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:37:26.468906 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.467063    6210 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2b3bbf0-2054-45ee-b135-fbc431f02a09-credential-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:37:26.468906 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.467075    6210 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2b3bbf0-2054-45ee-b135-fbc431f02a09-istio-envoy\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:37:26.468906 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.467087    6210 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2b3bbf0-2054-45ee-b135-fbc431f02a09-istio-token\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:37:26.468906 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.467101    6210 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2b3bbf0-2054-45ee-b135-fbc431f02a09-istiod-ca-cert\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:37:26.480952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.474133    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2e080b58-6116-41f4-a940-0b18c2d15049" path="/var/lib/kubelet/pods/2e080b58-6116-41f4-a940-0b18c2d15049/volumes"
Nov 02 08:37:26.483274 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.483212    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d2b3bbf0-2054-45ee-b135-fbc431f02a09-istio-podinfo" pod "d2b3bbf0-2054-45ee-b135-fbc431f02a09" (UID: "d2b3bbf0-2054-45ee-b135-fbc431f02a09"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 08:37:26.484755 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.484723    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2b3bbf0-2054-45ee-b135-fbc431f02a09-kube-api-access-gfsqt" pod "d2b3bbf0-2054-45ee-b135-fbc431f02a09" (UID: "d2b3bbf0-2054-45ee-b135-fbc431f02a09"). InnerVolumeSpecName "kube-api-access-gfsqt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:37:26.568450 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.568415    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfsqt\" (UniqueName: \"kubernetes.io/projected/d2b3bbf0-2054-45ee-b135-fbc431f02a09-kube-api-access-gfsqt\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:37:26.568450 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.568445    6210 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2b3bbf0-2054-45ee-b135-fbc431f02a09-istio-podinfo\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:37:26.661256 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.661176    6210 generic.go:356] "Generic (PLEG): container finished" podID="d2b3bbf0-2054-45ee-b135-fbc431f02a09" containerID="e74be045d174cafb5bf5dc0ff509a957bf92ace6fafd76f0edd17e7a20065ca0" exitCode=0
Nov 02 08:37:26.661256 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.661227    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"
Nov 02 08:37:26.661256 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.661235    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj" event={"ID":"d2b3bbf0-2054-45ee-b135-fbc431f02a09","Type":"ContainerDied","Data":"e74be045d174cafb5bf5dc0ff509a957bf92ace6fafd76f0edd17e7a20065ca0"}
Nov 02 08:37:26.661537 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.661280    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj" event={"ID":"d2b3bbf0-2054-45ee-b135-fbc431f02a09","Type":"ContainerDied","Data":"3d88bfdd11213a1d96a97c0b34b37431672d16a79930911fa4984d01976b8cc8"}
Nov 02 08:37:26.661537 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.661303    6210 scope.go:122] "RemoveContainer" containerID="e74be045d174cafb5bf5dc0ff509a957bf92ace6fafd76f0edd17e7a20065ca0"
Nov 02 08:37:26.672105 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.672087    6210 scope.go:122] "RemoveContainer" containerID="b6206ac5856d0e106fc0d78084eea535526c9caced63dfed014c53a46976edbd"
Nov 02 08:37:26.681431 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.681412    6210 scope.go:122] "RemoveContainer" containerID="e74be045d174cafb5bf5dc0ff509a957bf92ace6fafd76f0edd17e7a20065ca0"
Nov 02 08:37:26.681698 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:37:26.681679    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e74be045d174cafb5bf5dc0ff509a957bf92ace6fafd76f0edd17e7a20065ca0\": container with ID starting with e74be045d174cafb5bf5dc0ff509a957bf92ace6fafd76f0edd17e7a20065ca0 not found: ID does not exist" containerID="e74be045d174cafb5bf5dc0ff509a957bf92ace6fafd76f0edd17e7a20065ca0"
Nov 02 08:37:26.681765 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.681705    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e74be045d174cafb5bf5dc0ff509a957bf92ace6fafd76f0edd17e7a20065ca0"} err="failed to get container status \"e74be045d174cafb5bf5dc0ff509a957bf92ace6fafd76f0edd17e7a20065ca0\": rpc error: code = NotFound desc = could not find container \"e74be045d174cafb5bf5dc0ff509a957bf92ace6fafd76f0edd17e7a20065ca0\": container with ID starting with e74be045d174cafb5bf5dc0ff509a957bf92ace6fafd76f0edd17e7a20065ca0 not found: ID does not exist"
Nov 02 08:37:26.681765 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.681722    6210 scope.go:122] "RemoveContainer" containerID="b6206ac5856d0e106fc0d78084eea535526c9caced63dfed014c53a46976edbd"
Nov 02 08:37:26.681983 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:37:26.681962    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6206ac5856d0e106fc0d78084eea535526c9caced63dfed014c53a46976edbd\": container with ID starting with b6206ac5856d0e106fc0d78084eea535526c9caced63dfed014c53a46976edbd not found: ID does not exist" containerID="b6206ac5856d0e106fc0d78084eea535526c9caced63dfed014c53a46976edbd"
Nov 02 08:37:26.682045 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.681989    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6206ac5856d0e106fc0d78084eea535526c9caced63dfed014c53a46976edbd"} err="failed to get container status \"b6206ac5856d0e106fc0d78084eea535526c9caced63dfed014c53a46976edbd\": rpc error: code = NotFound desc = could not find container \"b6206ac5856d0e106fc0d78084eea535526c9caced63dfed014c53a46976edbd\": container with ID starting with b6206ac5856d0e106fc0d78084eea535526c9caced63dfed014c53a46976edbd not found: ID does not exist"
Nov 02 08:37:26.828004 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.827952    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"]
Nov 02 08:37:26.867555 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:26.867526    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj"]
Nov 02 08:37:28.353529 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:28.353496    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d2b3bbf0-2054-45ee-b135-fbc431f02a09" path="/var/lib/kubelet/pods/d2b3bbf0-2054-45ee-b135-fbc431f02a09/volumes"
Nov 02 08:37:30.849107 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:37:30.849066    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:37:32.370534 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:32.370487    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk"]
Nov 02 08:37:32.371423 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:32.371354    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk" podUID="7d787563-f928-4b74-9534-0d5bde83ad2f" containerName="maas-api" containerID="cri-o://884da2005c51cf7844113c0c03768f08c1027d7f7fea60220eb2c687791786eb" gracePeriod=30
Nov 02 08:37:32.894914 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:32.893443    6210 generic.go:356] "Generic (PLEG): container finished" podID="7d787563-f928-4b74-9534-0d5bde83ad2f" containerID="884da2005c51cf7844113c0c03768f08c1027d7f7fea60220eb2c687791786eb" exitCode=0
Nov 02 08:37:32.898913 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:32.895201    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk" event={"ID":"7d787563-f928-4b74-9534-0d5bde83ad2f","Type":"ContainerDied","Data":"884da2005c51cf7844113c0c03768f08c1027d7f7fea60220eb2c687791786eb"}
Nov 02 08:37:32.899145 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:32.899126    6210 scope.go:122] "RemoveContainer" containerID="1109d8b0a985aa5ce271380fd6f44df4c9714d6d1bc766278cb3f5f50ceb22ea"
Nov 02 08:37:32.996528 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:32.996499    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk"
Nov 02 08:37:32.997847 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:32.997820    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp"]
Nov 02 08:37:32.998094 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:32.998067    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp" podUID="b2aa7c8c-14cc-4768-8035-c5644474d228" containerName="payload-processing" containerID="cri-o://609319b5eba7fcf60c40841069bbe39c50dd7b707757b2ac54fe34debe8fa93e" gracePeriod=30
Nov 02 08:37:33.094930 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.094857    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7d787563-f928-4b74-9534-0d5bde83ad2f-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d787563-f928-4b74-9534-0d5bde83ad2f-maas-api-tls\") pod \"7d787563-f928-4b74-9534-0d5bde83ad2f\" (UID: \"7d787563-f928-4b74-9534-0d5bde83ad2f\") "
Nov 02 08:37:33.095153 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.095133    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7d787563-f928-4b74-9534-0d5bde83ad2f-metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d787563-f928-4b74-9534-0d5bde83ad2f-metrics-certs\") pod \"7d787563-f928-4b74-9534-0d5bde83ad2f\" (UID: \"7d787563-f928-4b74-9534-0d5bde83ad2f\") "
Nov 02 08:37:33.095246 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.095192    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7d787563-f928-4b74-9534-0d5bde83ad2f-kube-api-access-tgf6p\" (UniqueName: \"kubernetes.io/projected/7d787563-f928-4b74-9534-0d5bde83ad2f-kube-api-access-tgf6p\") pod \"7d787563-f928-4b74-9534-0d5bde83ad2f\" (UID: \"7d787563-f928-4b74-9534-0d5bde83ad2f\") "
Nov 02 08:37:33.095313 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.095257    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7d787563-f928-4b74-9534-0d5bde83ad2f-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d787563-f928-4b74-9534-0d5bde83ad2f-openshift-service-ca\") pod \"7d787563-f928-4b74-9534-0d5bde83ad2f\" (UID: \"7d787563-f928-4b74-9534-0d5bde83ad2f\") "
Nov 02 08:37:33.107238 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.096143    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d787563-f928-4b74-9534-0d5bde83ad2f-openshift-service-ca" pod "7d787563-f928-4b74-9534-0d5bde83ad2f" (UID: "7d787563-f928-4b74-9534-0d5bde83ad2f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:37:33.107238 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.096365    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n"]
Nov 02 08:37:33.107238 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.096581    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n" podUID="c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35" containerName="payload-pre-processing" containerID="cri-o://90b817279b1ea85ea4fa60f9377bcf86249cc32787d977218399e9342a28e27e" gracePeriod=30
Nov 02 08:37:33.107238 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.099701    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d787563-f928-4b74-9534-0d5bde83ad2f-kube-api-access-tgf6p" pod "7d787563-f928-4b74-9534-0d5bde83ad2f" (UID: "7d787563-f928-4b74-9534-0d5bde83ad2f"). InnerVolumeSpecName "kube-api-access-tgf6p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:37:33.107238 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.105313    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d787563-f928-4b74-9534-0d5bde83ad2f-metrics-certs" pod "7d787563-f928-4b74-9534-0d5bde83ad2f" (UID: "7d787563-f928-4b74-9534-0d5bde83ad2f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:37:33.114972 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.114543    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d787563-f928-4b74-9534-0d5bde83ad2f-maas-api-tls" pod "7d787563-f928-4b74-9534-0d5bde83ad2f" (UID: "7d787563-f928-4b74-9534-0d5bde83ad2f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:37:33.197350 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.197168    6210 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d787563-f928-4b74-9534-0d5bde83ad2f-maas-api-tls\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:37:33.197350 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.197199    6210 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d787563-f928-4b74-9534-0d5bde83ad2f-metrics-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:37:33.197350 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.197243    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgf6p\" (UniqueName: \"kubernetes.io/projected/7d787563-f928-4b74-9534-0d5bde83ad2f-kube-api-access-tgf6p\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:37:33.197350 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.197261    6210 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d787563-f928-4b74-9534-0d5bde83ad2f-openshift-service-ca\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:37:33.284345 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.284312    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp"
Nov 02 08:37:33.371523 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.371500    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n"
Nov 02 08:37:33.400225 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.400205    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b2aa7c8c-14cc-4768-8035-c5644474d228-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2aa7c8c-14cc-4768-8035-c5644474d228-plugins-config-volume\") pod \"b2aa7c8c-14cc-4768-8035-c5644474d228\" (UID: \"b2aa7c8c-14cc-4768-8035-c5644474d228\") "
Nov 02 08:37:33.400394 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.400367    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35-kube-api-access-zq7mq\" (UniqueName: \"kubernetes.io/projected/c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35-kube-api-access-zq7mq\") pod \"c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35\" (UID: \"c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35\") "
Nov 02 08:37:33.400527 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.400433    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b2aa7c8c-14cc-4768-8035-c5644474d228-kube-api-access-7lx9r\" (UniqueName: \"kubernetes.io/projected/b2aa7c8c-14cc-4768-8035-c5644474d228-kube-api-access-7lx9r\") pod \"b2aa7c8c-14cc-4768-8035-c5644474d228\" (UID: \"b2aa7c8c-14cc-4768-8035-c5644474d228\") "
Nov 02 08:37:33.400527 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.400494    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35-plugins-config-volume\") pod \"c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35\" (UID: \"c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35\") "
Nov 02 08:37:33.400648 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.400581    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2aa7c8c-14cc-4768-8035-c5644474d228-plugins-config-volume" pod "b2aa7c8c-14cc-4768-8035-c5644474d228" (UID: "b2aa7c8c-14cc-4768-8035-c5644474d228"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:37:33.401112 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.401073    6210 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2aa7c8c-14cc-4768-8035-c5644474d228-plugins-config-volume\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:37:33.401112 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.401095    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35-plugins-config-volume" pod "c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35" (UID: "c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:37:33.403270 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.403249    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35-kube-api-access-zq7mq" pod "c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35" (UID: "c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35"). InnerVolumeSpecName "kube-api-access-zq7mq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:37:33.403349 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.403269    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2aa7c8c-14cc-4768-8035-c5644474d228-kube-api-access-7lx9r" pod "b2aa7c8c-14cc-4768-8035-c5644474d228" (UID: "b2aa7c8c-14cc-4768-8035-c5644474d228"). InnerVolumeSpecName "kube-api-access-7lx9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:37:33.527905 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.526360    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zq7mq\" (UniqueName: \"kubernetes.io/projected/c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35-kube-api-access-zq7mq\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:37:33.527905 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.526398    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7lx9r\" (UniqueName: \"kubernetes.io/projected/b2aa7c8c-14cc-4768-8035-c5644474d228-kube-api-access-7lx9r\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:37:33.527905 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.526414    6210 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35-plugins-config-volume\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:37:33.903920 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.903806    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk"
Nov 02 08:37:33.904239 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.903831    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk" event={"ID":"7d787563-f928-4b74-9534-0d5bde83ad2f","Type":"ContainerDied","Data":"30551be9baf86a7b51ae427b69bce45b02123eadf5d599fe0370c222bf911699"}
Nov 02 08:37:33.904347 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.904284    6210 scope.go:122] "RemoveContainer" containerID="884da2005c51cf7844113c0c03768f08c1027d7f7fea60220eb2c687791786eb"
Nov 02 08:37:33.904856 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.904830    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"]
Nov 02 08:37:33.905723 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.905692    6210 cpu_manager.go:414] "containerMap: removing container" podUID="2e080b58-6116-41f4-a940-0b18c2d15049" containerName="maas-api"
Nov 02 08:37:33.905723 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.905716    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2e080b58-6116-41f4-a940-0b18c2d15049" containerName="maas-api"
Nov 02 08:37:33.905889 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.905753    6210 cpu_manager.go:414] "containerMap: removing container" podUID="b2aa7c8c-14cc-4768-8035-c5644474d228" containerName="payload-processing"
Nov 02 08:37:33.905889 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.905763    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b2aa7c8c-14cc-4768-8035-c5644474d228" containerName="payload-processing"
Nov 02 08:37:33.905889 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.905775    6210 cpu_manager.go:414] "containerMap: removing container" podUID="7d787563-f928-4b74-9534-0d5bde83ad2f" containerName="maas-api"
Nov 02 08:37:33.905889 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.905784    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7d787563-f928-4b74-9534-0d5bde83ad2f" containerName="maas-api"
Nov 02 08:37:33.905889 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.905821    6210 cpu_manager.go:414] "containerMap: removing container" podUID="c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35" containerName="payload-pre-processing"
Nov 02 08:37:33.905889 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.905829    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35" containerName="payload-pre-processing"
Nov 02 08:37:33.905889 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.905847    6210 cpu_manager.go:414] "containerMap: removing container" podUID="7c7034e7-ee65-4f14-8731-21d93d7fa08c" containerName="payload-processing"
Nov 02 08:37:33.905889 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.905856    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7c7034e7-ee65-4f14-8731-21d93d7fa08c" containerName="payload-processing"
Nov 02 08:37:33.905889 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.905868    6210 cpu_manager.go:414] "containerMap: removing container" podUID="d2b3bbf0-2054-45ee-b135-fbc431f02a09" containerName="istio-proxy"
Nov 02 08:37:33.905889 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.905892    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d2b3bbf0-2054-45ee-b135-fbc431f02a09" containerName="istio-proxy"
Nov 02 08:37:33.906980 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.905904    6210 cpu_manager.go:414] "containerMap: removing container" podUID="5356cab6-ae06-4027-a75f-9b3f74cb7318" containerName="payload-processing"
Nov 02 08:37:33.906980 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.905912    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5356cab6-ae06-4027-a75f-9b3f74cb7318" containerName="payload-processing"
Nov 02 08:37:33.906980 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.905929    6210 cpu_manager.go:414] "containerMap: removing container" podUID="d2b3bbf0-2054-45ee-b135-fbc431f02a09" containerName="istio-proxy"
Nov 02 08:37:33.906980 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.905937    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d2b3bbf0-2054-45ee-b135-fbc431f02a09" containerName="istio-proxy"
Nov 02 08:37:33.906980 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.906105    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="d2b3bbf0-2054-45ee-b135-fbc431f02a09" containerName="istio-proxy"
Nov 02 08:37:33.906980 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.906121    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="2e080b58-6116-41f4-a940-0b18c2d15049" containerName="maas-api"
Nov 02 08:37:33.906980 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.906136    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="b2aa7c8c-14cc-4768-8035-c5644474d228" containerName="payload-processing"
Nov 02 08:37:33.906980 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.906147    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="7d787563-f928-4b74-9534-0d5bde83ad2f" containerName="maas-api"
Nov 02 08:37:33.906980 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.906184    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35" containerName="payload-pre-processing"
Nov 02 08:37:33.906980 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.906197    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="7c7034e7-ee65-4f14-8731-21d93d7fa08c" containerName="payload-processing"
Nov 02 08:37:33.906980 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.906208    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="d2b3bbf0-2054-45ee-b135-fbc431f02a09" containerName="istio-proxy"
Nov 02 08:37:33.906980 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.906218    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="5356cab6-ae06-4027-a75f-9b3f74cb7318" containerName="payload-processing"
Nov 02 08:37:33.906980 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.906268    6210 generic.go:356] "Generic (PLEG): container finished" podID="c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35" containerID="90b817279b1ea85ea4fa60f9377bcf86249cc32787d977218399e9342a28e27e" exitCode=0
Nov 02 08:37:33.906980 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.906441    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n"
Nov 02 08:37:33.910581 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.910554    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n" event={"ID":"c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35","Type":"ContainerDied","Data":"90b817279b1ea85ea4fa60f9377bcf86249cc32787d977218399e9342a28e27e"}
Nov 02 08:37:33.910693 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.910596    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n" event={"ID":"c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35","Type":"ContainerDied","Data":"a622c39bdca4e4f1c7e18f74b28ad40f33e9b0b5d0d4dac9293e133ada0afcc1"}
Nov 02 08:37:33.910693 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.910684    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:37:33.912157 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.912135    6210 generic.go:356] "Generic (PLEG): container finished" podID="b2aa7c8c-14cc-4768-8035-c5644474d228" containerID="609319b5eba7fcf60c40841069bbe39c50dd7b707757b2ac54fe34debe8fa93e" exitCode=0
Nov 02 08:37:33.912337 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.912175    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp"
Nov 02 08:37:33.912463 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.912189    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp" event={"ID":"b2aa7c8c-14cc-4768-8035-c5644474d228","Type":"ContainerDied","Data":"609319b5eba7fcf60c40841069bbe39c50dd7b707757b2ac54fe34debe8fa93e"}
Nov 02 08:37:33.912531 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.912468    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp" event={"ID":"b2aa7c8c-14cc-4768-8035-c5644474d228","Type":"ContainerDied","Data":"e46394ec7c1115a23fd1e41356276ee1e15bcfa512ede3ee71972714eb9a2179"}
Nov 02 08:37:33.919658 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.919642    6210 scope.go:122] "RemoveContainer" containerID="90b817279b1ea85ea4fa60f9377bcf86249cc32787d977218399e9342a28e27e"
Nov 02 08:37:33.941210 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.941057    6210 scope.go:122] "RemoveContainer" containerID="90b817279b1ea85ea4fa60f9377bcf86249cc32787d977218399e9342a28e27e"
Nov 02 08:37:33.941456 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:37:33.941420    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90b817279b1ea85ea4fa60f9377bcf86249cc32787d977218399e9342a28e27e\": container with ID starting with 90b817279b1ea85ea4fa60f9377bcf86249cc32787d977218399e9342a28e27e not found: ID does not exist" containerID="90b817279b1ea85ea4fa60f9377bcf86249cc32787d977218399e9342a28e27e"
Nov 02 08:37:33.941535 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.941466    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90b817279b1ea85ea4fa60f9377bcf86249cc32787d977218399e9342a28e27e"} err="failed to get container status \"90b817279b1ea85ea4fa60f9377bcf86249cc32787d977218399e9342a28e27e\": rpc error: code = NotFound desc = could not find container \"90b817279b1ea85ea4fa60f9377bcf86249cc32787d977218399e9342a28e27e\": container with ID starting with 90b817279b1ea85ea4fa60f9377bcf86249cc32787d977218399e9342a28e27e not found: ID does not exist"
Nov 02 08:37:33.941535 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.941490    6210 scope.go:122] "RemoveContainer" containerID="609319b5eba7fcf60c40841069bbe39c50dd7b707757b2ac54fe34debe8fa93e"
Nov 02 08:37:33.958024 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.957074    6210 scope.go:122] "RemoveContainer" containerID="609319b5eba7fcf60c40841069bbe39c50dd7b707757b2ac54fe34debe8fa93e"
Nov 02 08:37:33.958024 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:37:33.957518    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"609319b5eba7fcf60c40841069bbe39c50dd7b707757b2ac54fe34debe8fa93e\": container with ID starting with 609319b5eba7fcf60c40841069bbe39c50dd7b707757b2ac54fe34debe8fa93e not found: ID does not exist" containerID="609319b5eba7fcf60c40841069bbe39c50dd7b707757b2ac54fe34debe8fa93e"
Nov 02 08:37:33.958024 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.957588    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"609319b5eba7fcf60c40841069bbe39c50dd7b707757b2ac54fe34debe8fa93e"} err="failed to get container status \"609319b5eba7fcf60c40841069bbe39c50dd7b707757b2ac54fe34debe8fa93e\": rpc error: code = NotFound desc = could not find container \"609319b5eba7fcf60c40841069bbe39c50dd7b707757b2ac54fe34debe8fa93e\": container with ID starting with 609319b5eba7fcf60c40841069bbe39c50dd7b707757b2ac54fe34debe8fa93e not found: ID does not exist"
Nov 02 08:37:33.968697 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.968626    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"]
Nov 02 08:37:33.970842 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:33.970803    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-d51175-openshift-default-dockercfg-jn4bs\""
Nov 02 08:37:34.037400 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:34.037359    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be2cc6e9-e7dc-431f-85b1-1552a355d75c-workload-certs\") pod \"e2e-ipp-a-d51175-openshift-default-647d58c97-r497w\" (UID: \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\") " pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:37:34.037600 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:34.037575    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be2cc6e9-e7dc-431f-85b1-1552a355d75c-istio-token\") pod \"e2e-ipp-a-d51175-openshift-default-647d58c97-r497w\" (UID: \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\") " pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:37:34.037704 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:34.037663    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be2cc6e9-e7dc-431f-85b1-1552a355d75c-istiod-ca-cert\") pod \"e2e-ipp-a-d51175-openshift-default-647d58c97-r497w\" (UID: \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\") " pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:37:34.037830 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:34.037734    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be2cc6e9-e7dc-431f-85b1-1552a355d75c-istio-podinfo\") pod \"e2e-ipp-a-d51175-openshift-default-647d58c97-r497w\" (UID: \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\") " pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:37:34.037924 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:34.037859    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be2cc6e9-e7dc-431f-85b1-1552a355d75c-istio-envoy\") pod \"e2e-ipp-a-d51175-openshift-default-647d58c97-r497w\" (UID: \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\") " pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:37:34.038002 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:34.037921    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be2cc6e9-e7dc-431f-85b1-1552a355d75c-istio-data\") pod \"e2e-ipp-a-d51175-openshift-default-647d58c97-r497w\" (UID: \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\") " pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:37:34.038071 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:34.038049    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be2cc6e9-e7dc-431f-85b1-1552a355d75c-workload-socket\") pod \"e2e-ipp-a-d51175-openshift-default-647d58c97-r497w\" (UID: \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\") " pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:37:34.038117 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:34.038105    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be2cc6e9-e7dc-431f-85b1-1552a355d75c-credential-socket\") pod \"e2e-ipp-a-d51175-openshift-default-647d58c97-r497w\" (UID: \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\") " pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:37:34.038157 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:34.038134    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vn9h\" (UniqueName: \"kubernetes.io/projected/be2cc6e9-e7dc-431f-85b1-1552a355d75c-kube-api-access-8vn9h\") pod \"e2e-ipp-a-d51175-openshift-default-647d58c97-r497w\" (UID: \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\") " pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:37:34.061679 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:34.061652    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk"]
Nov 02 08:37:34.068399 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:34.068365    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ee94-7c4b4dd6df-569nk"]
Nov 02 08:37:34.139430 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:34.139397    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be2cc6e9-e7dc-431f-85b1-1552a355d75c-istio-envoy\") pod \"e2e-ipp-a-d51175-openshift-default-647d58c97-r497w\" (UID: \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\") " pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:37:34.139615 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:34.139438    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be2cc6e9-e7dc-431f-85b1-1552a355d75c-istio-data\") pod \"e2e-ipp-a-d51175-openshift-default-647d58c97-r497w\" (UID: \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\") " pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:37:34.139615 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:34.139553    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be2cc6e9-e7dc-431f-85b1-1552a355d75c-workload-socket\") pod \"e2e-ipp-a-d51175-openshift-default-647d58c97-r497w\" (UID: \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\") " pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:37:34.139615 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:34.139600    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be2cc6e9-e7dc-431f-85b1-1552a355d75c-credential-socket\") pod \"e2e-ipp-a-d51175-openshift-default-647d58c97-r497w\" (UID: \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\") " pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:37:34.139800 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:34.139626    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vn9h\" (UniqueName: \"kubernetes.io/projected/be2cc6e9-e7dc-431f-85b1-1552a355d75c-kube-api-access-8vn9h\") pod \"e2e-ipp-a-d51175-openshift-default-647d58c97-r497w\" (UID: \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\") " pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:37:34.139800 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:34.139714    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be2cc6e9-e7dc-431f-85b1-1552a355d75c-workload-certs\") pod \"e2e-ipp-a-d51175-openshift-default-647d58c97-r497w\" (UID: \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\") " pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:37:34.139800 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:34.139780    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be2cc6e9-e7dc-431f-85b1-1552a355d75c-istio-token\") pod \"e2e-ipp-a-d51175-openshift-default-647d58c97-r497w\" (UID: \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\") " pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:37:34.140294 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:34.140023    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be2cc6e9-e7dc-431f-85b1-1552a355d75c-istio-data\") pod \"e2e-ipp-a-d51175-openshift-default-647d58c97-r497w\" (UID: \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\") " pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:37:34.140294 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:34.140039    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be2cc6e9-e7dc-431f-85b1-1552a355d75c-istiod-ca-cert\") pod \"e2e-ipp-a-d51175-openshift-default-647d58c97-r497w\" (UID: \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\") " pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:37:34.140294 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:34.140128    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be2cc6e9-e7dc-431f-85b1-1552a355d75c-istio-podinfo\") pod \"e2e-ipp-a-d51175-openshift-default-647d58c97-r497w\" (UID: \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\") " pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:37:34.140294 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:34.140237    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be2cc6e9-e7dc-431f-85b1-1552a355d75c-credential-socket\") pod \"e2e-ipp-a-d51175-openshift-default-647d58c97-r497w\" (UID: \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\") " pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:37:34.140294 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:34.140254    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be2cc6e9-e7dc-431f-85b1-1552a355d75c-workload-certs\") pod \"e2e-ipp-a-d51175-openshift-default-647d58c97-r497w\" (UID: \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\") " pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:37:34.140613 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:34.140406    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be2cc6e9-e7dc-431f-85b1-1552a355d75c-workload-socket\") pod \"e2e-ipp-a-d51175-openshift-default-647d58c97-r497w\" (UID: \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\") " pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:37:34.140770 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:34.140747    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be2cc6e9-e7dc-431f-85b1-1552a355d75c-istiod-ca-cert\") pod \"e2e-ipp-a-d51175-openshift-default-647d58c97-r497w\" (UID: \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\") " pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:37:34.142420 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:34.142391    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be2cc6e9-e7dc-431f-85b1-1552a355d75c-istio-envoy\") pod \"e2e-ipp-a-d51175-openshift-default-647d58c97-r497w\" (UID: \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\") " pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:37:34.142574 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:34.142552    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be2cc6e9-e7dc-431f-85b1-1552a355d75c-istio-podinfo\") pod \"e2e-ipp-a-d51175-openshift-default-647d58c97-r497w\" (UID: \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\") " pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:37:34.455903 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:34.337833    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vn9h\" (UniqueName: \"kubernetes.io/projected/be2cc6e9-e7dc-431f-85b1-1552a355d75c-kube-api-access-8vn9h\") pod \"e2e-ipp-a-d51175-openshift-default-647d58c97-r497w\" (UID: \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\") " pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:37:34.455903 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:34.434939    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7d787563-f928-4b74-9534-0d5bde83ad2f" path="/var/lib/kubelet/pods/7d787563-f928-4b74-9534-0d5bde83ad2f/volumes"
Nov 02 08:37:34.455903 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:34.435380    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n"]
Nov 02 08:37:34.455903 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:34.435419    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n"]
Nov 02 08:37:34.468937 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:34.459103    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be2cc6e9-e7dc-431f-85b1-1552a355d75c-istio-token\") pod \"e2e-ipp-a-d51175-openshift-default-647d58c97-r497w\" (UID: \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\") " pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:37:34.560135 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:34.559335    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:37:34.598021 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:34.595739    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp"]
Nov 02 08:37:34.600825 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:34.600783    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp"]
Nov 02 08:37:35.057038 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:35.057015    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"]
Nov 02 08:37:35.060324 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:37:35.060291    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe2cc6e9_e7dc_431f_85b1_1552a355d75c.slice/crio-2943eb9db254db8a808ae2533361718ecbcc925bb185a0ada9143d801db4827f WatchSource:0}: Error finding container 2943eb9db254db8a808ae2533361718ecbcc925bb185a0ada9143d801db4827f: Status 404 returned error can't find the container with id 2943eb9db254db8a808ae2533361718ecbcc925bb185a0ada9143d801db4827f
Nov 02 08:37:35.063939 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:35.063871    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:37:35.064023 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:35.063996    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:37:35.064067 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:35.064041    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:37:35.965974 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:35.965932    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w" event={"ID":"be2cc6e9-e7dc-431f-85b1-1552a355d75c","Type":"ContainerStarted","Data":"46b8f1d6d41c8838630bc490b583c4f7e8fe94aaf3ed613bca000c6f5d75bc88"}
Nov 02 08:37:35.966395 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:35.966006    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w" event={"ID":"be2cc6e9-e7dc-431f-85b1-1552a355d75c","Type":"ContainerStarted","Data":"2943eb9db254db8a808ae2533361718ecbcc925bb185a0ada9143d801db4827f"}
Nov 02 08:37:36.353321 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:36.353246    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b2aa7c8c-14cc-4768-8035-c5644474d228" path="/var/lib/kubelet/pods/b2aa7c8c-14cc-4768-8035-c5644474d228/volumes"
Nov 02 08:37:36.353656 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:36.353642    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35" path="/var/lib/kubelet/pods/c52623a3-d307-4cc2-bf8c-a5e7cbd2cc35/volumes"
Nov 02 08:37:36.560356 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:36.560320    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:37:36.566711 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:36.566686    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:37:36.679303 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:36.679169    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w" podStartSLOduration=3.679155402 podStartE2EDuration="3.679155402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:37:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:37:36.173601354 +0000 UTC m=+1845.932030086" watchObservedRunningTime="2026-11-02 08:37:36.679155402 +0000 UTC m=+1846.437584134"
Nov 02 08:37:36.973513 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:36.973485    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:37:36.974495 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:36.974477    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:37:40.661038 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:40.661001    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9"]
Nov 02 08:37:40.661640 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:40.661625    6210 cpu_manager.go:414] "containerMap: removing container" podUID="7d787563-f928-4b74-9534-0d5bde83ad2f" containerName="maas-api"
Nov 02 08:37:40.661718 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:40.661640    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7d787563-f928-4b74-9534-0d5bde83ad2f" containerName="maas-api"
Nov 02 08:37:40.661763 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:40.661738    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="7d787563-f928-4b74-9534-0d5bde83ad2f" containerName="maas-api"
Nov 02 08:37:40.666457 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:40.666434    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9"
Nov 02 08:37:40.740962 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:40.740921    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2150ad95-e6b8-4529-b40c-83119a744da3-maas-api-tls\") pod \"maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9\" (UID: \"2150ad95-e6b8-4529-b40c-83119a744da3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9"
Nov 02 08:37:40.740962 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:40.740971    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mptmk\" (UniqueName: \"kubernetes.io/projected/2150ad95-e6b8-4529-b40c-83119a744da3-kube-api-access-mptmk\") pod \"maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9\" (UID: \"2150ad95-e6b8-4529-b40c-83119a744da3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9"
Nov 02 08:37:40.741218 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:40.741160    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2150ad95-e6b8-4529-b40c-83119a744da3-metrics-certs\") pod \"maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9\" (UID: \"2150ad95-e6b8-4529-b40c-83119a744da3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9"
Nov 02 08:37:40.741304 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:40.741286    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2150ad95-e6b8-4529-b40c-83119a744da3-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9\" (UID: \"2150ad95-e6b8-4529-b40c-83119a744da3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9"
Nov 02 08:37:40.759058 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:40.759032    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-45fc31-serving-cert\""
Nov 02 08:37:40.761855 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:40.761835    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9"]
Nov 02 08:37:40.842260 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:40.842229    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2150ad95-e6b8-4529-b40c-83119a744da3-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9\" (UID: \"2150ad95-e6b8-4529-b40c-83119a744da3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9"
Nov 02 08:37:40.842444 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:40.842388    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2150ad95-e6b8-4529-b40c-83119a744da3-maas-api-tls\") pod \"maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9\" (UID: \"2150ad95-e6b8-4529-b40c-83119a744da3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9"
Nov 02 08:37:40.842444 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:40.842409    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mptmk\" (UniqueName: \"kubernetes.io/projected/2150ad95-e6b8-4529-b40c-83119a744da3-kube-api-access-mptmk\") pod \"maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9\" (UID: \"2150ad95-e6b8-4529-b40c-83119a744da3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9"
Nov 02 08:37:40.842567 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:40.842491    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2150ad95-e6b8-4529-b40c-83119a744da3-metrics-certs\") pod \"maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9\" (UID: \"2150ad95-e6b8-4529-b40c-83119a744da3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9"
Nov 02 08:37:40.850608 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:37:40.842845    6210 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-45fc31-serving-cert: secret "maas-api-e2e-ipp-b-45fc31-serving-cert" not found
Nov 02 08:37:40.850608 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:37:40.842946    6210 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2150ad95-e6b8-4529-b40c-83119a744da3-maas-api-tls podName:2150ad95-e6b8-4529-b40c-83119a744da3 nodeName:}" failed. No retries permitted until 2026-11-02 08:37:41.34292659 +0000 UTC m=+1851.101355316 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2150ad95-e6b8-4529-b40c-83119a744da3-maas-api-tls") pod "maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9" (UID: "2150ad95-e6b8-4529-b40c-83119a744da3") : secret "maas-api-e2e-ipp-b-45fc31-serving-cert" not found
Nov 02 08:37:40.850608 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:40.843025    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2150ad95-e6b8-4529-b40c-83119a744da3-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9\" (UID: \"2150ad95-e6b8-4529-b40c-83119a744da3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9"
Nov 02 08:37:40.850608 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:40.850543    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2150ad95-e6b8-4529-b40c-83119a744da3-metrics-certs\") pod \"maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9\" (UID: \"2150ad95-e6b8-4529-b40c-83119a744da3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9"
Nov 02 08:37:40.896697 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:40.896658    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mptmk\" (UniqueName: \"kubernetes.io/projected/2150ad95-e6b8-4529-b40c-83119a744da3-kube-api-access-mptmk\") pod \"maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9\" (UID: \"2150ad95-e6b8-4529-b40c-83119a744da3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9"
Nov 02 08:37:41.349062 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:41.349026    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2150ad95-e6b8-4529-b40c-83119a744da3-maas-api-tls\") pod \"maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9\" (UID: \"2150ad95-e6b8-4529-b40c-83119a744da3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9"
Nov 02 08:37:41.351451 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:41.351419    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2150ad95-e6b8-4529-b40c-83119a744da3-maas-api-tls\") pod \"maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9\" (UID: \"2150ad95-e6b8-4529-b40c-83119a744da3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9"
Nov 02 08:37:41.587607 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:41.587568    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9"
Nov 02 08:37:42.040246 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:42.040218    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9"]
Nov 02 08:37:42.042256 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:37:42.042230    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2150ad95_e6b8_4529_b40c_83119a744da3.slice/crio-cef074985c454224999a335f69690effb24514e0bead4be2ece8663cfc1c1f17 WatchSource:0}: Error finding container cef074985c454224999a335f69690effb24514e0bead4be2ece8663cfc1c1f17: Status 404 returned error can't find the container with id cef074985c454224999a335f69690effb24514e0bead4be2ece8663cfc1c1f17
Nov 02 08:37:43.087427 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:43.087388    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9" event={"ID":"2150ad95-e6b8-4529-b40c-83119a744da3","Type":"ContainerStarted","Data":"cef074985c454224999a335f69690effb24514e0bead4be2ece8663cfc1c1f17"}
Nov 02 08:37:44.128902 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:44.123964    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9" event={"ID":"2150ad95-e6b8-4529-b40c-83119a744da3","Type":"ContainerStarted","Data":"677e4546b8aa066086d061e5dc47da6c944fa3bec41218f22df64a134a9c0f9e"}
Nov 02 08:37:44.128902 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:44.125193    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9"
Nov 02 08:37:44.237613 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:44.237557    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9" podStartSLOduration=3.292014009 podStartE2EDuration="4.237542352s" totalImagesPullingTime="945.528343ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:37:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:37:44.236011524 +0000 UTC m=+1853.994440257" watchObservedRunningTime="2026-11-02 08:37:44.237542352 +0000 UTC m=+1853.995971083"
Nov 02 08:37:51.141942 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:51.141848    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9"
Nov 02 08:37:55.870131 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:55.870094    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688"]
Nov 02 08:37:55.870604 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:55.870287    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688" podUID="451e6b46-7c5a-4e3f-a367-c5acb443ad04" containerName="maas-api" containerID="cri-o://228ebeac28a204756ffeabe93aa7de20170e63b6ddcad033490d1030a94e3a5a" gracePeriod=30
Nov 02 08:37:56.202047 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:56.201925    6210 generic.go:356] "Generic (PLEG): container finished" podID="451e6b46-7c5a-4e3f-a367-c5acb443ad04" containerID="228ebeac28a204756ffeabe93aa7de20170e63b6ddcad033490d1030a94e3a5a" exitCode=0
Nov 02 08:37:56.202047 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:56.201999    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688" event={"ID":"451e6b46-7c5a-4e3f-a367-c5acb443ad04","Type":"ContainerDied","Data":"228ebeac28a204756ffeabe93aa7de20170e63b6ddcad033490d1030a94e3a5a"}
Nov 02 08:37:56.202275 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:56.202064    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688" event={"ID":"451e6b46-7c5a-4e3f-a367-c5acb443ad04","Type":"ContainerDied","Data":"17acf3e6690689f985bdd8126d2773077742e9999e3bd978fbf1788b41399e75"}
Nov 02 08:37:56.202275 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:56.202091    6210 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="17acf3e6690689f985bdd8126d2773077742e9999e3bd978fbf1788b41399e75"
Nov 02 08:37:56.213069 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:56.213047    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688"
Nov 02 08:37:56.227240 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:56.227215    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/451e6b46-7c5a-4e3f-a367-c5acb443ad04-kube-api-access-8pp75\" (UniqueName: \"kubernetes.io/projected/451e6b46-7c5a-4e3f-a367-c5acb443ad04-kube-api-access-8pp75\") pod \"451e6b46-7c5a-4e3f-a367-c5acb443ad04\" (UID: \"451e6b46-7c5a-4e3f-a367-c5acb443ad04\") "
Nov 02 08:37:56.227372 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:56.227267    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/451e6b46-7c5a-4e3f-a367-c5acb443ad04-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/451e6b46-7c5a-4e3f-a367-c5acb443ad04-openshift-service-ca\") pod \"451e6b46-7c5a-4e3f-a367-c5acb443ad04\" (UID: \"451e6b46-7c5a-4e3f-a367-c5acb443ad04\") "
Nov 02 08:37:56.227372 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:56.227323    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/451e6b46-7c5a-4e3f-a367-c5acb443ad04-metrics-certs\" (UniqueName: \"kubernetes.io/secret/451e6b46-7c5a-4e3f-a367-c5acb443ad04-metrics-certs\") pod \"451e6b46-7c5a-4e3f-a367-c5acb443ad04\" (UID: \"451e6b46-7c5a-4e3f-a367-c5acb443ad04\") "
Nov 02 08:37:56.227372 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:56.227346    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/451e6b46-7c5a-4e3f-a367-c5acb443ad04-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/451e6b46-7c5a-4e3f-a367-c5acb443ad04-maas-api-tls\") pod \"451e6b46-7c5a-4e3f-a367-c5acb443ad04\" (UID: \"451e6b46-7c5a-4e3f-a367-c5acb443ad04\") "
Nov 02 08:37:56.227727 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:56.227679    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/451e6b46-7c5a-4e3f-a367-c5acb443ad04-openshift-service-ca" pod "451e6b46-7c5a-4e3f-a367-c5acb443ad04" (UID: "451e6b46-7c5a-4e3f-a367-c5acb443ad04"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:37:56.228191 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:56.228167    6210 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/451e6b46-7c5a-4e3f-a367-c5acb443ad04-openshift-service-ca\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:37:56.229668 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:56.229639    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/451e6b46-7c5a-4e3f-a367-c5acb443ad04-kube-api-access-8pp75" pod "451e6b46-7c5a-4e3f-a367-c5acb443ad04" (UID: "451e6b46-7c5a-4e3f-a367-c5acb443ad04"). InnerVolumeSpecName "kube-api-access-8pp75". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:37:56.229772 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:56.229693    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/451e6b46-7c5a-4e3f-a367-c5acb443ad04-metrics-certs" pod "451e6b46-7c5a-4e3f-a367-c5acb443ad04" (UID: "451e6b46-7c5a-4e3f-a367-c5acb443ad04"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:37:56.229839 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:56.229786    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/451e6b46-7c5a-4e3f-a367-c5acb443ad04-maas-api-tls" pod "451e6b46-7c5a-4e3f-a367-c5acb443ad04" (UID: "451e6b46-7c5a-4e3f-a367-c5acb443ad04"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:37:56.335370 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:56.335319    6210 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/451e6b46-7c5a-4e3f-a367-c5acb443ad04-metrics-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:37:56.335966 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:56.335943    6210 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/451e6b46-7c5a-4e3f-a367-c5acb443ad04-maas-api-tls\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:37:56.336127 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:56.336111    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pp75\" (UniqueName: \"kubernetes.io/projected/451e6b46-7c5a-4e3f-a367-c5acb443ad04-kube-api-access-8pp75\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:37:56.834752 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:56.834719    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7355-6b4e7e"]
Nov 02 08:37:56.835318 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:56.835302    6210 cpu_manager.go:414] "containerMap: removing container" podUID="451e6b46-7c5a-4e3f-a367-c5acb443ad04" containerName="maas-api"
Nov 02 08:37:56.835411 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:56.835319    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="451e6b46-7c5a-4e3f-a367-c5acb443ad04" containerName="maas-api"
Nov 02 08:37:56.835450 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:56.835438    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="451e6b46-7c5a-4e3f-a367-c5acb443ad04" containerName="maas-api"
Nov 02 08:37:56.838936 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:56.838918    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7355-6b4e7e"
Nov 02 08:37:56.849791 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:56.849759    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb669\" (UniqueName: \"kubernetes.io/projected/a2d66fee-ddaa-4b63-956e-5e6aa18e34b0-kube-api-access-fb669\") pod \"test-curl-7355-6b4e7e\" (UID: \"a2d66fee-ddaa-4b63-956e-5e6aa18e34b0\") " pod="opendatahub/test-curl-7355-6b4e7e"
Nov 02 08:37:56.887923 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:56.887713    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-nb5bk\""
Nov 02 08:37:56.888367 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:56.888223    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7355-6b4e7e"]
Nov 02 08:37:57.018899 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:57.016363    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb669\" (UniqueName: \"kubernetes.io/projected/a2d66fee-ddaa-4b63-956e-5e6aa18e34b0-kube-api-access-fb669\") pod \"test-curl-7355-6b4e7e\" (UID: \"a2d66fee-ddaa-4b63-956e-5e6aa18e34b0\") " pod="opendatahub/test-curl-7355-6b4e7e"
Nov 02 08:37:57.083355 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:57.082933    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb669\" (UniqueName: \"kubernetes.io/projected/a2d66fee-ddaa-4b63-956e-5e6aa18e34b0-kube-api-access-fb669\") pod \"test-curl-7355-6b4e7e\" (UID: \"a2d66fee-ddaa-4b63-956e-5e6aa18e34b0\") " pod="opendatahub/test-curl-7355-6b4e7e"
Nov 02 08:37:57.156985 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:57.156899    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7355-6b4e7e"
Nov 02 08:37:57.211660 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:57.211622    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688"
Nov 02 08:37:57.365853 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:57.365823    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688"]
Nov 02 08:37:57.371680 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:57.371651    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6a289-7c484f8579-5x688"]
Nov 02 08:37:57.523759 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:57.523736    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7355-6b4e7e"]
Nov 02 08:37:57.526104 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:37:57.526064    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda2d66fee_ddaa_4b63_956e_5e6aa18e34b0.slice/crio-4c23345c351ec27b28348c95586ad777f051b2448103f1e236a3f5c3d86c8e9b WatchSource:0}: Error finding container 4c23345c351ec27b28348c95586ad777f051b2448103f1e236a3f5c3d86c8e9b: Status 404 returned error can't find the container with id 4c23345c351ec27b28348c95586ad777f051b2448103f1e236a3f5c3d86c8e9b
Nov 02 08:37:58.219403 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:58.219371    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7355-6b4e7e" event={"ID":"a2d66fee-ddaa-4b63-956e-5e6aa18e34b0","Type":"ContainerStarted","Data":"fd8c09b66c813b9371365e77e623d0079e780b5b9c857946b6f131c349681842"}
Nov 02 08:37:58.219851 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:58.219413    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7355-6b4e7e" event={"ID":"a2d66fee-ddaa-4b63-956e-5e6aa18e34b0","Type":"ContainerStarted","Data":"4c23345c351ec27b28348c95586ad777f051b2448103f1e236a3f5c3d86c8e9b"}
Nov 02 08:37:58.326696 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:58.326642    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7355-6b4e7e" podStartSLOduration=2.326628155 podStartE2EDuration="2.326628155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:37:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:37:58.32383956 +0000 UTC m=+1868.082268293" watchObservedRunningTime="2026-11-02 08:37:58.326628155 +0000 UTC m=+1868.085056886"
Nov 02 08:37:58.353042 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:58.353013    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="451e6b46-7c5a-4e3f-a367-c5acb443ad04" path="/var/lib/kubelet/pods/451e6b46-7c5a-4e3f-a367-c5acb443ad04/volumes"
Nov 02 08:37:59.750481 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:59.750431    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7355-6b4e7e"]
Nov 02 08:37:59.753746 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:37:59.753712    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7355-6b4e7e"]
Nov 02 08:38:00.238085 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:00.238027    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7355-6b4e7e" podUID="a2d66fee-ddaa-4b63-956e-5e6aa18e34b0" containerName="test-curl-7355-6b4e7e" containerID="cri-o://fd8c09b66c813b9371365e77e623d0079e780b5b9c857946b6f131c349681842" gracePeriod=2
Nov 02 08:38:00.285788 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:38:00.285744    6210 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7355-6b4e7e\" is forbidden: User \"system:node:ip-10-0-135-235.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-235.us-west-2.compute.internal' and this object" podUID="a2d66fee-ddaa-4b63-956e-5e6aa18e34b0" pod="opendatahub/test-curl-7355-6b4e7e"
Nov 02 08:38:00.396604 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:38:00.396566    6210 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7355-6b4e7e\" is forbidden: User \"system:node:ip-10-0-135-235.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-235.us-west-2.compute.internal' and this object" podUID="a2d66fee-ddaa-4b63-956e-5e6aa18e34b0" pod="opendatahub/test-curl-7355-6b4e7e"
Nov 02 08:38:00.822989 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:38:00.822946    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:38:02.493222 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:02.493144    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7355-6b4e7e"
Nov 02 08:38:02.597281 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:02.597247    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a2d66fee-ddaa-4b63-956e-5e6aa18e34b0-kube-api-access-fb669\" (UniqueName: \"kubernetes.io/projected/a2d66fee-ddaa-4b63-956e-5e6aa18e34b0-kube-api-access-fb669\") pod \"a2d66fee-ddaa-4b63-956e-5e6aa18e34b0\" (UID: \"a2d66fee-ddaa-4b63-956e-5e6aa18e34b0\") "
Nov 02 08:38:02.599429 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:02.599398    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2d66fee-ddaa-4b63-956e-5e6aa18e34b0-kube-api-access-fb669" pod "a2d66fee-ddaa-4b63-956e-5e6aa18e34b0" (UID: "a2d66fee-ddaa-4b63-956e-5e6aa18e34b0"). InnerVolumeSpecName "kube-api-access-fb669". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:38:02.698688 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:02.698653    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fb669\" (UniqueName: \"kubernetes.io/projected/a2d66fee-ddaa-4b63-956e-5e6aa18e34b0-kube-api-access-fb669\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:38:03.258317 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:03.258284    6210 generic.go:356] "Generic (PLEG): container finished" podID="a2d66fee-ddaa-4b63-956e-5e6aa18e34b0" containerID="fd8c09b66c813b9371365e77e623d0079e780b5b9c857946b6f131c349681842" exitCode=137
Nov 02 08:38:03.258530 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:03.258325    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7355-6b4e7e"
Nov 02 08:38:03.258530 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:03.258382    6210 scope.go:122] "RemoveContainer" containerID="fd8c09b66c813b9371365e77e623d0079e780b5b9c857946b6f131c349681842"
Nov 02 08:38:03.269366 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:03.269345    6210 scope.go:122] "RemoveContainer" containerID="fd8c09b66c813b9371365e77e623d0079e780b5b9c857946b6f131c349681842"
Nov 02 08:38:03.269658 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:38:03.269638    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd8c09b66c813b9371365e77e623d0079e780b5b9c857946b6f131c349681842\": container with ID starting with fd8c09b66c813b9371365e77e623d0079e780b5b9c857946b6f131c349681842 not found: ID does not exist" containerID="fd8c09b66c813b9371365e77e623d0079e780b5b9c857946b6f131c349681842"
Nov 02 08:38:03.269730 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:03.269671    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd8c09b66c813b9371365e77e623d0079e780b5b9c857946b6f131c349681842"} err="failed to get container status \"fd8c09b66c813b9371365e77e623d0079e780b5b9c857946b6f131c349681842\": rpc error: code = NotFound desc = could not find container \"fd8c09b66c813b9371365e77e623d0079e780b5b9c857946b6f131c349681842\": container with ID starting with fd8c09b66c813b9371365e77e623d0079e780b5b9c857946b6f131c349681842 not found: ID does not exist"
Nov 02 08:38:03.315361 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:38:03.315320    6210 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7355-6b4e7e\" is forbidden: User \"system:node:ip-10-0-135-235.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-235.us-west-2.compute.internal' and this object" podUID="a2d66fee-ddaa-4b63-956e-5e6aa18e34b0" pod="opendatahub/test-curl-7355-6b4e7e"
Nov 02 08:38:04.352537 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:04.352503    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a2d66fee-ddaa-4b63-956e-5e6aa18e34b0" path="/var/lib/kubelet/pods/a2d66fee-ddaa-4b63-956e-5e6aa18e34b0/volumes"
Nov 02 08:38:08.423900 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:08.423075    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"]
Nov 02 08:38:08.423900 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:08.423903    6210 cpu_manager.go:414] "containerMap: removing container" podUID="a2d66fee-ddaa-4b63-956e-5e6aa18e34b0" containerName="test-curl-7355-6b4e7e"
Nov 02 08:38:08.424484 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:08.423920    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a2d66fee-ddaa-4b63-956e-5e6aa18e34b0" containerName="test-curl-7355-6b4e7e"
Nov 02 08:38:08.424484 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:08.424103    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="a2d66fee-ddaa-4b63-956e-5e6aa18e34b0" containerName="test-curl-7355-6b4e7e"
Nov 02 08:38:08.439945 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:08.439873    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:38:08.498825 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:08.498789    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-praxis-a-f4516e-openshift-default-dockercfg-6twft\""
Nov 02 08:38:08.548112 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:08.548075    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"]
Nov 02 08:38:08.602923 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:08.597747    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72cfa2c7-210c-4e18-961b-4676855ffd42-workload-certs\") pod \"e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2\" (UID: \"72cfa2c7-210c-4e18-961b-4676855ffd42\") " pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:38:08.602923 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:08.597798    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72cfa2c7-210c-4e18-961b-4676855ffd42-istio-token\") pod \"e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2\" (UID: \"72cfa2c7-210c-4e18-961b-4676855ffd42\") " pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:38:08.602923 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:08.597832    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72cfa2c7-210c-4e18-961b-4676855ffd42-workload-socket\") pod \"e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2\" (UID: \"72cfa2c7-210c-4e18-961b-4676855ffd42\") " pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:38:08.602923 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:08.597897    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72cfa2c7-210c-4e18-961b-4676855ffd42-credential-socket\") pod \"e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2\" (UID: \"72cfa2c7-210c-4e18-961b-4676855ffd42\") " pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:38:08.609226 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:08.609191    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72cfa2c7-210c-4e18-961b-4676855ffd42-istio-envoy\") pod \"e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2\" (UID: \"72cfa2c7-210c-4e18-961b-4676855ffd42\") " pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:38:08.609384 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:08.609281    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72cfa2c7-210c-4e18-961b-4676855ffd42-istiod-ca-cert\") pod \"e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2\" (UID: \"72cfa2c7-210c-4e18-961b-4676855ffd42\") " pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:38:08.609449 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:08.609393    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72cfa2c7-210c-4e18-961b-4676855ffd42-istio-data\") pod \"e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2\" (UID: \"72cfa2c7-210c-4e18-961b-4676855ffd42\") " pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:38:08.609515 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:08.609483    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72cfa2c7-210c-4e18-961b-4676855ffd42-istio-podinfo\") pod \"e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2\" (UID: \"72cfa2c7-210c-4e18-961b-4676855ffd42\") " pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:38:08.609591 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:08.609572    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49pmn\" (UniqueName: \"kubernetes.io/projected/72cfa2c7-210c-4e18-961b-4676855ffd42-kube-api-access-49pmn\") pod \"e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2\" (UID: \"72cfa2c7-210c-4e18-961b-4676855ffd42\") " pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:38:08.712766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:08.712703    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72cfa2c7-210c-4e18-961b-4676855ffd42-istiod-ca-cert\") pod \"e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2\" (UID: \"72cfa2c7-210c-4e18-961b-4676855ffd42\") " pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:38:08.713777 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:08.713745    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72cfa2c7-210c-4e18-961b-4676855ffd42-istio-data\") pod \"e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2\" (UID: \"72cfa2c7-210c-4e18-961b-4676855ffd42\") " pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:38:08.713905 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:08.713782    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72cfa2c7-210c-4e18-961b-4676855ffd42-istiod-ca-cert\") pod \"e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2\" (UID: \"72cfa2c7-210c-4e18-961b-4676855ffd42\") " pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:38:08.713905 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:08.713855    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72cfa2c7-210c-4e18-961b-4676855ffd42-istio-podinfo\") pod \"e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2\" (UID: \"72cfa2c7-210c-4e18-961b-4676855ffd42\") " pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:38:08.714013 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:08.713955    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49pmn\" (UniqueName: \"kubernetes.io/projected/72cfa2c7-210c-4e18-961b-4676855ffd42-kube-api-access-49pmn\") pod \"e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2\" (UID: \"72cfa2c7-210c-4e18-961b-4676855ffd42\") " pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:38:08.714083 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:08.714064    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72cfa2c7-210c-4e18-961b-4676855ffd42-workload-certs\") pod \"e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2\" (UID: \"72cfa2c7-210c-4e18-961b-4676855ffd42\") " pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:38:08.714131 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:08.714097    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72cfa2c7-210c-4e18-961b-4676855ffd42-istio-token\") pod \"e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2\" (UID: \"72cfa2c7-210c-4e18-961b-4676855ffd42\") " pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:38:08.714131 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:08.714104    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72cfa2c7-210c-4e18-961b-4676855ffd42-istio-data\") pod \"e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2\" (UID: \"72cfa2c7-210c-4e18-961b-4676855ffd42\") " pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:38:08.714220 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:08.714142    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72cfa2c7-210c-4e18-961b-4676855ffd42-workload-socket\") pod \"e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2\" (UID: \"72cfa2c7-210c-4e18-961b-4676855ffd42\") " pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:38:08.714220 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:08.714191    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72cfa2c7-210c-4e18-961b-4676855ffd42-credential-socket\") pod \"e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2\" (UID: \"72cfa2c7-210c-4e18-961b-4676855ffd42\") " pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:38:08.714344 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:08.714326    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72cfa2c7-210c-4e18-961b-4676855ffd42-istio-envoy\") pod \"e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2\" (UID: \"72cfa2c7-210c-4e18-961b-4676855ffd42\") " pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:38:08.714772 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:08.714747    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72cfa2c7-210c-4e18-961b-4676855ffd42-workload-certs\") pod \"e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2\" (UID: \"72cfa2c7-210c-4e18-961b-4676855ffd42\") " pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:38:08.715491 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:08.715469    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72cfa2c7-210c-4e18-961b-4676855ffd42-workload-socket\") pod \"e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2\" (UID: \"72cfa2c7-210c-4e18-961b-4676855ffd42\") " pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:38:08.715582 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:08.715486    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72cfa2c7-210c-4e18-961b-4676855ffd42-credential-socket\") pod \"e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2\" (UID: \"72cfa2c7-210c-4e18-961b-4676855ffd42\") " pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:38:08.717068 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:08.717042    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72cfa2c7-210c-4e18-961b-4676855ffd42-istio-podinfo\") pod \"e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2\" (UID: \"72cfa2c7-210c-4e18-961b-4676855ffd42\") " pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:38:08.717388 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:08.717369    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72cfa2c7-210c-4e18-961b-4676855ffd42-istio-envoy\") pod \"e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2\" (UID: \"72cfa2c7-210c-4e18-961b-4676855ffd42\") " pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:38:08.770793 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:08.770762    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72cfa2c7-210c-4e18-961b-4676855ffd42-istio-token\") pod \"e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2\" (UID: \"72cfa2c7-210c-4e18-961b-4676855ffd42\") " pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:38:08.770979 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:08.770918    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49pmn\" (UniqueName: \"kubernetes.io/projected/72cfa2c7-210c-4e18-961b-4676855ffd42-kube-api-access-49pmn\") pod \"e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2\" (UID: \"72cfa2c7-210c-4e18-961b-4676855ffd42\") " pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:38:09.074498 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:09.074139    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:38:09.574184 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:09.574150    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"]
Nov 02 08:38:09.576296 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:38:09.576269    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72cfa2c7_210c_4e18_961b_4676855ffd42.slice/crio-27ece34fb00beb531a6935e06950e6dda8733fe7e6801bb46cf65a34fcaf4cfd WatchSource:0}: Error finding container 27ece34fb00beb531a6935e06950e6dda8733fe7e6801bb46cf65a34fcaf4cfd: Status 404 returned error can't find the container with id 27ece34fb00beb531a6935e06950e6dda8733fe7e6801bb46cf65a34fcaf4cfd
Nov 02 08:38:09.579432 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:09.579396    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:38:09.579539 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:09.579464    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:38:09.579539 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:09.579494    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:38:10.352458 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.352428    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2" event={"ID":"72cfa2c7-210c-4e18-961b-4676855ffd42","Type":"ContainerStarted","Data":"2e366b5f1b7288abb73fb3a36cbbf866f95406230fb4ec58fbc561a928d9a5dc"}
Nov 02 08:38:10.352635 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.352472    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2" event={"ID":"72cfa2c7-210c-4e18-961b-4676855ffd42","Type":"ContainerStarted","Data":"27ece34fb00beb531a6935e06950e6dda8733fe7e6801bb46cf65a34fcaf4cfd"}
Nov 02 08:38:10.504141 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.504096    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2" podStartSLOduration=2.50408126 podStartE2EDuration="2.50408126s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:38:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:38:10.457308771 +0000 UTC m=+1880.215737504" watchObservedRunningTime="2026-11-02 08:38:10.50408126 +0000 UTC m=+1880.262509991"
Nov 02 08:38:10.509312 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.509285    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"]
Nov 02 08:38:10.513667 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.513646    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"
Nov 02 08:38:10.525384 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.525359    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"]
Nov 02 08:38:10.529555 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.529536    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"
Nov 02 08:38:10.567643 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.567611    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"]
Nov 02 08:38:10.638038 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.632303    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"]
Nov 02 08:38:10.661400 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.660172    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09185775-6eca-468f-a7c3-9793d2cb43b7-istio-data\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-785dw\" (UID: \"09185775-6eca-468f-a7c3-9793d2cb43b7\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"
Nov 02 08:38:10.661400 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.660288    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-istio-token\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-bn64g\" (UID: \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"
Nov 02 08:38:10.661400 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.660330    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrpzd\" (UniqueName: \"kubernetes.io/projected/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-kube-api-access-lrpzd\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-bn64g\" (UID: \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"
Nov 02 08:38:10.661400 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.660373    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-istio-data\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-bn64g\" (UID: \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"
Nov 02 08:38:10.661400 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.660407    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09185775-6eca-468f-a7c3-9793d2cb43b7-istio-envoy\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-785dw\" (UID: \"09185775-6eca-468f-a7c3-9793d2cb43b7\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"
Nov 02 08:38:10.661400 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.660473    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-istio-podinfo\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-bn64g\" (UID: \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"
Nov 02 08:38:10.661400 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.660533    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09185775-6eca-468f-a7c3-9793d2cb43b7-workload-certs\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-785dw\" (UID: \"09185775-6eca-468f-a7c3-9793d2cb43b7\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"
Nov 02 08:38:10.661400 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.660586    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09185775-6eca-468f-a7c3-9793d2cb43b7-credential-socket\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-785dw\" (UID: \"09185775-6eca-468f-a7c3-9793d2cb43b7\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"
Nov 02 08:38:10.661400 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.660612    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-istio-envoy\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-bn64g\" (UID: \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"
Nov 02 08:38:10.661400 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.660648    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09185775-6eca-468f-a7c3-9793d2cb43b7-workload-socket\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-785dw\" (UID: \"09185775-6eca-468f-a7c3-9793d2cb43b7\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"
Nov 02 08:38:10.661400 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.660672    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09185775-6eca-468f-a7c3-9793d2cb43b7-istiod-ca-cert\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-785dw\" (UID: \"09185775-6eca-468f-a7c3-9793d2cb43b7\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"
Nov 02 08:38:10.661400 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.660729    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-workload-socket\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-bn64g\" (UID: \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"
Nov 02 08:38:10.661400 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.660766    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09185775-6eca-468f-a7c3-9793d2cb43b7-istio-token\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-785dw\" (UID: \"09185775-6eca-468f-a7c3-9793d2cb43b7\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"
Nov 02 08:38:10.661400 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.660835    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qx5s\" (UniqueName: \"kubernetes.io/projected/09185775-6eca-468f-a7c3-9793d2cb43b7-kube-api-access-9qx5s\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-785dw\" (UID: \"09185775-6eca-468f-a7c3-9793d2cb43b7\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"
Nov 02 08:38:10.661400 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.660866    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-istiod-ca-cert\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-bn64g\" (UID: \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"
Nov 02 08:38:10.661400 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.660986    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09185775-6eca-468f-a7c3-9793d2cb43b7-istio-podinfo\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-785dw\" (UID: \"09185775-6eca-468f-a7c3-9793d2cb43b7\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"
Nov 02 08:38:10.661400 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.661043    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-workload-certs\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-bn64g\" (UID: \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"
Nov 02 08:38:10.661400 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.661147    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-credential-socket\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-bn64g\" (UID: \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"
Nov 02 08:38:10.762463 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.762426    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-istio-token\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-bn64g\" (UID: \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"
Nov 02 08:38:10.762655 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.762474    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrpzd\" (UniqueName: \"kubernetes.io/projected/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-kube-api-access-lrpzd\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-bn64g\" (UID: \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"
Nov 02 08:38:10.762655 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.762604    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-istio-data\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-bn64g\" (UID: \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"
Nov 02 08:38:10.762789 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.762663    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09185775-6eca-468f-a7c3-9793d2cb43b7-istio-envoy\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-785dw\" (UID: \"09185775-6eca-468f-a7c3-9793d2cb43b7\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"
Nov 02 08:38:10.762789 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.762736    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-istio-podinfo\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-bn64g\" (UID: \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"
Nov 02 08:38:10.762789 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.762771    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09185775-6eca-468f-a7c3-9793d2cb43b7-workload-certs\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-785dw\" (UID: \"09185775-6eca-468f-a7c3-9793d2cb43b7\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"
Nov 02 08:38:10.762959 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.762827    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09185775-6eca-468f-a7c3-9793d2cb43b7-credential-socket\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-785dw\" (UID: \"09185775-6eca-468f-a7c3-9793d2cb43b7\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"
Nov 02 08:38:10.762959 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.762855    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-istio-envoy\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-bn64g\" (UID: \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"
Nov 02 08:38:10.762959 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.762908    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09185775-6eca-468f-a7c3-9793d2cb43b7-workload-socket\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-785dw\" (UID: \"09185775-6eca-468f-a7c3-9793d2cb43b7\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"
Nov 02 08:38:10.762959 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.762933    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09185775-6eca-468f-a7c3-9793d2cb43b7-istiod-ca-cert\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-785dw\" (UID: \"09185775-6eca-468f-a7c3-9793d2cb43b7\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"
Nov 02 08:38:10.763151 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.762987    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-workload-socket\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-bn64g\" (UID: \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"
Nov 02 08:38:10.763151 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.763027    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09185775-6eca-468f-a7c3-9793d2cb43b7-istio-token\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-785dw\" (UID: \"09185775-6eca-468f-a7c3-9793d2cb43b7\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"
Nov 02 08:38:10.763151 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.763098    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qx5s\" (UniqueName: \"kubernetes.io/projected/09185775-6eca-468f-a7c3-9793d2cb43b7-kube-api-access-9qx5s\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-785dw\" (UID: \"09185775-6eca-468f-a7c3-9793d2cb43b7\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"
Nov 02 08:38:10.763151 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.763139    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-istiod-ca-cert\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-bn64g\" (UID: \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"
Nov 02 08:38:10.763349 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.763206    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09185775-6eca-468f-a7c3-9793d2cb43b7-istio-podinfo\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-785dw\" (UID: \"09185775-6eca-468f-a7c3-9793d2cb43b7\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"
Nov 02 08:38:10.763349 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.763263    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-workload-certs\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-bn64g\" (UID: \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"
Nov 02 08:38:10.763349 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.763314    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-credential-socket\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-bn64g\" (UID: \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"
Nov 02 08:38:10.763498 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.763369    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09185775-6eca-468f-a7c3-9793d2cb43b7-istio-data\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-785dw\" (UID: \"09185775-6eca-468f-a7c3-9793d2cb43b7\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"
Nov 02 08:38:10.763498 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.763405    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-istio-data\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-bn64g\" (UID: \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"
Nov 02 08:38:10.763672 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.763648    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09185775-6eca-468f-a7c3-9793d2cb43b7-workload-socket\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-785dw\" (UID: \"09185775-6eca-468f-a7c3-9793d2cb43b7\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"
Nov 02 08:38:10.763742 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.763710    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09185775-6eca-468f-a7c3-9793d2cb43b7-istio-data\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-785dw\" (UID: \"09185775-6eca-468f-a7c3-9793d2cb43b7\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"
Nov 02 08:38:10.763867 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.763838    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09185775-6eca-468f-a7c3-9793d2cb43b7-credential-socket\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-785dw\" (UID: \"09185775-6eca-468f-a7c3-9793d2cb43b7\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"
Nov 02 08:38:10.763984 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.763202    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09185775-6eca-468f-a7c3-9793d2cb43b7-workload-certs\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-785dw\" (UID: \"09185775-6eca-468f-a7c3-9793d2cb43b7\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"
Nov 02 08:38:10.764187 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.764166    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-workload-certs\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-bn64g\" (UID: \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"
Nov 02 08:38:10.764336 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.764301    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09185775-6eca-468f-a7c3-9793d2cb43b7-istiod-ca-cert\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-785dw\" (UID: \"09185775-6eca-468f-a7c3-9793d2cb43b7\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"
Nov 02 08:38:10.764429 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.764408    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-credential-socket\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-bn64g\" (UID: \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"
Nov 02 08:38:10.764554 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.764531    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-istiod-ca-cert\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-bn64g\" (UID: \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"
Nov 02 08:38:10.764625 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.764545    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-workload-socket\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-bn64g\" (UID: \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"
Nov 02 08:38:10.767181 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.767144    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-istio-envoy\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-bn64g\" (UID: \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"
Nov 02 08:38:10.767388 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.767370    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09185775-6eca-468f-a7c3-9793d2cb43b7-istio-podinfo\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-785dw\" (UID: \"09185775-6eca-468f-a7c3-9793d2cb43b7\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"
Nov 02 08:38:10.767693 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.767673    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-istio-podinfo\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-bn64g\" (UID: \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"
Nov 02 08:38:10.768028 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.768011    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09185775-6eca-468f-a7c3-9793d2cb43b7-istio-envoy\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-785dw\" (UID: \"09185775-6eca-468f-a7c3-9793d2cb43b7\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"
Nov 02 08:38:10.816253 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.816218    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-istio-token\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-bn64g\" (UID: \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"
Nov 02 08:38:10.816407 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.816337    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09185775-6eca-468f-a7c3-9793d2cb43b7-istio-token\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-785dw\" (UID: \"09185775-6eca-468f-a7c3-9793d2cb43b7\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"
Nov 02 08:38:10.816498 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.816472    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrpzd\" (UniqueName: \"kubernetes.io/projected/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-kube-api-access-lrpzd\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-bn64g\" (UID: \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"
Nov 02 08:38:10.816556 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.816490    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qx5s\" (UniqueName: \"kubernetes.io/projected/09185775-6eca-468f-a7c3-9793d2cb43b7-kube-api-access-9qx5s\") pod \"e2e-mt-cba6f9af-openshift-default-db985b657-785dw\" (UID: \"09185775-6eca-468f-a7c3-9793d2cb43b7\") " pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"
Nov 02 08:38:10.829211 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.829185    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"
Nov 02 08:38:10.851983 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:10.846127    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"
Nov 02 08:38:11.074998 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:11.074929    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:38:11.080702 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:11.080678    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:38:11.267464 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:11.267433    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"]
Nov 02 08:38:11.269973 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:38:11.269938    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09185775_6eca_468f_a7c3_9793d2cb43b7.slice/crio-fe8dde3e00c3a49a5e8bcd7b0a9a19a7fed8aaffc8471ea18a3f36ac2dffa780 WatchSource:0}: Error finding container fe8dde3e00c3a49a5e8bcd7b0a9a19a7fed8aaffc8471ea18a3f36ac2dffa780: Status 404 returned error can't find the container with id fe8dde3e00c3a49a5e8bcd7b0a9a19a7fed8aaffc8471ea18a3f36ac2dffa780
Nov 02 08:38:11.274605 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:11.272810    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:38:11.274605 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:11.272942    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:38:11.274605 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:11.272987    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:38:11.274605 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:38:11.273357    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac5e7ab8_bf7b_43a1_8943_334c1641a3d2.slice/crio-074ed35f25b270dfa4ab57a3a9b3e1342eca076085bf0366989d431d4db47ffd WatchSource:0}: Error finding container 074ed35f25b270dfa4ab57a3a9b3e1342eca076085bf0366989d431d4db47ffd: Status 404 returned error can't find the container with id 074ed35f25b270dfa4ab57a3a9b3e1342eca076085bf0366989d431d4db47ffd
Nov 02 08:38:11.274605 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:11.274098    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"]
Nov 02 08:38:11.276356 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:11.276318    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:38:11.276448 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:11.276399    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:38:11.276448 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:11.276442    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:38:11.354756 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:11.354717    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g" event={"ID":"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2","Type":"ContainerStarted","Data":"074ed35f25b270dfa4ab57a3a9b3e1342eca076085bf0366989d431d4db47ffd"}
Nov 02 08:38:11.356520 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:11.356494    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw" event={"ID":"09185775-6eca-468f-a7c3-9793d2cb43b7","Type":"ContainerStarted","Data":"fe8dde3e00c3a49a5e8bcd7b0a9a19a7fed8aaffc8471ea18a3f36ac2dffa780"}
Nov 02 08:38:11.356700 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:11.356677    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:38:11.357734 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:11.357715    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:38:12.455981 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:12.455317    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g" event={"ID":"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2","Type":"ContainerStarted","Data":"e6b1028fd3dd27b9fdd1b492ac2c82e03cf9c49a283dee662894ff6f1362d842"}
Nov 02 08:38:12.483512 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:12.483475    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw" event={"ID":"09185775-6eca-468f-a7c3-9793d2cb43b7","Type":"ContainerStarted","Data":"b4a33bfb3b0f8d3f0a07fe2652ddb810105e1bda7b97df7d0237069e0420f1ca"}
Nov 02 08:38:12.751475 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:12.751397    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g" podStartSLOduration=2.751376097 podStartE2EDuration="2.751376097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:38:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:38:12.625701776 +0000 UTC m=+1882.384130514" watchObservedRunningTime="2026-11-02 08:38:12.751376097 +0000 UTC m=+1882.509804830"
Nov 02 08:38:12.752211 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:12.752154    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw" podStartSLOduration=2.7521392000000002 podStartE2EDuration="2.7521392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:38:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:38:12.750497965 +0000 UTC m=+1882.508926697" watchObservedRunningTime="2026-11-02 08:38:12.7521392 +0000 UTC m=+1882.510567933"
Nov 02 08:38:12.832270 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:12.832226    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"
Nov 02 08:38:12.836020 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:12.835985    6210 patch_prober.go:29] interesting pod/e2e-mt-cba6f9af-openshift-default-db985b657-785dw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Nov 02 08:38:12.836295 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:12.836265    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw" podUID="09185775-6eca-468f-a7c3-9793d2cb43b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Nov 02 08:38:12.849235 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:12.849205    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"
Nov 02 08:38:12.853999 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:12.853970    6210 patch_prober.go:29] interesting pod/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused" start-of-body=
Nov 02 08:38:12.854204 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:12.854177    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g" podUID="ac5e7ab8-bf7b-43a1-8943-334c1641a3d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused"
Nov 02 08:38:13.833901 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:13.830261    6210 patch_prober.go:29] interesting pod/e2e-mt-cba6f9af-openshift-default-db985b657-785dw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Nov 02 08:38:13.833901 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:13.830340    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw" podUID="09185775-6eca-468f-a7c3-9793d2cb43b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Nov 02 08:38:13.851903 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:13.848220    6210 patch_prober.go:29] interesting pod/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused" start-of-body=
Nov 02 08:38:13.851903 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:13.848276    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g" podUID="ac5e7ab8-bf7b-43a1-8943-334c1641a3d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused"
Nov 02 08:38:14.832217 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:14.832179    6210 patch_prober.go:29] interesting pod/e2e-mt-cba6f9af-openshift-default-db985b657-785dw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Nov 02 08:38:14.832524 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:14.832489    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw" podUID="09185775-6eca-468f-a7c3-9793d2cb43b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Nov 02 08:38:14.847234 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:14.847205    6210 patch_prober.go:29] interesting pod/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused" start-of-body=
Nov 02 08:38:14.847819 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:14.847787    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g" podUID="ac5e7ab8-bf7b-43a1-8943-334c1641a3d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused"
Nov 02 08:38:15.833902 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:15.833591    6210 patch_prober.go:29] interesting pod/e2e-mt-cba6f9af-openshift-default-db985b657-785dw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Nov 02 08:38:15.833902 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:15.833656    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw" podUID="09185775-6eca-468f-a7c3-9793d2cb43b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Nov 02 08:38:15.847903 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:15.847206    6210 patch_prober.go:29] interesting pod/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused" start-of-body=
Nov 02 08:38:15.847903 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:15.847259    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g" podUID="ac5e7ab8-bf7b-43a1-8943-334c1641a3d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused"
Nov 02 08:38:16.832902 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:16.832366    6210 patch_prober.go:29] interesting pod/e2e-mt-cba6f9af-openshift-default-db985b657-785dw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Nov 02 08:38:16.832902 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:16.832429    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw" podUID="09185775-6eca-468f-a7c3-9793d2cb43b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Nov 02 08:38:16.849930 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:16.847849    6210 patch_prober.go:29] interesting pod/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused" start-of-body=
Nov 02 08:38:16.849930 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:16.847956    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g" podUID="ac5e7ab8-bf7b-43a1-8943-334c1641a3d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused"
Nov 02 08:38:17.830319 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:17.830281    6210 patch_prober.go:29] interesting pod/e2e-mt-cba6f9af-openshift-default-db985b657-785dw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Nov 02 08:38:17.830498 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:17.830330    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw" podUID="09185775-6eca-468f-a7c3-9793d2cb43b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Nov 02 08:38:18.560677 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:18.560643    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"
Nov 02 08:38:18.561145 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:18.561094    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"
Nov 02 08:38:18.562108 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:18.562088    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"
Nov 02 08:38:18.834900 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:18.834793    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"
Nov 02 08:38:18.836084 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:18.836059    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"
Nov 02 08:38:18.836660 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:18.836638    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"
Nov 02 08:38:30.822344 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:38:30.822310    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:38:39.036464 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:39.036429    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"]
Nov 02 08:38:39.037004 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:39.036662    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z" podUID="ab1cc655-53d5-4b53-8041-bb102a2d133e" containerName="istio-proxy" containerID="cri-o://e7b326345f8f7ea0aaa3716e776c80dc11b748bec6278845808abd5d6d372c75" gracePeriod=30
Nov 02 08:38:44.308935 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:44.308852    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"
Nov 02 08:38:44.365231 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:44.365198    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ab1cc655-53d5-4b53-8041-bb102a2d133e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab1cc655-53d5-4b53-8041-bb102a2d133e-workload-socket\") pod \"ab1cc655-53d5-4b53-8041-bb102a2d133e\" (UID: \"ab1cc655-53d5-4b53-8041-bb102a2d133e\") "
Nov 02 08:38:44.365389 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:44.365247    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ab1cc655-53d5-4b53-8041-bb102a2d133e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab1cc655-53d5-4b53-8041-bb102a2d133e-workload-certs\") pod \"ab1cc655-53d5-4b53-8041-bb102a2d133e\" (UID: \"ab1cc655-53d5-4b53-8041-bb102a2d133e\") "
Nov 02 08:38:44.365389 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:44.365283    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ab1cc655-53d5-4b53-8041-bb102a2d133e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab1cc655-53d5-4b53-8041-bb102a2d133e-istio-envoy\") pod \"ab1cc655-53d5-4b53-8041-bb102a2d133e\" (UID: \"ab1cc655-53d5-4b53-8041-bb102a2d133e\") "
Nov 02 08:38:44.365389 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:44.365383    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ab1cc655-53d5-4b53-8041-bb102a2d133e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab1cc655-53d5-4b53-8041-bb102a2d133e-istio-podinfo\") pod \"ab1cc655-53d5-4b53-8041-bb102a2d133e\" (UID: \"ab1cc655-53d5-4b53-8041-bb102a2d133e\") "
Nov 02 08:38:44.365548 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:44.365406    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ab1cc655-53d5-4b53-8041-bb102a2d133e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab1cc655-53d5-4b53-8041-bb102a2d133e-credential-socket\") pod \"ab1cc655-53d5-4b53-8041-bb102a2d133e\" (UID: \"ab1cc655-53d5-4b53-8041-bb102a2d133e\") "
Nov 02 08:38:44.365548 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:44.365476    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ab1cc655-53d5-4b53-8041-bb102a2d133e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab1cc655-53d5-4b53-8041-bb102a2d133e-istio-data\") pod \"ab1cc655-53d5-4b53-8041-bb102a2d133e\" (UID: \"ab1cc655-53d5-4b53-8041-bb102a2d133e\") "
Nov 02 08:38:44.365659 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:44.365564    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ab1cc655-53d5-4b53-8041-bb102a2d133e-kube-api-access-vrnrk\" (UniqueName: \"kubernetes.io/projected/ab1cc655-53d5-4b53-8041-bb102a2d133e-kube-api-access-vrnrk\") pod \"ab1cc655-53d5-4b53-8041-bb102a2d133e\" (UID: \"ab1cc655-53d5-4b53-8041-bb102a2d133e\") "
Nov 02 08:38:44.365659 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:44.365469    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab1cc655-53d5-4b53-8041-bb102a2d133e-workload-socket" pod "ab1cc655-53d5-4b53-8041-bb102a2d133e" (UID: "ab1cc655-53d5-4b53-8041-bb102a2d133e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:38:44.365659 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:44.365566    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab1cc655-53d5-4b53-8041-bb102a2d133e-workload-certs" pod "ab1cc655-53d5-4b53-8041-bb102a2d133e" (UID: "ab1cc655-53d5-4b53-8041-bb102a2d133e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:38:44.365659 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:44.365602    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ab1cc655-53d5-4b53-8041-bb102a2d133e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab1cc655-53d5-4b53-8041-bb102a2d133e-istiod-ca-cert\") pod \"ab1cc655-53d5-4b53-8041-bb102a2d133e\" (UID: \"ab1cc655-53d5-4b53-8041-bb102a2d133e\") "
Nov 02 08:38:44.365659 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:44.365654    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ab1cc655-53d5-4b53-8041-bb102a2d133e-istio-token\" (UniqueName: \"kubernetes.io/projected/ab1cc655-53d5-4b53-8041-bb102a2d133e-istio-token\") pod \"ab1cc655-53d5-4b53-8041-bb102a2d133e\" (UID: \"ab1cc655-53d5-4b53-8041-bb102a2d133e\") "
Nov 02 08:38:44.365935 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:44.365699    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab1cc655-53d5-4b53-8041-bb102a2d133e-credential-socket" pod "ab1cc655-53d5-4b53-8041-bb102a2d133e" (UID: "ab1cc655-53d5-4b53-8041-bb102a2d133e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:38:44.365935 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:44.365738    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab1cc655-53d5-4b53-8041-bb102a2d133e-istio-data" pod "ab1cc655-53d5-4b53-8041-bb102a2d133e" (UID: "ab1cc655-53d5-4b53-8041-bb102a2d133e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:38:44.366050 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:44.365993    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab1cc655-53d5-4b53-8041-bb102a2d133e-istiod-ca-cert" pod "ab1cc655-53d5-4b53-8041-bb102a2d133e" (UID: "ab1cc655-53d5-4b53-8041-bb102a2d133e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:38:44.366320 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:44.366271    6210 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab1cc655-53d5-4b53-8041-bb102a2d133e-credential-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:38:44.366320 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:44.366298    6210 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab1cc655-53d5-4b53-8041-bb102a2d133e-istio-data\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:38:44.366320 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:44.366313    6210 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab1cc655-53d5-4b53-8041-bb102a2d133e-istiod-ca-cert\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:38:44.366531 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:44.366327    6210 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab1cc655-53d5-4b53-8041-bb102a2d133e-workload-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:38:44.366531 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:44.366342    6210 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab1cc655-53d5-4b53-8041-bb102a2d133e-workload-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:38:44.367963 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:44.367861    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab1cc655-53d5-4b53-8041-bb102a2d133e-istio-token" pod "ab1cc655-53d5-4b53-8041-bb102a2d133e" (UID: "ab1cc655-53d5-4b53-8041-bb102a2d133e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:38:44.368065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:44.368012    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab1cc655-53d5-4b53-8041-bb102a2d133e-istio-envoy" pod "ab1cc655-53d5-4b53-8041-bb102a2d133e" (UID: "ab1cc655-53d5-4b53-8041-bb102a2d133e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:38:44.368065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:44.368034    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ab1cc655-53d5-4b53-8041-bb102a2d133e-istio-podinfo" pod "ab1cc655-53d5-4b53-8041-bb102a2d133e" (UID: "ab1cc655-53d5-4b53-8041-bb102a2d133e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 08:38:44.368176 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:44.368095    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab1cc655-53d5-4b53-8041-bb102a2d133e-kube-api-access-vrnrk" pod "ab1cc655-53d5-4b53-8041-bb102a2d133e" (UID: "ab1cc655-53d5-4b53-8041-bb102a2d133e"). InnerVolumeSpecName "kube-api-access-vrnrk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:38:44.467381 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:44.467346    6210 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab1cc655-53d5-4b53-8041-bb102a2d133e-istio-podinfo\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:38:44.467381 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:44.467380    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrnrk\" (UniqueName: \"kubernetes.io/projected/ab1cc655-53d5-4b53-8041-bb102a2d133e-kube-api-access-vrnrk\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:38:44.467598 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:44.467395    6210 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab1cc655-53d5-4b53-8041-bb102a2d133e-istio-token\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:38:44.467598 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:44.467407    6210 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab1cc655-53d5-4b53-8041-bb102a2d133e-istio-envoy\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:38:44.870119 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:44.870078    6210 generic.go:356] "Generic (PLEG): container finished" podID="ab1cc655-53d5-4b53-8041-bb102a2d133e" containerID="e7b326345f8f7ea0aaa3716e776c80dc11b748bec6278845808abd5d6d372c75" exitCode=0
Nov 02 08:38:44.870302 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:44.870131    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"
Nov 02 08:38:44.870302 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:44.870159    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z" event={"ID":"ab1cc655-53d5-4b53-8041-bb102a2d133e","Type":"ContainerDied","Data":"e7b326345f8f7ea0aaa3716e776c80dc11b748bec6278845808abd5d6d372c75"}
Nov 02 08:38:44.870302 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:44.870218    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z" event={"ID":"ab1cc655-53d5-4b53-8041-bb102a2d133e","Type":"ContainerDied","Data":"42abe342129ae0e8803f1b8124723ec6692a412ad995e914cf07df819471d4e8"}
Nov 02 08:38:44.870302 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:44.870241    6210 scope.go:122] "RemoveContainer" containerID="e7b326345f8f7ea0aaa3716e776c80dc11b748bec6278845808abd5d6d372c75"
Nov 02 08:38:44.880585 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:44.880565    6210 scope.go:122] "RemoveContainer" containerID="e7b326345f8f7ea0aaa3716e776c80dc11b748bec6278845808abd5d6d372c75"
Nov 02 08:38:44.880865 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:38:44.880848    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7b326345f8f7ea0aaa3716e776c80dc11b748bec6278845808abd5d6d372c75\": container with ID starting with e7b326345f8f7ea0aaa3716e776c80dc11b748bec6278845808abd5d6d372c75 not found: ID does not exist" containerID="e7b326345f8f7ea0aaa3716e776c80dc11b748bec6278845808abd5d6d372c75"
Nov 02 08:38:44.880942 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:44.880874    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7b326345f8f7ea0aaa3716e776c80dc11b748bec6278845808abd5d6d372c75"} err="failed to get container status \"e7b326345f8f7ea0aaa3716e776c80dc11b748bec6278845808abd5d6d372c75\": rpc error: code = NotFound desc = could not find container \"e7b326345f8f7ea0aaa3716e776c80dc11b748bec6278845808abd5d6d372c75\": container with ID starting with e7b326345f8f7ea0aaa3716e776c80dc11b748bec6278845808abd5d6d372c75 not found: ID does not exist"
Nov 02 08:38:45.027949 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:45.027918    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"]
Nov 02 08:38:45.031616 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:45.031590    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z"]
Nov 02 08:38:46.354216 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:46.354186    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ab1cc655-53d5-4b53-8041-bb102a2d133e" path="/var/lib/kubelet/pods/ab1cc655-53d5-4b53-8041-bb102a2d133e/volumes"
Nov 02 08:38:55.767829 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:55.767795    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch"]
Nov 02 08:38:55.924284 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:55.924244    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67"]
Nov 02 08:38:58.591900 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:58.589305    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4"]
Nov 02 08:38:58.591900 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:58.589545    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4" podUID="eba9e1b0-c9f1-4ecf-994b-750dfd592c2f" containerName="maas-api" containerID="cri-o://aa77023b419de5ba9b2661be954d68221bbc280376ed722bc4194e69a5e47f14" gracePeriod=30
Nov 02 08:38:59.058903 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:59.050501    6210 generic.go:356] "Generic (PLEG): container finished" podID="eba9e1b0-c9f1-4ecf-994b-750dfd592c2f" containerID="aa77023b419de5ba9b2661be954d68221bbc280376ed722bc4194e69a5e47f14" exitCode=0
Nov 02 08:38:59.058903 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:59.050680    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4" event={"ID":"eba9e1b0-c9f1-4ecf-994b-750dfd592c2f","Type":"ContainerDied","Data":"aa77023b419de5ba9b2661be954d68221bbc280376ed722bc4194e69a5e47f14"}
Nov 02 08:38:59.144345 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:59.144281    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4"
Nov 02 08:38:59.287451 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:59.287409    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/eba9e1b0-c9f1-4ecf-994b-750dfd592c2f-kube-api-access-25f6t\" (UniqueName: \"kubernetes.io/projected/eba9e1b0-c9f1-4ecf-994b-750dfd592c2f-kube-api-access-25f6t\") pod \"eba9e1b0-c9f1-4ecf-994b-750dfd592c2f\" (UID: \"eba9e1b0-c9f1-4ecf-994b-750dfd592c2f\") "
Nov 02 08:38:59.287642 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:59.287512    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/eba9e1b0-c9f1-4ecf-994b-750dfd592c2f-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eba9e1b0-c9f1-4ecf-994b-750dfd592c2f-openshift-service-ca\") pod \"eba9e1b0-c9f1-4ecf-994b-750dfd592c2f\" (UID: \"eba9e1b0-c9f1-4ecf-994b-750dfd592c2f\") "
Nov 02 08:38:59.287766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:59.287746    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/eba9e1b0-c9f1-4ecf-994b-750dfd592c2f-metrics-certs\" (UniqueName: \"kubernetes.io/secret/eba9e1b0-c9f1-4ecf-994b-750dfd592c2f-metrics-certs\") pod \"eba9e1b0-c9f1-4ecf-994b-750dfd592c2f\" (UID: \"eba9e1b0-c9f1-4ecf-994b-750dfd592c2f\") "
Nov 02 08:38:59.287830 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:59.287784    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/eba9e1b0-c9f1-4ecf-994b-750dfd592c2f-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eba9e1b0-c9f1-4ecf-994b-750dfd592c2f-maas-api-tls\") pod \"eba9e1b0-c9f1-4ecf-994b-750dfd592c2f\" (UID: \"eba9e1b0-c9f1-4ecf-994b-750dfd592c2f\") "
Nov 02 08:38:59.287920 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:59.287867    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eba9e1b0-c9f1-4ecf-994b-750dfd592c2f-openshift-service-ca" pod "eba9e1b0-c9f1-4ecf-994b-750dfd592c2f" (UID: "eba9e1b0-c9f1-4ecf-994b-750dfd592c2f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:38:59.288451 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:59.288422    6210 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eba9e1b0-c9f1-4ecf-994b-750dfd592c2f-openshift-service-ca\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:38:59.289590 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:59.289562    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eba9e1b0-c9f1-4ecf-994b-750dfd592c2f-kube-api-access-25f6t" pod "eba9e1b0-c9f1-4ecf-994b-750dfd592c2f" (UID: "eba9e1b0-c9f1-4ecf-994b-750dfd592c2f"). InnerVolumeSpecName "kube-api-access-25f6t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:38:59.289770 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:59.289747    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eba9e1b0-c9f1-4ecf-994b-750dfd592c2f-metrics-certs" pod "eba9e1b0-c9f1-4ecf-994b-750dfd592c2f" (UID: "eba9e1b0-c9f1-4ecf-994b-750dfd592c2f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:38:59.290506 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:59.290478    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eba9e1b0-c9f1-4ecf-994b-750dfd592c2f-maas-api-tls" pod "eba9e1b0-c9f1-4ecf-994b-750dfd592c2f" (UID: "eba9e1b0-c9f1-4ecf-994b-750dfd592c2f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:38:59.395277 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:59.395192    6210 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eba9e1b0-c9f1-4ecf-994b-750dfd592c2f-metrics-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:38:59.395277 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:59.395226    6210 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eba9e1b0-c9f1-4ecf-994b-750dfd592c2f-maas-api-tls\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:38:59.395277 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:38:59.395246    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25f6t\" (UniqueName: \"kubernetes.io/projected/eba9e1b0-c9f1-4ecf-994b-750dfd592c2f-kube-api-access-25f6t\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:00.058357 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:00.058326    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4" event={"ID":"eba9e1b0-c9f1-4ecf-994b-750dfd592c2f","Type":"ContainerDied","Data":"1589859f7df38b26db73741ff2a2d030214a504a59a46659e023ebf16d459f58"}
Nov 02 08:39:00.058833 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:00.058380    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4"
Nov 02 08:39:00.058833 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:00.058410    6210 scope.go:122] "RemoveContainer" containerID="aa77023b419de5ba9b2661be954d68221bbc280376ed722bc4194e69a5e47f14"
Nov 02 08:39:00.247635 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:00.247601    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4"]
Nov 02 08:39:00.293968 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:00.293931    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cba6f9af-7cdb7b567d-mzjp4"]
Nov 02 08:39:00.353680 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:00.353599    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="eba9e1b0-c9f1-4ecf-994b-750dfd592c2f" path="/var/lib/kubelet/pods/eba9e1b0-c9f1-4ecf-994b-750dfd592c2f/volumes"
Nov 02 08:39:00.769030 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:00.768990    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch" podUID="533b692f-58b1-4609-b173-914d4a183be8" containerName="payload-processing" containerID="cri-o://d17738ee9e08188e54eeb6ce6cf501bd6479a4cfd22c1a776e3a272754151313" gracePeriod=25
Nov 02 08:39:00.821683 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:39:00.821648    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:39:00.931043 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:00.929003    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67" podUID="931e577d-0e59-4304-b6eb-7b2b5e9834ba" containerName="payload-pre-processing" containerID="cri-o://455d8ec0d2debafd7be14984c4fcd0eba12a9c9e7f7f40bcea0b477a02c5ba4f" gracePeriod=25
Nov 02 08:39:01.067610 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:01.067576    6210 generic.go:356] "Generic (PLEG): container finished" podID="931e577d-0e59-4304-b6eb-7b2b5e9834ba" containerID="455d8ec0d2debafd7be14984c4fcd0eba12a9c9e7f7f40bcea0b477a02c5ba4f" exitCode=0
Nov 02 08:39:01.067986 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:01.067653    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67" event={"ID":"931e577d-0e59-4304-b6eb-7b2b5e9834ba","Type":"ContainerDied","Data":"455d8ec0d2debafd7be14984c4fcd0eba12a9c9e7f7f40bcea0b477a02c5ba4f"}
Nov 02 08:39:01.069453 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:01.069425    6210 generic.go:356] "Generic (PLEG): container finished" podID="533b692f-58b1-4609-b173-914d4a183be8" containerID="d17738ee9e08188e54eeb6ce6cf501bd6479a4cfd22c1a776e3a272754151313" exitCode=0
Nov 02 08:39:01.069595 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:01.069490    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch" event={"ID":"533b692f-58b1-4609-b173-914d4a183be8","Type":"ContainerDied","Data":"d17738ee9e08188e54eeb6ce6cf501bd6479a4cfd22c1a776e3a272754151313"}
Nov 02 08:39:01.095535 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:01.095507    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch"
Nov 02 08:39:01.297093 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:01.199694    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/533b692f-58b1-4609-b173-914d4a183be8-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/533b692f-58b1-4609-b173-914d4a183be8-plugins-config-volume\") pod \"533b692f-58b1-4609-b173-914d4a183be8\" (UID: \"533b692f-58b1-4609-b173-914d4a183be8\") "
Nov 02 08:39:01.297093 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:01.199836    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/533b692f-58b1-4609-b173-914d4a183be8-kube-api-access-qfvl2\" (UniqueName: \"kubernetes.io/projected/533b692f-58b1-4609-b173-914d4a183be8-kube-api-access-qfvl2\") pod \"533b692f-58b1-4609-b173-914d4a183be8\" (UID: \"533b692f-58b1-4609-b173-914d4a183be8\") "
Nov 02 08:39:01.297093 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:01.207578    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/533b692f-58b1-4609-b173-914d4a183be8-plugins-config-volume" pod "533b692f-58b1-4609-b173-914d4a183be8" (UID: "533b692f-58b1-4609-b173-914d4a183be8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:39:01.302235 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:01.302134    6210 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/533b692f-58b1-4609-b173-914d4a183be8-plugins-config-volume\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:01.352210 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:01.352175    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/533b692f-58b1-4609-b173-914d4a183be8-kube-api-access-qfvl2" pod "533b692f-58b1-4609-b173-914d4a183be8" (UID: "533b692f-58b1-4609-b173-914d4a183be8"). InnerVolumeSpecName "kube-api-access-qfvl2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:39:01.386441 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:01.386398    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67"
Nov 02 08:39:01.404413 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:01.404373    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/931e577d-0e59-4304-b6eb-7b2b5e9834ba-kube-api-access-nq2qm\" (UniqueName: \"kubernetes.io/projected/931e577d-0e59-4304-b6eb-7b2b5e9834ba-kube-api-access-nq2qm\") pod \"931e577d-0e59-4304-b6eb-7b2b5e9834ba\" (UID: \"931e577d-0e59-4304-b6eb-7b2b5e9834ba\") "
Nov 02 08:39:01.404635 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:01.404484    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/931e577d-0e59-4304-b6eb-7b2b5e9834ba-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/931e577d-0e59-4304-b6eb-7b2b5e9834ba-plugins-config-volume\") pod \"931e577d-0e59-4304-b6eb-7b2b5e9834ba\" (UID: \"931e577d-0e59-4304-b6eb-7b2b5e9834ba\") "
Nov 02 08:39:01.404846 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:01.404824    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/931e577d-0e59-4304-b6eb-7b2b5e9834ba-plugins-config-volume" pod "931e577d-0e59-4304-b6eb-7b2b5e9834ba" (UID: "931e577d-0e59-4304-b6eb-7b2b5e9834ba"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:39:01.405184 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:01.405156    6210 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/931e577d-0e59-4304-b6eb-7b2b5e9834ba-plugins-config-volume\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:01.405287 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:01.405191    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfvl2\" (UniqueName: \"kubernetes.io/projected/533b692f-58b1-4609-b173-914d4a183be8-kube-api-access-qfvl2\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:01.406658 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:01.406628    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/931e577d-0e59-4304-b6eb-7b2b5e9834ba-kube-api-access-nq2qm" pod "931e577d-0e59-4304-b6eb-7b2b5e9834ba" (UID: "931e577d-0e59-4304-b6eb-7b2b5e9834ba"). InnerVolumeSpecName "kube-api-access-nq2qm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:39:01.510903 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:01.507048    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nq2qm\" (UniqueName: \"kubernetes.io/projected/931e577d-0e59-4304-b6eb-7b2b5e9834ba-kube-api-access-nq2qm\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:02.079893 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:02.079788    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67"
Nov 02 08:39:02.079893 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:02.079823    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67" event={"ID":"931e577d-0e59-4304-b6eb-7b2b5e9834ba","Type":"ContainerDied","Data":"cf5f36864938525f92f7aacb7d61d11511f5e44c497342095ceb67eb388b8bba"}
Nov 02 08:39:02.080486 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:02.079923    6210 scope.go:122] "RemoveContainer" containerID="455d8ec0d2debafd7be14984c4fcd0eba12a9c9e7f7f40bcea0b477a02c5ba4f"
Nov 02 08:39:02.081451 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:02.081429    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch" event={"ID":"533b692f-58b1-4609-b173-914d4a183be8","Type":"ContainerDied","Data":"8c490fbc5c538cb794b0e8b9549eb885fff1a3c66a4b1d1b4d1a9b2f87737cb5"}
Nov 02 08:39:02.081527 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:02.081450    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch"
Nov 02 08:39:02.092105 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:02.092079    6210 scope.go:122] "RemoveContainer" containerID="d17738ee9e08188e54eeb6ce6cf501bd6479a4cfd22c1a776e3a272754151313"
Nov 02 08:39:02.233360 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:02.233326    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67"]
Nov 02 08:39:02.269019 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:02.268985    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67"]
Nov 02 08:39:02.353519 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:02.353433    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="931e577d-0e59-4304-b6eb-7b2b5e9834ba" path="/var/lib/kubelet/pods/931e577d-0e59-4304-b6eb-7b2b5e9834ba/volumes"
Nov 02 08:39:02.371066 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:02.371023    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch"]
Nov 02 08:39:02.374040 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:02.374014    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch"]
Nov 02 08:39:04.352373 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:04.352337    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="533b692f-58b1-4609-b173-914d4a183be8" path="/var/lib/kubelet/pods/533b692f-58b1-4609-b173-914d4a183be8/volumes"
Nov 02 08:39:29.905498 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:29.905458    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j"]
Nov 02 08:39:29.952353 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:29.952321    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm"]
Nov 02 08:39:29.955370 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:29.955343    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj"]
Nov 02 08:39:30.825428 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:39:30.825389    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:39:34.312038 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:34.312001    6210 generic.go:356] "Generic (PLEG): container finished" podID="be2cc6e9-e7dc-431f-85b1-1552a355d75c" containerID="46b8f1d6d41c8838630bc490b583c4f7e8fe94aaf3ed613bca000c6f5d75bc88" exitCode=0
Nov 02 08:39:34.312476 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:34.312072    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w" event={"ID":"be2cc6e9-e7dc-431f-85b1-1552a355d75c","Type":"ContainerDied","Data":"46b8f1d6d41c8838630bc490b583c4f7e8fe94aaf3ed613bca000c6f5d75bc88"}
Nov 02 08:39:34.312545 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:34.312530    6210 scope.go:122] "RemoveContainer" containerID="46b8f1d6d41c8838630bc490b583c4f7e8fe94aaf3ed613bca000c6f5d75bc88"
Nov 02 08:39:34.314396 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:34.314361    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:39:34.314512 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:34.314452    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:39:34.314512 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:34.314503    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:39:35.330318 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:35.330282    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w" event={"ID":"be2cc6e9-e7dc-431f-85b1-1552a355d75c","Type":"ContainerStarted","Data":"621becfb630bf0823494199d9d4381a231d326049f4dac3f85837c24ff30a237"}
Nov 02 08:39:35.561204 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:35.561167    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:39:35.562477 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:35.562450    6210 patch_prober.go:29] interesting pod/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused" start-of-body=
Nov 02 08:39:35.562622 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:35.562519    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w" podUID="be2cc6e9-e7dc-431f-85b1-1552a355d75c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused"
Nov 02 08:39:36.560315 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:36.560283    6210 patch_prober.go:29] interesting pod/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused" start-of-body=
Nov 02 08:39:36.560944 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:36.560908    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w" podUID="be2cc6e9-e7dc-431f-85b1-1552a355d75c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused"
Nov 02 08:39:36.974229 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:36.974196    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:39:37.573958 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:37.569244    6210 patch_prober.go:29] interesting pod/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused" start-of-body=
Nov 02 08:39:37.573958 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:37.569305    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w" podUID="be2cc6e9-e7dc-431f-85b1-1552a355d75c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused"
Nov 02 08:39:38.560709 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:38.560661    6210 patch_prober.go:29] interesting pod/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused" start-of-body=
Nov 02 08:39:38.560922 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:38.560733    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w" podUID="be2cc6e9-e7dc-431f-85b1-1552a355d75c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused"
Nov 02 08:39:39.560128 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:39.560068    6210 patch_prober.go:29] interesting pod/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused" start-of-body=
Nov 02 08:39:39.560628 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:39.560174    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w" podUID="be2cc6e9-e7dc-431f-85b1-1552a355d75c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused"
Nov 02 08:39:40.561676 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:40.561233    6210 patch_prober.go:29] interesting pod/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused" start-of-body=
Nov 02 08:39:40.561676 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:40.561298    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w" podUID="be2cc6e9-e7dc-431f-85b1-1552a355d75c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused"
Nov 02 08:39:41.564298 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:41.564271    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:39:41.565296 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:41.565274    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:39:44.927011 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:44.926948    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j" podUID="5d4395c6-343b-4ed5-97f5-7bb40dec980b" containerName="main" containerID="cri-o://cf04a5a17cc494bdd45a048937cfbde46d3db3b86ce8ebf18ad33a1527087c0d" gracePeriod=45
Nov 02 08:39:44.973491 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:44.973437    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm" podUID="007e502b-178a-4249-a138-f583cc7a4508" containerName="main" containerID="cri-o://e7dd7dd969e81f62523731ca68477356ae42c250df5e5142ebd5609640f2b499" gracePeriod=45
Nov 02 08:39:44.976058 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:44.976025    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj" podUID="49b40212-55da-41b0-904e-cbab2dc73648" containerName="main" containerID="cri-o://bf1eefcb0dfe1d5598a1657ce64f9d70b59145712142eebc47f1bf63187b5255" gracePeriod=45
Nov 02 08:39:45.332109 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.332059    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm"
Nov 02 08:39:45.336628 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.336598    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j"
Nov 02 08:39:45.341355 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.341328    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj"
Nov 02 08:39:45.395811 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.395781    6210 generic.go:356] "Generic (PLEG): container finished" podID="49b40212-55da-41b0-904e-cbab2dc73648" containerID="bf1eefcb0dfe1d5598a1657ce64f9d70b59145712142eebc47f1bf63187b5255" exitCode=0
Nov 02 08:39:45.396076 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.395823    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj"
Nov 02 08:39:45.396076 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.395871    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj" event={"ID":"49b40212-55da-41b0-904e-cbab2dc73648","Type":"ContainerDied","Data":"bf1eefcb0dfe1d5598a1657ce64f9d70b59145712142eebc47f1bf63187b5255"}
Nov 02 08:39:45.396076 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.395924    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj" event={"ID":"49b40212-55da-41b0-904e-cbab2dc73648","Type":"ContainerDied","Data":"3dc3f88a8bf542dda97af497f6a4aefd9491ccb1e96ca0a2b93c4b5fbb2ee85d"}
Nov 02 08:39:45.396076 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.395946    6210 scope.go:122] "RemoveContainer" containerID="bf1eefcb0dfe1d5598a1657ce64f9d70b59145712142eebc47f1bf63187b5255"
Nov 02 08:39:45.397304 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.397281    6210 generic.go:356] "Generic (PLEG): container finished" podID="007e502b-178a-4249-a138-f583cc7a4508" containerID="e7dd7dd969e81f62523731ca68477356ae42c250df5e5142ebd5609640f2b499" exitCode=0
Nov 02 08:39:45.397465 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.397355    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm"
Nov 02 08:39:45.397465 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.397407    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm" event={"ID":"007e502b-178a-4249-a138-f583cc7a4508","Type":"ContainerDied","Data":"e7dd7dd969e81f62523731ca68477356ae42c250df5e5142ebd5609640f2b499"}
Nov 02 08:39:45.397465 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.397440    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm" event={"ID":"007e502b-178a-4249-a138-f583cc7a4508","Type":"ContainerDied","Data":"2f24afbd19d20f248c13688e6bdf4fd3343826f24780df95082b3c9cff25e740"}
Nov 02 08:39:45.398752 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.398734    6210 generic.go:356] "Generic (PLEG): container finished" podID="5d4395c6-343b-4ed5-97f5-7bb40dec980b" containerID="cf04a5a17cc494bdd45a048937cfbde46d3db3b86ce8ebf18ad33a1527087c0d" exitCode=0
Nov 02 08:39:45.398822 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.398761    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j"
Nov 02 08:39:45.398822 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.398770    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j" event={"ID":"5d4395c6-343b-4ed5-97f5-7bb40dec980b","Type":"ContainerDied","Data":"cf04a5a17cc494bdd45a048937cfbde46d3db3b86ce8ebf18ad33a1527087c0d"}
Nov 02 08:39:45.398822 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.398794    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j" event={"ID":"5d4395c6-343b-4ed5-97f5-7bb40dec980b","Type":"ContainerDied","Data":"4bea384162346df3328b8da16fa69ffa3b4ff3146e6c3eb4fc74b40fc82aefcb"}
Nov 02 08:39:45.405821 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.405798    6210 scope.go:122] "RemoveContainer" containerID="bf1eefcb0dfe1d5598a1657ce64f9d70b59145712142eebc47f1bf63187b5255"
Nov 02 08:39:45.406108 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:39:45.406089    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf1eefcb0dfe1d5598a1657ce64f9d70b59145712142eebc47f1bf63187b5255\": container with ID starting with bf1eefcb0dfe1d5598a1657ce64f9d70b59145712142eebc47f1bf63187b5255 not found: ID does not exist" containerID="bf1eefcb0dfe1d5598a1657ce64f9d70b59145712142eebc47f1bf63187b5255"
Nov 02 08:39:45.406174 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.406116    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf1eefcb0dfe1d5598a1657ce64f9d70b59145712142eebc47f1bf63187b5255"} err="failed to get container status \"bf1eefcb0dfe1d5598a1657ce64f9d70b59145712142eebc47f1bf63187b5255\": rpc error: code = NotFound desc = could not find container \"bf1eefcb0dfe1d5598a1657ce64f9d70b59145712142eebc47f1bf63187b5255\": container with ID starting with bf1eefcb0dfe1d5598a1657ce64f9d70b59145712142eebc47f1bf63187b5255 not found: ID does not exist"
Nov 02 08:39:45.406174 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.406133    6210 scope.go:122] "RemoveContainer" containerID="e7dd7dd969e81f62523731ca68477356ae42c250df5e5142ebd5609640f2b499"
Nov 02 08:39:45.412557 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.412532    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/49b40212-55da-41b0-904e-cbab2dc73648-tls-certs\" (UniqueName: \"kubernetes.io/secret/49b40212-55da-41b0-904e-cbab2dc73648-tls-certs\") pod \"49b40212-55da-41b0-904e-cbab2dc73648\" (UID: \"49b40212-55da-41b0-904e-cbab2dc73648\") "
Nov 02 08:39:45.412640 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.412626    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5d4395c6-343b-4ed5-97f5-7bb40dec980b-kube-api-access-l225n\" (UniqueName: \"kubernetes.io/projected/5d4395c6-343b-4ed5-97f5-7bb40dec980b-kube-api-access-l225n\") pod \"5d4395c6-343b-4ed5-97f5-7bb40dec980b\" (UID: \"5d4395c6-343b-4ed5-97f5-7bb40dec980b\") "
Nov 02 08:39:45.412692 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.412663    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/007e502b-178a-4249-a138-f583cc7a4508-home\" (UniqueName: \"kubernetes.io/empty-dir/007e502b-178a-4249-a138-f583cc7a4508-home\") pod \"007e502b-178a-4249-a138-f583cc7a4508\" (UID: \"007e502b-178a-4249-a138-f583cc7a4508\") "
Nov 02 08:39:45.412738 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.412719    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/007e502b-178a-4249-a138-f583cc7a4508-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/007e502b-178a-4249-a138-f583cc7a4508-model-cache\") pod \"007e502b-178a-4249-a138-f583cc7a4508\" (UID: \"007e502b-178a-4249-a138-f583cc7a4508\") "
Nov 02 08:39:45.412787 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.412771    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/49b40212-55da-41b0-904e-cbab2dc73648-dshm\" (UniqueName: \"kubernetes.io/empty-dir/49b40212-55da-41b0-904e-cbab2dc73648-dshm\") pod \"49b40212-55da-41b0-904e-cbab2dc73648\" (UID: \"49b40212-55da-41b0-904e-cbab2dc73648\") "
Nov 02 08:39:45.412833 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.412803    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5d4395c6-343b-4ed5-97f5-7bb40dec980b-dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d4395c6-343b-4ed5-97f5-7bb40dec980b-dshm\") pod \"5d4395c6-343b-4ed5-97f5-7bb40dec980b\" (UID: \"5d4395c6-343b-4ed5-97f5-7bb40dec980b\") "
Nov 02 08:39:45.412868 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.412850    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/49b40212-55da-41b0-904e-cbab2dc73648-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49b40212-55da-41b0-904e-cbab2dc73648-model-cache\") pod \"49b40212-55da-41b0-904e-cbab2dc73648\" (UID: \"49b40212-55da-41b0-904e-cbab2dc73648\") "
Nov 02 08:39:45.412956 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.412924    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5d4395c6-343b-4ed5-97f5-7bb40dec980b-tls-certs\" (UniqueName: \"kubernetes.io/secret/5d4395c6-343b-4ed5-97f5-7bb40dec980b-tls-certs\") pod \"5d4395c6-343b-4ed5-97f5-7bb40dec980b\" (UID: \"5d4395c6-343b-4ed5-97f5-7bb40dec980b\") "
Nov 02 08:39:45.413018 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.412941    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/007e502b-178a-4249-a138-f583cc7a4508-home" pod "007e502b-178a-4249-a138-f583cc7a4508" (UID: "007e502b-178a-4249-a138-f583cc7a4508"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:39:45.413018 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.412960    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/007e502b-178a-4249-a138-f583cc7a4508-dshm\" (UniqueName: \"kubernetes.io/empty-dir/007e502b-178a-4249-a138-f583cc7a4508-dshm\") pod \"007e502b-178a-4249-a138-f583cc7a4508\" (UID: \"007e502b-178a-4249-a138-f583cc7a4508\") "
Nov 02 08:39:45.413122 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.413038    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/49b40212-55da-41b0-904e-cbab2dc73648-home\" (UniqueName: \"kubernetes.io/empty-dir/49b40212-55da-41b0-904e-cbab2dc73648-home\") pod \"49b40212-55da-41b0-904e-cbab2dc73648\" (UID: \"49b40212-55da-41b0-904e-cbab2dc73648\") "
Nov 02 08:39:45.413300 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.413221    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5d4395c6-343b-4ed5-97f5-7bb40dec980b-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d4395c6-343b-4ed5-97f5-7bb40dec980b-model-cache\") pod \"5d4395c6-343b-4ed5-97f5-7bb40dec980b\" (UID: \"5d4395c6-343b-4ed5-97f5-7bb40dec980b\") "
Nov 02 08:39:45.413300 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.413260    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/49b40212-55da-41b0-904e-cbab2dc73648-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49b40212-55da-41b0-904e-cbab2dc73648-tmp-dir\") pod \"49b40212-55da-41b0-904e-cbab2dc73648\" (UID: \"49b40212-55da-41b0-904e-cbab2dc73648\") "
Nov 02 08:39:45.413431 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.413329    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/007e502b-178a-4249-a138-f583cc7a4508-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/007e502b-178a-4249-a138-f583cc7a4508-tmp-dir\") pod \"007e502b-178a-4249-a138-f583cc7a4508\" (UID: \"007e502b-178a-4249-a138-f583cc7a4508\") "
Nov 02 08:39:45.413431 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.413402    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5d4395c6-343b-4ed5-97f5-7bb40dec980b-home\" (UniqueName: \"kubernetes.io/empty-dir/5d4395c6-343b-4ed5-97f5-7bb40dec980b-home\") pod \"5d4395c6-343b-4ed5-97f5-7bb40dec980b\" (UID: \"5d4395c6-343b-4ed5-97f5-7bb40dec980b\") "
Nov 02 08:39:45.413717 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.413436    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/007e502b-178a-4249-a138-f583cc7a4508-tls-certs\" (UniqueName: \"kubernetes.io/secret/007e502b-178a-4249-a138-f583cc7a4508-tls-certs\") pod \"007e502b-178a-4249-a138-f583cc7a4508\" (UID: \"007e502b-178a-4249-a138-f583cc7a4508\") "
Nov 02 08:39:45.413717 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.413435    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49b40212-55da-41b0-904e-cbab2dc73648-model-cache" pod "49b40212-55da-41b0-904e-cbab2dc73648" (UID: "49b40212-55da-41b0-904e-cbab2dc73648"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:39:45.413717 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.413469    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/49b40212-55da-41b0-904e-cbab2dc73648-kube-api-access-w8jv7\" (UniqueName: \"kubernetes.io/projected/49b40212-55da-41b0-904e-cbab2dc73648-kube-api-access-w8jv7\") pod \"49b40212-55da-41b0-904e-cbab2dc73648\" (UID: \"49b40212-55da-41b0-904e-cbab2dc73648\") "
Nov 02 08:39:45.413717 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.413477    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/007e502b-178a-4249-a138-f583cc7a4508-model-cache" pod "007e502b-178a-4249-a138-f583cc7a4508" (UID: "007e502b-178a-4249-a138-f583cc7a4508"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:39:45.413717 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.413627    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/007e502b-178a-4249-a138-f583cc7a4508-kube-api-access-lw2m4\" (UniqueName: \"kubernetes.io/projected/007e502b-178a-4249-a138-f583cc7a4508-kube-api-access-lw2m4\") pod \"007e502b-178a-4249-a138-f583cc7a4508\" (UID: \"007e502b-178a-4249-a138-f583cc7a4508\") "
Nov 02 08:39:45.413717 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.413675    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5d4395c6-343b-4ed5-97f5-7bb40dec980b-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d4395c6-343b-4ed5-97f5-7bb40dec980b-tmp-dir\") pod \"5d4395c6-343b-4ed5-97f5-7bb40dec980b\" (UID: \"5d4395c6-343b-4ed5-97f5-7bb40dec980b\") "
Nov 02 08:39:45.414402 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.413715    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/007e502b-178a-4249-a138-f583cc7a4508-tmp-dir" pod "007e502b-178a-4249-a138-f583cc7a4508" (UID: "007e502b-178a-4249-a138-f583cc7a4508"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:39:45.414402 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.413925    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49b40212-55da-41b0-904e-cbab2dc73648-home" pod "49b40212-55da-41b0-904e-cbab2dc73648" (UID: "49b40212-55da-41b0-904e-cbab2dc73648"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:39:45.414402 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.414145    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d4395c6-343b-4ed5-97f5-7bb40dec980b-model-cache" pod "5d4395c6-343b-4ed5-97f5-7bb40dec980b" (UID: "5d4395c6-343b-4ed5-97f5-7bb40dec980b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:39:45.414402 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.414342    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d4395c6-343b-4ed5-97f5-7bb40dec980b-tmp-dir" pod "5d4395c6-343b-4ed5-97f5-7bb40dec980b" (UID: "5d4395c6-343b-4ed5-97f5-7bb40dec980b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:39:45.414402 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.414151    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49b40212-55da-41b0-904e-cbab2dc73648-tmp-dir" pod "49b40212-55da-41b0-904e-cbab2dc73648" (UID: "49b40212-55da-41b0-904e-cbab2dc73648"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:39:45.414642 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.414524    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d4395c6-343b-4ed5-97f5-7bb40dec980b-home" pod "5d4395c6-343b-4ed5-97f5-7bb40dec980b" (UID: "5d4395c6-343b-4ed5-97f5-7bb40dec980b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:39:45.414642 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.414560    6210 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/007e502b-178a-4249-a138-f583cc7a4508-model-cache\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:45.414642 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.414581    6210 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49b40212-55da-41b0-904e-cbab2dc73648-model-cache\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:45.414642 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.414597    6210 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49b40212-55da-41b0-904e-cbab2dc73648-home\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:45.414642 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.414611    6210 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d4395c6-343b-4ed5-97f5-7bb40dec980b-model-cache\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:45.414642 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.414625    6210 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49b40212-55da-41b0-904e-cbab2dc73648-tmp-dir\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:45.414642 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.414639    6210 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/007e502b-178a-4249-a138-f583cc7a4508-tmp-dir\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:45.415055 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.414651    6210 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d4395c6-343b-4ed5-97f5-7bb40dec980b-tmp-dir\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:45.415055 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.414665    6210 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/007e502b-178a-4249-a138-f583cc7a4508-home\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:45.415428 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.415405    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/007e502b-178a-4249-a138-f583cc7a4508-dshm" pod "007e502b-178a-4249-a138-f583cc7a4508" (UID: "007e502b-178a-4249-a138-f583cc7a4508"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:39:45.415742 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.415714    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d4395c6-343b-4ed5-97f5-7bb40dec980b-kube-api-access-l225n" pod "5d4395c6-343b-4ed5-97f5-7bb40dec980b" (UID: "5d4395c6-343b-4ed5-97f5-7bb40dec980b"). InnerVolumeSpecName "kube-api-access-l225n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:39:45.415853 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.415834    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49b40212-55da-41b0-904e-cbab2dc73648-tls-certs" pod "49b40212-55da-41b0-904e-cbab2dc73648" (UID: "49b40212-55da-41b0-904e-cbab2dc73648"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:39:45.416576 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.416556    6210 scope.go:122] "RemoveContainer" containerID="e7dd7dd969e81f62523731ca68477356ae42c250df5e5142ebd5609640f2b499"
Nov 02 08:39:45.416697 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.416677    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d4395c6-343b-4ed5-97f5-7bb40dec980b-tls-certs" pod "5d4395c6-343b-4ed5-97f5-7bb40dec980b" (UID: "5d4395c6-343b-4ed5-97f5-7bb40dec980b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:39:45.416983 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:39:45.416907    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7dd7dd969e81f62523731ca68477356ae42c250df5e5142ebd5609640f2b499\": container with ID starting with e7dd7dd969e81f62523731ca68477356ae42c250df5e5142ebd5609640f2b499 not found: ID does not exist" containerID="e7dd7dd969e81f62523731ca68477356ae42c250df5e5142ebd5609640f2b499"
Nov 02 08:39:45.416983 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.416945    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7dd7dd969e81f62523731ca68477356ae42c250df5e5142ebd5609640f2b499"} err="failed to get container status \"e7dd7dd969e81f62523731ca68477356ae42c250df5e5142ebd5609640f2b499\": rpc error: code = NotFound desc = could not find container \"e7dd7dd969e81f62523731ca68477356ae42c250df5e5142ebd5609640f2b499\": container with ID starting with e7dd7dd969e81f62523731ca68477356ae42c250df5e5142ebd5609640f2b499 not found: ID does not exist"
Nov 02 08:39:45.416983 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.416967    6210 scope.go:122] "RemoveContainer" containerID="cf04a5a17cc494bdd45a048937cfbde46d3db3b86ce8ebf18ad33a1527087c0d"
Nov 02 08:39:45.417212 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.416985    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d4395c6-343b-4ed5-97f5-7bb40dec980b-dshm" pod "5d4395c6-343b-4ed5-97f5-7bb40dec980b" (UID: "5d4395c6-343b-4ed5-97f5-7bb40dec980b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:39:45.417269 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.417211    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/007e502b-178a-4249-a138-f583cc7a4508-kube-api-access-lw2m4" pod "007e502b-178a-4249-a138-f583cc7a4508" (UID: "007e502b-178a-4249-a138-f583cc7a4508"). InnerVolumeSpecName "kube-api-access-lw2m4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:39:45.417365 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.417344    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49b40212-55da-41b0-904e-cbab2dc73648-kube-api-access-w8jv7" pod "49b40212-55da-41b0-904e-cbab2dc73648" (UID: "49b40212-55da-41b0-904e-cbab2dc73648"). InnerVolumeSpecName "kube-api-access-w8jv7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:39:45.417595 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.417576    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/007e502b-178a-4249-a138-f583cc7a4508-tls-certs" pod "007e502b-178a-4249-a138-f583cc7a4508" (UID: "007e502b-178a-4249-a138-f583cc7a4508"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:39:45.418046 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.418029    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49b40212-55da-41b0-904e-cbab2dc73648-dshm" pod "49b40212-55da-41b0-904e-cbab2dc73648" (UID: "49b40212-55da-41b0-904e-cbab2dc73648"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:39:45.426066 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.426048    6210 scope.go:122] "RemoveContainer" containerID="cf04a5a17cc494bdd45a048937cfbde46d3db3b86ce8ebf18ad33a1527087c0d"
Nov 02 08:39:45.426329 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:39:45.426307    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf04a5a17cc494bdd45a048937cfbde46d3db3b86ce8ebf18ad33a1527087c0d\": container with ID starting with cf04a5a17cc494bdd45a048937cfbde46d3db3b86ce8ebf18ad33a1527087c0d not found: ID does not exist" containerID="cf04a5a17cc494bdd45a048937cfbde46d3db3b86ce8ebf18ad33a1527087c0d"
Nov 02 08:39:45.426388 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.426337    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf04a5a17cc494bdd45a048937cfbde46d3db3b86ce8ebf18ad33a1527087c0d"} err="failed to get container status \"cf04a5a17cc494bdd45a048937cfbde46d3db3b86ce8ebf18ad33a1527087c0d\": rpc error: code = NotFound desc = could not find container \"cf04a5a17cc494bdd45a048937cfbde46d3db3b86ce8ebf18ad33a1527087c0d\": container with ID starting with cf04a5a17cc494bdd45a048937cfbde46d3db3b86ce8ebf18ad33a1527087c0d not found: ID does not exist"
Nov 02 08:39:45.532966 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.532303    6210 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d4395c6-343b-4ed5-97f5-7bb40dec980b-home\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:45.532966 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.532339    6210 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/007e502b-178a-4249-a138-f583cc7a4508-tls-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:45.532966 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.532353    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8jv7\" (UniqueName: \"kubernetes.io/projected/49b40212-55da-41b0-904e-cbab2dc73648-kube-api-access-w8jv7\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:45.532966 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.532368    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lw2m4\" (UniqueName: \"kubernetes.io/projected/007e502b-178a-4249-a138-f583cc7a4508-kube-api-access-lw2m4\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:45.532966 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.532381    6210 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49b40212-55da-41b0-904e-cbab2dc73648-tls-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:45.532966 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.532393    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l225n\" (UniqueName: \"kubernetes.io/projected/5d4395c6-343b-4ed5-97f5-7bb40dec980b-kube-api-access-l225n\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:45.532966 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.532407    6210 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49b40212-55da-41b0-904e-cbab2dc73648-dshm\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:45.532966 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.532421    6210 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d4395c6-343b-4ed5-97f5-7bb40dec980b-dshm\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:45.532966 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.532437    6210 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d4395c6-343b-4ed5-97f5-7bb40dec980b-tls-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:45.532966 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.532452    6210 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/007e502b-178a-4249-a138-f583cc7a4508-dshm\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:45.864614 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.864542    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj"]
Nov 02 08:39:45.871949 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:45.871920    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj"]
Nov 02 08:39:46.116016 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:46.115927    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm"]
Nov 02 08:39:46.120908 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:46.117919    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-108cf9/premium-w3-108cf9-kserve-649d58889b-9pjvm"]
Nov 02 08:39:46.156250 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:46.156217    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j"]
Nov 02 08:39:46.159782 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:46.159759    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-108cf9/distinct-w3-108cf9-kserve-67dffb9475-wqd4j"]
Nov 02 08:39:46.314145 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:46.314098    6210 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-108cf9/simulator-w3-108cf9-kserve-6c6cc96889-pxrwj" podUID="49b40212-55da-41b0-904e-cbab2dc73648" containerName="main" probeResult="failure" output="Get \"https://10.134.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 08:39:46.353225 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:46.353193    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="007e502b-178a-4249-a138-f583cc7a4508" path="/var/lib/kubelet/pods/007e502b-178a-4249-a138-f583cc7a4508/volumes"
Nov 02 08:39:46.353684 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:46.353670    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="49b40212-55da-41b0-904e-cbab2dc73648" path="/var/lib/kubelet/pods/49b40212-55da-41b0-904e-cbab2dc73648/volumes"
Nov 02 08:39:46.354146 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:46.354130    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5d4395c6-343b-4ed5-97f5-7bb40dec980b" path="/var/lib/kubelet/pods/5d4395c6-343b-4ed5-97f5-7bb40dec980b/volumes"
Nov 02 08:39:49.710602 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:49.710565    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"]
Nov 02 08:39:49.711057 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:49.710820    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s" podUID="744edbc8-e19d-4047-a841-a5b0f9b51562" containerName="istio-proxy" containerID="cri-o://33fd284f0cf723aef1e07f1525926b31c3ed2044fd29b21347234d46935aa8e8" gracePeriod=30
Nov 02 08:39:49.728503 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:49.728474    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"]
Nov 02 08:39:49.728687 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:49.728665    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr" podUID="50c20741-ec88-47cf-8b93-23f3ff1ed7cd" containerName="istio-proxy" containerID="cri-o://3b6acf8239f6c4de72ec0be298863dac03e396b1d7a504901c760e2fe9c0afcd" gracePeriod=30
Nov 02 08:39:55.005569 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.005540    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"
Nov 02 08:39:55.036641 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.036612    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"
Nov 02 08:39:55.108946 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.108911    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-workload-certs\") pod \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\" (UID: \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\") "
Nov 02 08:39:55.109142 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.108992    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/744edbc8-e19d-4047-a841-a5b0f9b51562-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/744edbc8-e19d-4047-a841-a5b0f9b51562-istio-data\") pod \"744edbc8-e19d-4047-a841-a5b0f9b51562\" (UID: \"744edbc8-e19d-4047-a841-a5b0f9b51562\") "
Nov 02 08:39:55.109142 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.109036    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/744edbc8-e19d-4047-a841-a5b0f9b51562-kube-api-access-njkp5\" (UniqueName: \"kubernetes.io/projected/744edbc8-e19d-4047-a841-a5b0f9b51562-kube-api-access-njkp5\") pod \"744edbc8-e19d-4047-a841-a5b0f9b51562\" (UID: \"744edbc8-e19d-4047-a841-a5b0f9b51562\") "
Nov 02 08:39:55.109142 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.109076    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-istiod-ca-cert\") pod \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\" (UID: \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\") "
Nov 02 08:39:55.109142 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.109108    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/744edbc8-e19d-4047-a841-a5b0f9b51562-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/744edbc8-e19d-4047-a841-a5b0f9b51562-credential-socket\") pod \"744edbc8-e19d-4047-a841-a5b0f9b51562\" (UID: \"744edbc8-e19d-4047-a841-a5b0f9b51562\") "
Nov 02 08:39:55.109426 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.109142    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-kube-api-access-jq4vn\" (UniqueName: \"kubernetes.io/projected/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-kube-api-access-jq4vn\") pod \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\" (UID: \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\") "
Nov 02 08:39:55.109426 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.109192    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-istio-envoy\") pod \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\" (UID: \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\") "
Nov 02 08:39:55.109426 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.109223    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/744edbc8-e19d-4047-a841-a5b0f9b51562-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/744edbc8-e19d-4047-a841-a5b0f9b51562-workload-socket\") pod \"744edbc8-e19d-4047-a841-a5b0f9b51562\" (UID: \"744edbc8-e19d-4047-a841-a5b0f9b51562\") "
Nov 02 08:39:55.109426 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.109241    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/744edbc8-e19d-4047-a841-a5b0f9b51562-istio-data" pod "744edbc8-e19d-4047-a841-a5b0f9b51562" (UID: "744edbc8-e19d-4047-a841-a5b0f9b51562"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:39:55.109426 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.109258    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-istio-data\") pod \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\" (UID: \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\") "
Nov 02 08:39:55.109426 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.109244    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-workload-certs" pod "50c20741-ec88-47cf-8b93-23f3ff1ed7cd" (UID: "50c20741-ec88-47cf-8b93-23f3ff1ed7cd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:39:55.109426 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.109346    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/744edbc8-e19d-4047-a841-a5b0f9b51562-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/744edbc8-e19d-4047-a841-a5b0f9b51562-istio-envoy\") pod \"744edbc8-e19d-4047-a841-a5b0f9b51562\" (UID: \"744edbc8-e19d-4047-a841-a5b0f9b51562\") "
Nov 02 08:39:55.109426 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.109381    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/744edbc8-e19d-4047-a841-a5b0f9b51562-istio-token\" (UniqueName: \"kubernetes.io/projected/744edbc8-e19d-4047-a841-a5b0f9b51562-istio-token\") pod \"744edbc8-e19d-4047-a841-a5b0f9b51562\" (UID: \"744edbc8-e19d-4047-a841-a5b0f9b51562\") "
Nov 02 08:39:55.109426 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.109414    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-istio-podinfo\") pod \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\" (UID: \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\") "
Nov 02 08:39:55.109847 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.109442    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/744edbc8-e19d-4047-a841-a5b0f9b51562-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/744edbc8-e19d-4047-a841-a5b0f9b51562-istiod-ca-cert\") pod \"744edbc8-e19d-4047-a841-a5b0f9b51562\" (UID: \"744edbc8-e19d-4047-a841-a5b0f9b51562\") "
Nov 02 08:39:55.109847 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.109473    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/744edbc8-e19d-4047-a841-a5b0f9b51562-credential-socket" pod "744edbc8-e19d-4047-a841-a5b0f9b51562" (UID: "744edbc8-e19d-4047-a841-a5b0f9b51562"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:39:55.109847 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.109493    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/744edbc8-e19d-4047-a841-a5b0f9b51562-workload-socket" pod "744edbc8-e19d-4047-a841-a5b0f9b51562" (UID: "744edbc8-e19d-4047-a841-a5b0f9b51562"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:39:55.109847 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.109515    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-istio-token\" (UniqueName: \"kubernetes.io/projected/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-istio-token\") pod \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\" (UID: \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\") "
Nov 02 08:39:55.109847 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.109565    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-istiod-ca-cert" pod "50c20741-ec88-47cf-8b93-23f3ff1ed7cd" (UID: "50c20741-ec88-47cf-8b93-23f3ff1ed7cd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:39:55.109847 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.109583    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-workload-socket\") pod \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\" (UID: \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\") "
Nov 02 08:39:55.109847 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.109675    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/744edbc8-e19d-4047-a841-a5b0f9b51562-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/744edbc8-e19d-4047-a841-a5b0f9b51562-workload-certs\") pod \"744edbc8-e19d-4047-a841-a5b0f9b51562\" (UID: \"744edbc8-e19d-4047-a841-a5b0f9b51562\") "
Nov 02 08:39:55.109847 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.109706    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-credential-socket\") pod \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\" (UID: \"50c20741-ec88-47cf-8b93-23f3ff1ed7cd\") "
Nov 02 08:39:55.109847 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.109769    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/744edbc8-e19d-4047-a841-a5b0f9b51562-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/744edbc8-e19d-4047-a841-a5b0f9b51562-istio-podinfo\") pod \"744edbc8-e19d-4047-a841-a5b0f9b51562\" (UID: \"744edbc8-e19d-4047-a841-a5b0f9b51562\") "
Nov 02 08:39:55.109847 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.109812    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-istio-data" pod "50c20741-ec88-47cf-8b93-23f3ff1ed7cd" (UID: "50c20741-ec88-47cf-8b93-23f3ff1ed7cd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:39:55.110422 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.109953    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/744edbc8-e19d-4047-a841-a5b0f9b51562-istiod-ca-cert" pod "744edbc8-e19d-4047-a841-a5b0f9b51562" (UID: "744edbc8-e19d-4047-a841-a5b0f9b51562"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:39:55.110422 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.110411    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-workload-socket" pod "50c20741-ec88-47cf-8b93-23f3ff1ed7cd" (UID: "50c20741-ec88-47cf-8b93-23f3ff1ed7cd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:39:55.110606 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.110583    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/744edbc8-e19d-4047-a841-a5b0f9b51562-workload-certs" pod "744edbc8-e19d-4047-a841-a5b0f9b51562" (UID: "744edbc8-e19d-4047-a841-a5b0f9b51562"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:39:55.110671 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.110620    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-credential-socket" pod "50c20741-ec88-47cf-8b93-23f3ff1ed7cd" (UID: "50c20741-ec88-47cf-8b93-23f3ff1ed7cd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:39:55.110729 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.110700    6210 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-workload-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:55.110729 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.110720    6210 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-workload-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:55.110847 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.110734    6210 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/744edbc8-e19d-4047-a841-a5b0f9b51562-istio-data\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:55.110847 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.110749    6210 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-istiod-ca-cert\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:55.110847 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.110763    6210 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/744edbc8-e19d-4047-a841-a5b0f9b51562-credential-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:55.110847 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.110777    6210 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/744edbc8-e19d-4047-a841-a5b0f9b51562-workload-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:55.110847 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.110793    6210 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-istio-data\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:55.110847 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.110807    6210 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/744edbc8-e19d-4047-a841-a5b0f9b51562-istiod-ca-cert\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:55.112076 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.112010    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/744edbc8-e19d-4047-a841-a5b0f9b51562-istio-token" pod "744edbc8-e19d-4047-a841-a5b0f9b51562" (UID: "744edbc8-e19d-4047-a841-a5b0f9b51562"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:39:55.112076 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.112042    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-istio-envoy" pod "50c20741-ec88-47cf-8b93-23f3ff1ed7cd" (UID: "50c20741-ec88-47cf-8b93-23f3ff1ed7cd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:39:55.112228 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.112165    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/744edbc8-e19d-4047-a841-a5b0f9b51562-kube-api-access-njkp5" pod "744edbc8-e19d-4047-a841-a5b0f9b51562" (UID: "744edbc8-e19d-4047-a841-a5b0f9b51562"). InnerVolumeSpecName "kube-api-access-njkp5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:39:55.112228 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.112178    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/744edbc8-e19d-4047-a841-a5b0f9b51562-istio-envoy" pod "744edbc8-e19d-4047-a841-a5b0f9b51562" (UID: "744edbc8-e19d-4047-a841-a5b0f9b51562"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:39:55.112299 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.112268    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/744edbc8-e19d-4047-a841-a5b0f9b51562-istio-podinfo" pod "744edbc8-e19d-4047-a841-a5b0f9b51562" (UID: "744edbc8-e19d-4047-a841-a5b0f9b51562"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 08:39:55.112685 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.112663    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-istio-token" pod "50c20741-ec88-47cf-8b93-23f3ff1ed7cd" (UID: "50c20741-ec88-47cf-8b93-23f3ff1ed7cd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:39:55.112869 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.112851    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-kube-api-access-jq4vn" pod "50c20741-ec88-47cf-8b93-23f3ff1ed7cd" (UID: "50c20741-ec88-47cf-8b93-23f3ff1ed7cd"). InnerVolumeSpecName "kube-api-access-jq4vn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:39:55.113336 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.113322    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-istio-podinfo" pod "50c20741-ec88-47cf-8b93-23f3ff1ed7cd" (UID: "50c20741-ec88-47cf-8b93-23f3ff1ed7cd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 08:39:55.211756 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.211724    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njkp5\" (UniqueName: \"kubernetes.io/projected/744edbc8-e19d-4047-a841-a5b0f9b51562-kube-api-access-njkp5\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:55.211756 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.211753    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jq4vn\" (UniqueName: \"kubernetes.io/projected/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-kube-api-access-jq4vn\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:55.211756 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.211763    6210 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-istio-envoy\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:55.212002 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.211772    6210 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/744edbc8-e19d-4047-a841-a5b0f9b51562-istio-envoy\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:55.212002 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.211780    6210 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/744edbc8-e19d-4047-a841-a5b0f9b51562-istio-token\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:55.212002 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.211788    6210 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-istio-podinfo\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:55.212002 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.211797    6210 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-istio-token\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:55.212002 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.211805    6210 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/744edbc8-e19d-4047-a841-a5b0f9b51562-workload-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:55.212002 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.211814    6210 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c20741-ec88-47cf-8b93-23f3ff1ed7cd-credential-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:55.212002 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.211823    6210 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/744edbc8-e19d-4047-a841-a5b0f9b51562-istio-podinfo\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:39:55.464301 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.464271    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc"]
Nov 02 08:39:55.472589 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.472555    6210 generic.go:356] "Generic (PLEG): container finished" podID="50c20741-ec88-47cf-8b93-23f3ff1ed7cd" containerID="3b6acf8239f6c4de72ec0be298863dac03e396b1d7a504901c760e2fe9c0afcd" exitCode=0
Nov 02 08:39:55.472774 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.472609    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"
Nov 02 08:39:55.472774 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.472637    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr" event={"ID":"50c20741-ec88-47cf-8b93-23f3ff1ed7cd","Type":"ContainerDied","Data":"3b6acf8239f6c4de72ec0be298863dac03e396b1d7a504901c760e2fe9c0afcd"}
Nov 02 08:39:55.472774 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.472706    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr" event={"ID":"50c20741-ec88-47cf-8b93-23f3ff1ed7cd","Type":"ContainerDied","Data":"3669e9e24dabbfe74458229cf94a8ca3bcbe3a34855da21c4cbdf702ce4176ce"}
Nov 02 08:39:55.472774 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.472737    6210 scope.go:122] "RemoveContainer" containerID="3b6acf8239f6c4de72ec0be298863dac03e396b1d7a504901c760e2fe9c0afcd"
Nov 02 08:39:55.473375 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.473350    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98"]
Nov 02 08:39:55.481923 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.481896    6210 generic.go:356] "Generic (PLEG): container finished" podID="744edbc8-e19d-4047-a841-a5b0f9b51562" containerID="33fd284f0cf723aef1e07f1525926b31c3ed2044fd29b21347234d46935aa8e8" exitCode=0
Nov 02 08:39:55.482211 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.482191    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"
Nov 02 08:39:55.485465 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.485445    6210 scope.go:122] "RemoveContainer" containerID="3b6acf8239f6c4de72ec0be298863dac03e396b1d7a504901c760e2fe9c0afcd"
Nov 02 08:39:55.485816 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:39:55.485793    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b6acf8239f6c4de72ec0be298863dac03e396b1d7a504901c760e2fe9c0afcd\": container with ID starting with 3b6acf8239f6c4de72ec0be298863dac03e396b1d7a504901c760e2fe9c0afcd not found: ID does not exist" containerID="3b6acf8239f6c4de72ec0be298863dac03e396b1d7a504901c760e2fe9c0afcd"
Nov 02 08:39:55.485939 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.485827    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b6acf8239f6c4de72ec0be298863dac03e396b1d7a504901c760e2fe9c0afcd"} err="failed to get container status \"3b6acf8239f6c4de72ec0be298863dac03e396b1d7a504901c760e2fe9c0afcd\": rpc error: code = NotFound desc = could not find container \"3b6acf8239f6c4de72ec0be298863dac03e396b1d7a504901c760e2fe9c0afcd\": container with ID starting with 3b6acf8239f6c4de72ec0be298863dac03e396b1d7a504901c760e2fe9c0afcd not found: ID does not exist"
Nov 02 08:39:55.485939 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.482037    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s" event={"ID":"744edbc8-e19d-4047-a841-a5b0f9b51562","Type":"ContainerDied","Data":"33fd284f0cf723aef1e07f1525926b31c3ed2044fd29b21347234d46935aa8e8"}
Nov 02 08:39:55.486073 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.486012    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s" event={"ID":"744edbc8-e19d-4047-a841-a5b0f9b51562","Type":"ContainerDied","Data":"068d85f3ca482bf4fe8ff189b637d137537486d62c32701e3d5ffee406f5c136"}
Nov 02 08:39:55.486131 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.486053    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn"]
Nov 02 08:39:55.486131 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.486110    6210 scope.go:122] "RemoveContainer" containerID="33fd284f0cf723aef1e07f1525926b31c3ed2044fd29b21347234d46935aa8e8"
Nov 02 08:39:55.499100 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.499081    6210 scope.go:122] "RemoveContainer" containerID="33fd284f0cf723aef1e07f1525926b31c3ed2044fd29b21347234d46935aa8e8"
Nov 02 08:39:55.499533 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:39:55.499508    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33fd284f0cf723aef1e07f1525926b31c3ed2044fd29b21347234d46935aa8e8\": container with ID starting with 33fd284f0cf723aef1e07f1525926b31c3ed2044fd29b21347234d46935aa8e8 not found: ID does not exist" containerID="33fd284f0cf723aef1e07f1525926b31c3ed2044fd29b21347234d46935aa8e8"
Nov 02 08:39:55.499605 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.499545    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33fd284f0cf723aef1e07f1525926b31c3ed2044fd29b21347234d46935aa8e8"} err="failed to get container status \"33fd284f0cf723aef1e07f1525926b31c3ed2044fd29b21347234d46935aa8e8\": rpc error: code = NotFound desc = could not find container \"33fd284f0cf723aef1e07f1525926b31c3ed2044fd29b21347234d46935aa8e8\": container with ID starting with 33fd284f0cf723aef1e07f1525926b31c3ed2044fd29b21347234d46935aa8e8 not found: ID does not exist"
Nov 02 08:39:55.910802 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.910771    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"]
Nov 02 08:39:55.918215 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:55.918191    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr"]
Nov 02 08:39:56.026542 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:56.026453    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"]
Nov 02 08:39:56.029837 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:56.029813    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s"]
Nov 02 08:39:56.352610 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:56.352531    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="50c20741-ec88-47cf-8b93-23f3ff1ed7cd" path="/var/lib/kubelet/pods/50c20741-ec88-47cf-8b93-23f3ff1ed7cd/volumes"
Nov 02 08:39:56.353056 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:39:56.353041    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="744edbc8-e19d-4047-a841-a5b0f9b51562" path="/var/lib/kubelet/pods/744edbc8-e19d-4047-a841-a5b0f9b51562/volumes"
Nov 02 08:40:00.749154 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:00.749084    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"]
Nov 02 08:40:00.749598 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:00.749385    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927" podUID="36a05f34-aef7-440a-9a18-8c6b9812990a" containerName="istio-proxy" containerID="cri-o://f274b522361c13881bdbbee90abbd59b849f5ee46b54fba1c1fe489f2bafe521" gracePeriod=30
Nov 02 08:40:00.753046 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:00.753014    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"]
Nov 02 08:40:00.754098 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:00.753426    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw" podUID="09185775-6eca-468f-a7c3-9793d2cb43b7" containerName="istio-proxy" containerID="cri-o://b4a33bfb3b0f8d3f0a07fe2652ddb810105e1bda7b97df7d0237069e0420f1ca" gracePeriod=30
Nov 02 08:40:00.759641 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:00.759620    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"]
Nov 02 08:40:00.759845 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:00.759820    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g" podUID="ac5e7ab8-bf7b-43a1-8943-334c1641a3d2" containerName="istio-proxy" containerID="cri-o://e6b1028fd3dd27b9fdd1b492ac2c82e03cf9c49a283dee662894ff6f1362d842" gracePeriod=30
Nov 02 08:40:00.946905 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:40:00.943087    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:40:03.563074 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:03.563038    6210 patch_prober.go:29] interesting pod/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 08:40:03.563495 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:03.563096    6210 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g" podUID="ac5e7ab8-bf7b-43a1-8943-334c1641a3d2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 08:40:03.838269 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:03.838178    6210 patch_prober.go:29] interesting pod/e2e-mt-cba6f9af-openshift-default-db985b657-785dw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 08:40:03.838269 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:03.838238    6210 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw" podUID="09185775-6eca-468f-a7c3-9793d2cb43b7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 08:40:06.073969 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.073937    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"
Nov 02 08:40:06.084224 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.084182    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"
Nov 02 08:40:06.099412 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.099383    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"
Nov 02 08:40:06.141834 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.141804    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/09185775-6eca-468f-a7c3-9793d2cb43b7-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09185775-6eca-468f-a7c3-9793d2cb43b7-istio-podinfo\") pod \"09185775-6eca-468f-a7c3-9793d2cb43b7\" (UID: \"09185775-6eca-468f-a7c3-9793d2cb43b7\") "
Nov 02 08:40:06.142037 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.141849    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/09185775-6eca-468f-a7c3-9793d2cb43b7-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09185775-6eca-468f-a7c3-9793d2cb43b7-workload-certs\") pod \"09185775-6eca-468f-a7c3-9793d2cb43b7\" (UID: \"09185775-6eca-468f-a7c3-9793d2cb43b7\") "
Nov 02 08:40:06.142037 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.141890    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36a05f34-aef7-440a-9a18-8c6b9812990a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36a05f34-aef7-440a-9a18-8c6b9812990a-workload-socket\") pod \"36a05f34-aef7-440a-9a18-8c6b9812990a\" (UID: \"36a05f34-aef7-440a-9a18-8c6b9812990a\") "
Nov 02 08:40:06.142037 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.141926    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/36a05f34-aef7-440a-9a18-8c6b9812990a-istio-token\" (UniqueName: \"kubernetes.io/projected/36a05f34-aef7-440a-9a18-8c6b9812990a-istio-token\") pod \"36a05f34-aef7-440a-9a18-8c6b9812990a\" (UID: \"36a05f34-aef7-440a-9a18-8c6b9812990a\") "
Nov 02 08:40:06.142037 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.141954    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/36a05f34-aef7-440a-9a18-8c6b9812990a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36a05f34-aef7-440a-9a18-8c6b9812990a-istiod-ca-cert\") pod \"36a05f34-aef7-440a-9a18-8c6b9812990a\" (UID: \"36a05f34-aef7-440a-9a18-8c6b9812990a\") "
Nov 02 08:40:06.142037 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.141986    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-workload-certs\") pod \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\" (UID: \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\") "
Nov 02 08:40:06.142037 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.142004    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-istiod-ca-cert\") pod \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\" (UID: \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\") "
Nov 02 08:40:06.142037 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.142022    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/09185775-6eca-468f-a7c3-9793d2cb43b7-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09185775-6eca-468f-a7c3-9793d2cb43b7-credential-socket\") pod \"09185775-6eca-468f-a7c3-9793d2cb43b7\" (UID: \"09185775-6eca-468f-a7c3-9793d2cb43b7\") "
Nov 02 08:40:06.142411 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.142062    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-istio-data\") pod \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\" (UID: \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\") "
Nov 02 08:40:06.142411 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.142142    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/09185775-6eca-468f-a7c3-9793d2cb43b7-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09185775-6eca-468f-a7c3-9793d2cb43b7-istiod-ca-cert\") pod \"09185775-6eca-468f-a7c3-9793d2cb43b7\" (UID: \"09185775-6eca-468f-a7c3-9793d2cb43b7\") "
Nov 02 08:40:06.142411 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.142169    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/09185775-6eca-468f-a7c3-9793d2cb43b7-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09185775-6eca-468f-a7c3-9793d2cb43b7-istio-envoy\") pod \"09185775-6eca-468f-a7c3-9793d2cb43b7\" (UID: \"09185775-6eca-468f-a7c3-9793d2cb43b7\") "
Nov 02 08:40:06.142411 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.142176    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36a05f34-aef7-440a-9a18-8c6b9812990a-workload-socket" pod "36a05f34-aef7-440a-9a18-8c6b9812990a" (UID: "36a05f34-aef7-440a-9a18-8c6b9812990a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:40:06.142411 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.142183    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09185775-6eca-468f-a7c3-9793d2cb43b7-workload-certs" pod "09185775-6eca-468f-a7c3-9793d2cb43b7" (UID: "09185775-6eca-468f-a7c3-9793d2cb43b7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:40:06.142411 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.142204    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-credential-socket\") pod \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\" (UID: \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\") "
Nov 02 08:40:06.142411 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.142274    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36a05f34-aef7-440a-9a18-8c6b9812990a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36a05f34-aef7-440a-9a18-8c6b9812990a-istio-data\") pod \"36a05f34-aef7-440a-9a18-8c6b9812990a\" (UID: \"36a05f34-aef7-440a-9a18-8c6b9812990a\") "
Nov 02 08:40:06.142411 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.142305    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36a05f34-aef7-440a-9a18-8c6b9812990a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36a05f34-aef7-440a-9a18-8c6b9812990a-workload-certs\") pod \"36a05f34-aef7-440a-9a18-8c6b9812990a\" (UID: \"36a05f34-aef7-440a-9a18-8c6b9812990a\") "
Nov 02 08:40:06.142411 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.142330    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-workload-certs" pod "ac5e7ab8-bf7b-43a1-8943-334c1641a3d2" (UID: "ac5e7ab8-bf7b-43a1-8943-334c1641a3d2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:40:06.142411 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.142346    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-istio-podinfo\") pod \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\" (UID: \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\") "
Nov 02 08:40:06.142411 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.142376    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36a05f34-aef7-440a-9a18-8c6b9812990a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36a05f34-aef7-440a-9a18-8c6b9812990a-credential-socket\") pod \"36a05f34-aef7-440a-9a18-8c6b9812990a\" (UID: \"36a05f34-aef7-440a-9a18-8c6b9812990a\") "
Nov 02 08:40:06.142411 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.142410    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-istio-envoy\") pod \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\" (UID: \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\") "
Nov 02 08:40:06.143061 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.142449    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-istio-token\" (UniqueName: \"kubernetes.io/projected/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-istio-token\") pod \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\" (UID: \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\") "
Nov 02 08:40:06.143061 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.142528    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-workload-socket\") pod \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\" (UID: \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\") "
Nov 02 08:40:06.143061 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.142538    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36a05f34-aef7-440a-9a18-8c6b9812990a-istiod-ca-cert" pod "36a05f34-aef7-440a-9a18-8c6b9812990a" (UID: "36a05f34-aef7-440a-9a18-8c6b9812990a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:40:06.143061 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.142569    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/36a05f34-aef7-440a-9a18-8c6b9812990a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36a05f34-aef7-440a-9a18-8c6b9812990a-istio-podinfo\") pod \"36a05f34-aef7-440a-9a18-8c6b9812990a\" (UID: \"36a05f34-aef7-440a-9a18-8c6b9812990a\") "
Nov 02 08:40:06.143061 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.142571    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09185775-6eca-468f-a7c3-9793d2cb43b7-istiod-ca-cert" pod "09185775-6eca-468f-a7c3-9793d2cb43b7" (UID: "09185775-6eca-468f-a7c3-9793d2cb43b7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:40:06.143061 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.142624    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/09185775-6eca-468f-a7c3-9793d2cb43b7-istio-token\" (UniqueName: \"kubernetes.io/projected/09185775-6eca-468f-a7c3-9793d2cb43b7-istio-token\") pod \"09185775-6eca-468f-a7c3-9793d2cb43b7\" (UID: \"09185775-6eca-468f-a7c3-9793d2cb43b7\") "
Nov 02 08:40:06.143061 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.142667    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/09185775-6eca-468f-a7c3-9793d2cb43b7-kube-api-access-9qx5s\" (UniqueName: \"kubernetes.io/projected/09185775-6eca-468f-a7c3-9793d2cb43b7-kube-api-access-9qx5s\") pod \"09185775-6eca-468f-a7c3-9793d2cb43b7\" (UID: \"09185775-6eca-468f-a7c3-9793d2cb43b7\") "
Nov 02 08:40:06.143061 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.142740    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/09185775-6eca-468f-a7c3-9793d2cb43b7-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09185775-6eca-468f-a7c3-9793d2cb43b7-workload-socket\") pod \"09185775-6eca-468f-a7c3-9793d2cb43b7\" (UID: \"09185775-6eca-468f-a7c3-9793d2cb43b7\") "
Nov 02 08:40:06.143061 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.142785    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09185775-6eca-468f-a7c3-9793d2cb43b7-credential-socket" pod "09185775-6eca-468f-a7c3-9793d2cb43b7" (UID: "09185775-6eca-468f-a7c3-9793d2cb43b7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:40:06.143061 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.142801    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/09185775-6eca-468f-a7c3-9793d2cb43b7-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09185775-6eca-468f-a7c3-9793d2cb43b7-istio-data\") pod \"09185775-6eca-468f-a7c3-9793d2cb43b7\" (UID: \"09185775-6eca-468f-a7c3-9793d2cb43b7\") "
Nov 02 08:40:06.143061 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.142828    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36a05f34-aef7-440a-9a18-8c6b9812990a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36a05f34-aef7-440a-9a18-8c6b9812990a-istio-envoy\") pod \"36a05f34-aef7-440a-9a18-8c6b9812990a\" (UID: \"36a05f34-aef7-440a-9a18-8c6b9812990a\") "
Nov 02 08:40:06.143061 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.142830    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-credential-socket" pod "ac5e7ab8-bf7b-43a1-8943-334c1641a3d2" (UID: "ac5e7ab8-bf7b-43a1-8943-334c1641a3d2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:40:06.143061 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.142858    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-istiod-ca-cert" pod "ac5e7ab8-bf7b-43a1-8943-334c1641a3d2" (UID: "ac5e7ab8-bf7b-43a1-8943-334c1641a3d2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:40:06.143061 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.142867    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-kube-api-access-lrpzd\" (UniqueName: \"kubernetes.io/projected/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-kube-api-access-lrpzd\") pod \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\" (UID: \"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2\") "
Nov 02 08:40:06.143061 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.142946    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/36a05f34-aef7-440a-9a18-8c6b9812990a-kube-api-access-zxvtv\" (UniqueName: \"kubernetes.io/projected/36a05f34-aef7-440a-9a18-8c6b9812990a-kube-api-access-zxvtv\") pod \"36a05f34-aef7-440a-9a18-8c6b9812990a\" (UID: \"36a05f34-aef7-440a-9a18-8c6b9812990a\") "
Nov 02 08:40:06.144733 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.143343    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-istio-data" pod "ac5e7ab8-bf7b-43a1-8943-334c1641a3d2" (UID: "ac5e7ab8-bf7b-43a1-8943-334c1641a3d2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:40:06.144733 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.143742    6210 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09185775-6eca-468f-a7c3-9793d2cb43b7-workload-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:06.144733 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.143766    6210 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36a05f34-aef7-440a-9a18-8c6b9812990a-workload-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:06.144733 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.143781    6210 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36a05f34-aef7-440a-9a18-8c6b9812990a-istiod-ca-cert\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:06.144733 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.143796    6210 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-workload-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:06.144733 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.143810    6210 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-istiod-ca-cert\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:06.144733 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.143824    6210 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09185775-6eca-468f-a7c3-9793d2cb43b7-credential-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:06.144733 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.143837    6210 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-istio-data\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:06.144733 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.143851    6210 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09185775-6eca-468f-a7c3-9793d2cb43b7-istiod-ca-cert\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:06.144733 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.143866    6210 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-credential-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:06.144733 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.144059    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36a05f34-aef7-440a-9a18-8c6b9812990a-credential-socket" pod "36a05f34-aef7-440a-9a18-8c6b9812990a" (UID: "36a05f34-aef7-440a-9a18-8c6b9812990a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:40:06.144733 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.144343    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09185775-6eca-468f-a7c3-9793d2cb43b7-workload-socket" pod "09185775-6eca-468f-a7c3-9793d2cb43b7" (UID: "09185775-6eca-468f-a7c3-9793d2cb43b7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:40:06.144733 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.144364    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36a05f34-aef7-440a-9a18-8c6b9812990a-istio-data" pod "36a05f34-aef7-440a-9a18-8c6b9812990a" (UID: "36a05f34-aef7-440a-9a18-8c6b9812990a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:40:06.144733 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.144525    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09185775-6eca-468f-a7c3-9793d2cb43b7-istio-data" pod "09185775-6eca-468f-a7c3-9793d2cb43b7" (UID: "09185775-6eca-468f-a7c3-9793d2cb43b7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:40:06.144733 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.144545    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36a05f34-aef7-440a-9a18-8c6b9812990a-workload-certs" pod "36a05f34-aef7-440a-9a18-8c6b9812990a" (UID: "36a05f34-aef7-440a-9a18-8c6b9812990a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:40:06.145626 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.145446    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-workload-socket" pod "ac5e7ab8-bf7b-43a1-8943-334c1641a3d2" (UID: "ac5e7ab8-bf7b-43a1-8943-334c1641a3d2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:40:06.146114 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.146078    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/09185775-6eca-468f-a7c3-9793d2cb43b7-istio-podinfo" pod "09185775-6eca-468f-a7c3-9793d2cb43b7" (UID: "09185775-6eca-468f-a7c3-9793d2cb43b7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 08:40:06.146219 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.146167    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-kube-api-access-lrpzd" pod "ac5e7ab8-bf7b-43a1-8943-334c1641a3d2" (UID: "ac5e7ab8-bf7b-43a1-8943-334c1641a3d2"). InnerVolumeSpecName "kube-api-access-lrpzd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:40:06.146219 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.146184    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36a05f34-aef7-440a-9a18-8c6b9812990a-istio-token" pod "36a05f34-aef7-440a-9a18-8c6b9812990a" (UID: "36a05f34-aef7-440a-9a18-8c6b9812990a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:40:06.146308 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.146205    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36a05f34-aef7-440a-9a18-8c6b9812990a-kube-api-access-zxvtv" pod "36a05f34-aef7-440a-9a18-8c6b9812990a" (UID: "36a05f34-aef7-440a-9a18-8c6b9812990a"). InnerVolumeSpecName "kube-api-access-zxvtv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:40:06.146694 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.146665    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/36a05f34-aef7-440a-9a18-8c6b9812990a-istio-podinfo" pod "36a05f34-aef7-440a-9a18-8c6b9812990a" (UID: "36a05f34-aef7-440a-9a18-8c6b9812990a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 08:40:06.147051 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.146984    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09185775-6eca-468f-a7c3-9793d2cb43b7-istio-envoy" pod "09185775-6eca-468f-a7c3-9793d2cb43b7" (UID: "09185775-6eca-468f-a7c3-9793d2cb43b7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:40:06.147580 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.147545    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-istio-podinfo" pod "ac5e7ab8-bf7b-43a1-8943-334c1641a3d2" (UID: "ac5e7ab8-bf7b-43a1-8943-334c1641a3d2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 08:40:06.148178 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.148142    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09185775-6eca-468f-a7c3-9793d2cb43b7-istio-token" pod "09185775-6eca-468f-a7c3-9793d2cb43b7" (UID: "09185775-6eca-468f-a7c3-9793d2cb43b7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:40:06.148178 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.148153    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-istio-envoy" pod "ac5e7ab8-bf7b-43a1-8943-334c1641a3d2" (UID: "ac5e7ab8-bf7b-43a1-8943-334c1641a3d2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:40:06.148411 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.148390    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09185775-6eca-468f-a7c3-9793d2cb43b7-kube-api-access-9qx5s" pod "09185775-6eca-468f-a7c3-9793d2cb43b7" (UID: "09185775-6eca-468f-a7c3-9793d2cb43b7"). InnerVolumeSpecName "kube-api-access-9qx5s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:40:06.148819 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.148798    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-istio-token" pod "ac5e7ab8-bf7b-43a1-8943-334c1641a3d2" (UID: "ac5e7ab8-bf7b-43a1-8943-334c1641a3d2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:40:06.148869 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.148834    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36a05f34-aef7-440a-9a18-8c6b9812990a-istio-envoy" pod "36a05f34-aef7-440a-9a18-8c6b9812990a" (UID: "36a05f34-aef7-440a-9a18-8c6b9812990a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:40:06.245859 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.245825    6210 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36a05f34-aef7-440a-9a18-8c6b9812990a-istio-data\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:06.245859 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.245854    6210 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36a05f34-aef7-440a-9a18-8c6b9812990a-workload-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:06.245859 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.245870    6210 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-istio-podinfo\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:06.246147 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.245915    6210 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36a05f34-aef7-440a-9a18-8c6b9812990a-credential-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:06.246147 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.245929    6210 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-istio-envoy\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:06.246147 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.245939    6210 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-istio-token\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:06.246147 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.245948    6210 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-workload-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:06.246147 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.245959    6210 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36a05f34-aef7-440a-9a18-8c6b9812990a-istio-podinfo\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:06.246147 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.245967    6210 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09185775-6eca-468f-a7c3-9793d2cb43b7-istio-token\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:06.246147 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.245979    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qx5s\" (UniqueName: \"kubernetes.io/projected/09185775-6eca-468f-a7c3-9793d2cb43b7-kube-api-access-9qx5s\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:06.246147 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.245994    6210 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09185775-6eca-468f-a7c3-9793d2cb43b7-workload-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:06.246147 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.246009    6210 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09185775-6eca-468f-a7c3-9793d2cb43b7-istio-data\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:06.246147 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.246019    6210 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36a05f34-aef7-440a-9a18-8c6b9812990a-istio-envoy\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:06.246147 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.246028    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrpzd\" (UniqueName: \"kubernetes.io/projected/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2-kube-api-access-lrpzd\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:06.246147 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.246036    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxvtv\" (UniqueName: \"kubernetes.io/projected/36a05f34-aef7-440a-9a18-8c6b9812990a-kube-api-access-zxvtv\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:06.246147 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.246044    6210 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09185775-6eca-468f-a7c3-9793d2cb43b7-istio-podinfo\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:06.246147 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.246057    6210 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36a05f34-aef7-440a-9a18-8c6b9812990a-istio-token\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:06.246147 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.246069    6210 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09185775-6eca-468f-a7c3-9793d2cb43b7-istio-envoy\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:06.570233 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.570196    6210 generic.go:356] "Generic (PLEG): container finished" podID="36a05f34-aef7-440a-9a18-8c6b9812990a" containerID="f274b522361c13881bdbbee90abbd59b849f5ee46b54fba1c1fe489f2bafe521" exitCode=0
Nov 02 08:40:06.570425 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.570243    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"
Nov 02 08:40:06.570425 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.570282    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927" event={"ID":"36a05f34-aef7-440a-9a18-8c6b9812990a","Type":"ContainerDied","Data":"f274b522361c13881bdbbee90abbd59b849f5ee46b54fba1c1fe489f2bafe521"}
Nov 02 08:40:06.570425 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.570344    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927" event={"ID":"36a05f34-aef7-440a-9a18-8c6b9812990a","Type":"ContainerDied","Data":"ae9178a638eb47cd5f04168d481a7967375e17db72cfe67fe1c6636c0e366226"}
Nov 02 08:40:06.570425 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.570377    6210 scope.go:122] "RemoveContainer" containerID="f274b522361c13881bdbbee90abbd59b849f5ee46b54fba1c1fe489f2bafe521"
Nov 02 08:40:06.571800 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.571774    6210 generic.go:356] "Generic (PLEG): container finished" podID="ac5e7ab8-bf7b-43a1-8943-334c1641a3d2" containerID="e6b1028fd3dd27b9fdd1b492ac2c82e03cf9c49a283dee662894ff6f1362d842" exitCode=0
Nov 02 08:40:06.571943 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.571825    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"
Nov 02 08:40:06.571943 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.571914    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g" event={"ID":"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2","Type":"ContainerDied","Data":"e6b1028fd3dd27b9fdd1b492ac2c82e03cf9c49a283dee662894ff6f1362d842"}
Nov 02 08:40:06.572086 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.571959    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g" event={"ID":"ac5e7ab8-bf7b-43a1-8943-334c1641a3d2","Type":"ContainerDied","Data":"074ed35f25b270dfa4ab57a3a9b3e1342eca076085bf0366989d431d4db47ffd"}
Nov 02 08:40:06.573751 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.573611    6210 generic.go:356] "Generic (PLEG): container finished" podID="09185775-6eca-468f-a7c3-9793d2cb43b7" containerID="b4a33bfb3b0f8d3f0a07fe2652ddb810105e1bda7b97df7d0237069e0420f1ca" exitCode=0
Nov 02 08:40:06.573751 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.573636    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw" event={"ID":"09185775-6eca-468f-a7c3-9793d2cb43b7","Type":"ContainerDied","Data":"b4a33bfb3b0f8d3f0a07fe2652ddb810105e1bda7b97df7d0237069e0420f1ca"}
Nov 02 08:40:06.573751 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.573663    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"
Nov 02 08:40:06.573751 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.573678    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw" event={"ID":"09185775-6eca-468f-a7c3-9793d2cb43b7","Type":"ContainerDied","Data":"fe8dde3e00c3a49a5e8bcd7b0a9a19a7fed8aaffc8471ea18a3f36ac2dffa780"}
Nov 02 08:40:06.583508 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.583160    6210 scope.go:122] "RemoveContainer" containerID="f274b522361c13881bdbbee90abbd59b849f5ee46b54fba1c1fe489f2bafe521"
Nov 02 08:40:06.583775 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:40:06.583747    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f274b522361c13881bdbbee90abbd59b849f5ee46b54fba1c1fe489f2bafe521\": container with ID starting with f274b522361c13881bdbbee90abbd59b849f5ee46b54fba1c1fe489f2bafe521 not found: ID does not exist" containerID="f274b522361c13881bdbbee90abbd59b849f5ee46b54fba1c1fe489f2bafe521"
Nov 02 08:40:06.583918 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.583787    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f274b522361c13881bdbbee90abbd59b849f5ee46b54fba1c1fe489f2bafe521"} err="failed to get container status \"f274b522361c13881bdbbee90abbd59b849f5ee46b54fba1c1fe489f2bafe521\": rpc error: code = NotFound desc = could not find container \"f274b522361c13881bdbbee90abbd59b849f5ee46b54fba1c1fe489f2bafe521\": container with ID starting with f274b522361c13881bdbbee90abbd59b849f5ee46b54fba1c1fe489f2bafe521 not found: ID does not exist"
Nov 02 08:40:06.583918 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.583817    6210 scope.go:122] "RemoveContainer" containerID="e6b1028fd3dd27b9fdd1b492ac2c82e03cf9c49a283dee662894ff6f1362d842"
Nov 02 08:40:06.597548 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.597479    6210 scope.go:122] "RemoveContainer" containerID="e6b1028fd3dd27b9fdd1b492ac2c82e03cf9c49a283dee662894ff6f1362d842"
Nov 02 08:40:06.597938 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:40:06.597912    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6b1028fd3dd27b9fdd1b492ac2c82e03cf9c49a283dee662894ff6f1362d842\": container with ID starting with e6b1028fd3dd27b9fdd1b492ac2c82e03cf9c49a283dee662894ff6f1362d842 not found: ID does not exist" containerID="e6b1028fd3dd27b9fdd1b492ac2c82e03cf9c49a283dee662894ff6f1362d842"
Nov 02 08:40:06.598024 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.597952    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6b1028fd3dd27b9fdd1b492ac2c82e03cf9c49a283dee662894ff6f1362d842"} err="failed to get container status \"e6b1028fd3dd27b9fdd1b492ac2c82e03cf9c49a283dee662894ff6f1362d842\": rpc error: code = NotFound desc = could not find container \"e6b1028fd3dd27b9fdd1b492ac2c82e03cf9c49a283dee662894ff6f1362d842\": container with ID starting with e6b1028fd3dd27b9fdd1b492ac2c82e03cf9c49a283dee662894ff6f1362d842 not found: ID does not exist"
Nov 02 08:40:06.598024 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.597978    6210 scope.go:122] "RemoveContainer" containerID="b4a33bfb3b0f8d3f0a07fe2652ddb810105e1bda7b97df7d0237069e0420f1ca"
Nov 02 08:40:06.611277 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.611246    6210 scope.go:122] "RemoveContainer" containerID="b4a33bfb3b0f8d3f0a07fe2652ddb810105e1bda7b97df7d0237069e0420f1ca"
Nov 02 08:40:06.611707 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:40:06.611678    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4a33bfb3b0f8d3f0a07fe2652ddb810105e1bda7b97df7d0237069e0420f1ca\": container with ID starting with b4a33bfb3b0f8d3f0a07fe2652ddb810105e1bda7b97df7d0237069e0420f1ca not found: ID does not exist" containerID="b4a33bfb3b0f8d3f0a07fe2652ddb810105e1bda7b97df7d0237069e0420f1ca"
Nov 02 08:40:06.611794 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.611726    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4a33bfb3b0f8d3f0a07fe2652ddb810105e1bda7b97df7d0237069e0420f1ca"} err="failed to get container status \"b4a33bfb3b0f8d3f0a07fe2652ddb810105e1bda7b97df7d0237069e0420f1ca\": rpc error: code = NotFound desc = could not find container \"b4a33bfb3b0f8d3f0a07fe2652ddb810105e1bda7b97df7d0237069e0420f1ca\": container with ID starting with b4a33bfb3b0f8d3f0a07fe2652ddb810105e1bda7b97df7d0237069e0420f1ca not found: ID does not exist"
Nov 02 08:40:06.725041 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.725006    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"]
Nov 02 08:40:06.732035 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.731993    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927"]
Nov 02 08:40:06.851007 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.850939    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"]
Nov 02 08:40:06.855909 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.853005    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g"]
Nov 02 08:40:06.955428 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.955391    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"]
Nov 02 08:40:06.959158 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:06.959118    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw"]
Nov 02 08:40:08.383207 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:08.383033    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="09185775-6eca-468f-a7c3-9793d2cb43b7" path="/var/lib/kubelet/pods/09185775-6eca-468f-a7c3-9793d2cb43b7/volumes"
Nov 02 08:40:08.383714 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:08.383681    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="36a05f34-aef7-440a-9a18-8c6b9812990a" path="/var/lib/kubelet/pods/36a05f34-aef7-440a-9a18-8c6b9812990a/volumes"
Nov 02 08:40:08.384367 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:08.384345    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ac5e7ab8-bf7b-43a1-8943-334c1641a3d2" path="/var/lib/kubelet/pods/ac5e7ab8-bf7b-43a1-8943-334c1641a3d2/volumes"
Nov 02 08:40:09.597081 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:09.597048    6210 generic.go:356] "Generic (PLEG): container finished" podID="72cfa2c7-210c-4e18-961b-4676855ffd42" containerID="2e366b5f1b7288abb73fb3a36cbbf866f95406230fb4ec58fbc561a928d9a5dc" exitCode=0
Nov 02 08:40:09.597584 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:09.597095    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2" event={"ID":"72cfa2c7-210c-4e18-961b-4676855ffd42","Type":"ContainerDied","Data":"2e366b5f1b7288abb73fb3a36cbbf866f95406230fb4ec58fbc561a928d9a5dc"}
Nov 02 08:40:09.597584 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:09.597543    6210 scope.go:122] "RemoveContainer" containerID="2e366b5f1b7288abb73fb3a36cbbf866f95406230fb4ec58fbc561a928d9a5dc"
Nov 02 08:40:09.599101 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:09.599072    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:40:09.599195 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:09.599143    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:40:09.599195 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:09.599175    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:40:10.488896 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:10.488843    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc" podUID="5bb9c875-1508-474c-bf31-34e2bacbe3bd" containerName="main" containerID="cri-o://accb0f79ca5064d59aa38ae086061dcbb1c80e9eeb447f52bc1a56dee618daa0" gracePeriod=45
Nov 02 08:40:10.501615 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:10.501575    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98" podUID="dc856144-2439-489a-b4a8-c0a1ddd02cdf" containerName="main" containerID="cri-o://338932fd77bd63f3f75318cdad691439752494232602f7d1f2d604a0853d0373" gracePeriod=45
Nov 02 08:40:10.510313 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:10.510283    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn" podUID="b8490c0b-3384-43b7-a143-6c1db756aafe" containerName="main" containerID="cri-o://fb00fb1c873618b0b3343887eabe78f29f619a570b1734406fd979df30a76a62" gracePeriod=45
Nov 02 08:40:10.549385 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:10.549338    6210 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc" podUID="5bb9c875-1508-474c-bf31-34e2bacbe3bd" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": dial tcp 10.134.0.50:8000: connect: connection refused"
Nov 02 08:40:10.630952 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:10.630919    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2" event={"ID":"72cfa2c7-210c-4e18-961b-4676855ffd42","Type":"ContainerStarted","Data":"bccbe232dec0adb1d25b8c583e9b4c9b0979461ca917c80e28e0df950435d50b"}
Nov 02 08:40:10.980429 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:10.979763    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98"
Nov 02 08:40:10.983038 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:10.983014    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc"
Nov 02 08:40:10.987711 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:10.987684    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn"
Nov 02 08:40:11.087433 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.084995    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:40:11.087433 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.085140    6210 patch_prober.go:29] interesting pod/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused" start-of-body=
Nov 02 08:40:11.087433 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.085193    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2" podUID="72cfa2c7-210c-4e18-961b-4676855ffd42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused"
Nov 02 08:40:11.173943 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.152288    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dc856144-2439-489a-b4a8-c0a1ddd02cdf-kube-api-access-5xv9w\" (UniqueName: \"kubernetes.io/projected/dc856144-2439-489a-b4a8-c0a1ddd02cdf-kube-api-access-5xv9w\") pod \"dc856144-2439-489a-b4a8-c0a1ddd02cdf\" (UID: \"dc856144-2439-489a-b4a8-c0a1ddd02cdf\") "
Nov 02 08:40:11.173943 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.152373    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b8490c0b-3384-43b7-a143-6c1db756aafe-tls-certs\" (UniqueName: \"kubernetes.io/secret/b8490c0b-3384-43b7-a143-6c1db756aafe-tls-certs\") pod \"b8490c0b-3384-43b7-a143-6c1db756aafe\" (UID: \"b8490c0b-3384-43b7-a143-6c1db756aafe\") "
Nov 02 08:40:11.173943 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.152438    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5bb9c875-1508-474c-bf31-34e2bacbe3bd-tls-certs\" (UniqueName: \"kubernetes.io/secret/5bb9c875-1508-474c-bf31-34e2bacbe3bd-tls-certs\") pod \"5bb9c875-1508-474c-bf31-34e2bacbe3bd\" (UID: \"5bb9c875-1508-474c-bf31-34e2bacbe3bd\") "
Nov 02 08:40:11.173943 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.152478    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5bb9c875-1508-474c-bf31-34e2bacbe3bd-home\" (UniqueName: \"kubernetes.io/empty-dir/5bb9c875-1508-474c-bf31-34e2bacbe3bd-home\") pod \"5bb9c875-1508-474c-bf31-34e2bacbe3bd\" (UID: \"5bb9c875-1508-474c-bf31-34e2bacbe3bd\") "
Nov 02 08:40:11.173943 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.152508    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b8490c0b-3384-43b7-a143-6c1db756aafe-dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8490c0b-3384-43b7-a143-6c1db756aafe-dshm\") pod \"b8490c0b-3384-43b7-a143-6c1db756aafe\" (UID: \"b8490c0b-3384-43b7-a143-6c1db756aafe\") "
Nov 02 08:40:11.173943 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.152560    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dc856144-2439-489a-b4a8-c0a1ddd02cdf-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc856144-2439-489a-b4a8-c0a1ddd02cdf-model-cache\") pod \"dc856144-2439-489a-b4a8-c0a1ddd02cdf\" (UID: \"dc856144-2439-489a-b4a8-c0a1ddd02cdf\") "
Nov 02 08:40:11.173943 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.152619    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5bb9c875-1508-474c-bf31-34e2bacbe3bd-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bb9c875-1508-474c-bf31-34e2bacbe3bd-tmp-dir\") pod \"5bb9c875-1508-474c-bf31-34e2bacbe3bd\" (UID: \"5bb9c875-1508-474c-bf31-34e2bacbe3bd\") "
Nov 02 08:40:11.173943 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.152673    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dc856144-2439-489a-b4a8-c0a1ddd02cdf-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc856144-2439-489a-b4a8-c0a1ddd02cdf-tmp-dir\") pod \"dc856144-2439-489a-b4a8-c0a1ddd02cdf\" (UID: \"dc856144-2439-489a-b4a8-c0a1ddd02cdf\") "
Nov 02 08:40:11.173943 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.152706    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b8490c0b-3384-43b7-a143-6c1db756aafe-kube-api-access-d45mp\" (UniqueName: \"kubernetes.io/projected/b8490c0b-3384-43b7-a143-6c1db756aafe-kube-api-access-d45mp\") pod \"b8490c0b-3384-43b7-a143-6c1db756aafe\" (UID: \"b8490c0b-3384-43b7-a143-6c1db756aafe\") "
Nov 02 08:40:11.173943 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.152771    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dc856144-2439-489a-b4a8-c0a1ddd02cdf-dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc856144-2439-489a-b4a8-c0a1ddd02cdf-dshm\") pod \"dc856144-2439-489a-b4a8-c0a1ddd02cdf\" (UID: \"dc856144-2439-489a-b4a8-c0a1ddd02cdf\") "
Nov 02 08:40:11.173943 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.152809    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b8490c0b-3384-43b7-a143-6c1db756aafe-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8490c0b-3384-43b7-a143-6c1db756aafe-tmp-dir\") pod \"b8490c0b-3384-43b7-a143-6c1db756aafe\" (UID: \"b8490c0b-3384-43b7-a143-6c1db756aafe\") "
Nov 02 08:40:11.173943 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.152842    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b8490c0b-3384-43b7-a143-6c1db756aafe-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8490c0b-3384-43b7-a143-6c1db756aafe-model-cache\") pod \"b8490c0b-3384-43b7-a143-6c1db756aafe\" (UID: \"b8490c0b-3384-43b7-a143-6c1db756aafe\") "
Nov 02 08:40:11.173943 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.152902    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dc856144-2439-489a-b4a8-c0a1ddd02cdf-home\" (UniqueName: \"kubernetes.io/empty-dir/dc856144-2439-489a-b4a8-c0a1ddd02cdf-home\") pod \"dc856144-2439-489a-b4a8-c0a1ddd02cdf\" (UID: \"dc856144-2439-489a-b4a8-c0a1ddd02cdf\") "
Nov 02 08:40:11.173943 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.152932    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/dc856144-2439-489a-b4a8-c0a1ddd02cdf-tls-certs\" (UniqueName: \"kubernetes.io/secret/dc856144-2439-489a-b4a8-c0a1ddd02cdf-tls-certs\") pod \"dc856144-2439-489a-b4a8-c0a1ddd02cdf\" (UID: \"dc856144-2439-489a-b4a8-c0a1ddd02cdf\") "
Nov 02 08:40:11.173943 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.152972    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5bb9c875-1508-474c-bf31-34e2bacbe3bd-kube-api-access-69vr4\" (UniqueName: \"kubernetes.io/projected/5bb9c875-1508-474c-bf31-34e2bacbe3bd-kube-api-access-69vr4\") pod \"5bb9c875-1508-474c-bf31-34e2bacbe3bd\" (UID: \"5bb9c875-1508-474c-bf31-34e2bacbe3bd\") "
Nov 02 08:40:11.173943 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.153035    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b8490c0b-3384-43b7-a143-6c1db756aafe-home\" (UniqueName: \"kubernetes.io/empty-dir/b8490c0b-3384-43b7-a143-6c1db756aafe-home\") pod \"b8490c0b-3384-43b7-a143-6c1db756aafe\" (UID: \"b8490c0b-3384-43b7-a143-6c1db756aafe\") "
Nov 02 08:40:11.173943 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.153059    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5bb9c875-1508-474c-bf31-34e2bacbe3bd-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bb9c875-1508-474c-bf31-34e2bacbe3bd-model-cache\") pod \"5bb9c875-1508-474c-bf31-34e2bacbe3bd\" (UID: \"5bb9c875-1508-474c-bf31-34e2bacbe3bd\") "
Nov 02 08:40:11.173943 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.153115    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5bb9c875-1508-474c-bf31-34e2bacbe3bd-dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bb9c875-1508-474c-bf31-34e2bacbe3bd-dshm\") pod \"5bb9c875-1508-474c-bf31-34e2bacbe3bd\" (UID: \"5bb9c875-1508-474c-bf31-34e2bacbe3bd\") "
Nov 02 08:40:11.176485 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.176435    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bb9c875-1508-474c-bf31-34e2bacbe3bd-home" pod "5bb9c875-1508-474c-bf31-34e2bacbe3bd" (UID: "5bb9c875-1508-474c-bf31-34e2bacbe3bd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:40:11.177224 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.177167    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc856144-2439-489a-b4a8-c0a1ddd02cdf-home" pod "dc856144-2439-489a-b4a8-c0a1ddd02cdf" (UID: "dc856144-2439-489a-b4a8-c0a1ddd02cdf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:40:11.221153 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.211366    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bb9c875-1508-474c-bf31-34e2bacbe3bd-tmp-dir" pod "5bb9c875-1508-474c-bf31-34e2bacbe3bd" (UID: "5bb9c875-1508-474c-bf31-34e2bacbe3bd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:40:11.221153 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.211586    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bb9c875-1508-474c-bf31-34e2bacbe3bd-model-cache" pod "5bb9c875-1508-474c-bf31-34e2bacbe3bd" (UID: "5bb9c875-1508-474c-bf31-34e2bacbe3bd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:40:11.221153 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.211794    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8490c0b-3384-43b7-a143-6c1db756aafe-tmp-dir" pod "b8490c0b-3384-43b7-a143-6c1db756aafe" (UID: "b8490c0b-3384-43b7-a143-6c1db756aafe"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:40:11.221153 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.211848    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8490c0b-3384-43b7-a143-6c1db756aafe-home" pod "b8490c0b-3384-43b7-a143-6c1db756aafe" (UID: "b8490c0b-3384-43b7-a143-6c1db756aafe"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:40:11.221153 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.213971    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc856144-2439-489a-b4a8-c0a1ddd02cdf-model-cache" pod "dc856144-2439-489a-b4a8-c0a1ddd02cdf" (UID: "dc856144-2439-489a-b4a8-c0a1ddd02cdf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:40:11.222071 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.222036    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8490c0b-3384-43b7-a143-6c1db756aafe-model-cache" pod "b8490c0b-3384-43b7-a143-6c1db756aafe" (UID: "b8490c0b-3384-43b7-a143-6c1db756aafe"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:40:11.245977 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.225249    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bb9c875-1508-474c-bf31-34e2bacbe3bd-kube-api-access-69vr4" pod "5bb9c875-1508-474c-bf31-34e2bacbe3bd" (UID: "5bb9c875-1508-474c-bf31-34e2bacbe3bd"). InnerVolumeSpecName "kube-api-access-69vr4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:40:11.247426 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.229981    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc856144-2439-489a-b4a8-c0a1ddd02cdf-tmp-dir" pod "dc856144-2439-489a-b4a8-c0a1ddd02cdf" (UID: "dc856144-2439-489a-b4a8-c0a1ddd02cdf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:40:11.247426 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.244052    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bb9c875-1508-474c-bf31-34e2bacbe3bd-tls-certs" pod "5bb9c875-1508-474c-bf31-34e2bacbe3bd" (UID: "5bb9c875-1508-474c-bf31-34e2bacbe3bd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:40:11.247805 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.247778    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc856144-2439-489a-b4a8-c0a1ddd02cdf-tls-certs" pod "dc856144-2439-489a-b4a8-c0a1ddd02cdf" (UID: "dc856144-2439-489a-b4a8-c0a1ddd02cdf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:40:11.250600 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.250562    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8490c0b-3384-43b7-a143-6c1db756aafe-tls-certs" pod "b8490c0b-3384-43b7-a143-6c1db756aafe" (UID: "b8490c0b-3384-43b7-a143-6c1db756aafe"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:40:11.252370 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.252240    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8490c0b-3384-43b7-a143-6c1db756aafe-kube-api-access-d45mp" pod "b8490c0b-3384-43b7-a143-6c1db756aafe" (UID: "b8490c0b-3384-43b7-a143-6c1db756aafe"). InnerVolumeSpecName "kube-api-access-d45mp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:40:11.252370 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.252306    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc856144-2439-489a-b4a8-c0a1ddd02cdf-kube-api-access-5xv9w" pod "dc856144-2439-489a-b4a8-c0a1ddd02cdf" (UID: "dc856144-2439-489a-b4a8-c0a1ddd02cdf"). InnerVolumeSpecName "kube-api-access-5xv9w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:40:11.252370 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.252346    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bb9c875-1508-474c-bf31-34e2bacbe3bd-dshm" pod "5bb9c875-1508-474c-bf31-34e2bacbe3bd" (UID: "5bb9c875-1508-474c-bf31-34e2bacbe3bd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:40:11.253042 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.253020    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc856144-2439-489a-b4a8-c0a1ddd02cdf-dshm" pod "dc856144-2439-489a-b4a8-c0a1ddd02cdf" (UID: "dc856144-2439-489a-b4a8-c0a1ddd02cdf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:40:11.254209 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.254171    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8490c0b-3384-43b7-a143-6c1db756aafe-dshm" pod "b8490c0b-3384-43b7-a143-6c1db756aafe" (UID: "b8490c0b-3384-43b7-a143-6c1db756aafe"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:40:11.254809 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.254553    6210 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc856144-2439-489a-b4a8-c0a1ddd02cdf-home\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:11.254809 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.254580    6210 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc856144-2439-489a-b4a8-c0a1ddd02cdf-tls-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:11.254809 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.254594    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69vr4\" (UniqueName: \"kubernetes.io/projected/5bb9c875-1508-474c-bf31-34e2bacbe3bd-kube-api-access-69vr4\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:11.254809 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.254607    6210 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8490c0b-3384-43b7-a143-6c1db756aafe-home\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:11.254809 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.254620    6210 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bb9c875-1508-474c-bf31-34e2bacbe3bd-model-cache\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:11.254809 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.254632    6210 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bb9c875-1508-474c-bf31-34e2bacbe3bd-dshm\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:11.254809 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.254646    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xv9w\" (UniqueName: \"kubernetes.io/projected/dc856144-2439-489a-b4a8-c0a1ddd02cdf-kube-api-access-5xv9w\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:11.254809 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.254659    6210 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8490c0b-3384-43b7-a143-6c1db756aafe-tls-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:11.254809 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.254673    6210 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bb9c875-1508-474c-bf31-34e2bacbe3bd-tls-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:11.254809 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.254685    6210 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bb9c875-1508-474c-bf31-34e2bacbe3bd-home\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:11.254809 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.254699    6210 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8490c0b-3384-43b7-a143-6c1db756aafe-dshm\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:11.254809 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.254711    6210 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc856144-2439-489a-b4a8-c0a1ddd02cdf-model-cache\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:11.254809 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.254725    6210 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bb9c875-1508-474c-bf31-34e2bacbe3bd-tmp-dir\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:11.254809 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.254739    6210 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc856144-2439-489a-b4a8-c0a1ddd02cdf-tmp-dir\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:11.254809 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.254751    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d45mp\" (UniqueName: \"kubernetes.io/projected/b8490c0b-3384-43b7-a143-6c1db756aafe-kube-api-access-d45mp\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:11.254809 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.254762    6210 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc856144-2439-489a-b4a8-c0a1ddd02cdf-dshm\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:11.254809 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.254776    6210 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8490c0b-3384-43b7-a143-6c1db756aafe-tmp-dir\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:11.254809 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.254789    6210 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8490c0b-3384-43b7-a143-6c1db756aafe-model-cache\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:11.356929 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.356827    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:40:11.597261 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.597232    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg"]
Nov 02 08:40:11.597718 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.597706    6210 cpu_manager.go:414] "containerMap: removing container" podUID="ac5e7ab8-bf7b-43a1-8943-334c1641a3d2" containerName="istio-proxy"
Nov 02 08:40:11.597756 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.597719    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ac5e7ab8-bf7b-43a1-8943-334c1641a3d2" containerName="istio-proxy"
Nov 02 08:40:11.597756 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.597733    6210 cpu_manager.go:414] "containerMap: removing container" podUID="50c20741-ec88-47cf-8b93-23f3ff1ed7cd" containerName="istio-proxy"
Nov 02 08:40:11.597756 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.597739    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="50c20741-ec88-47cf-8b93-23f3ff1ed7cd" containerName="istio-proxy"
Nov 02 08:40:11.597756 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.597747    6210 cpu_manager.go:414] "containerMap: removing container" podUID="5d4395c6-343b-4ed5-97f5-7bb40dec980b" containerName="main"
Nov 02 08:40:11.597756 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.597752    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5d4395c6-343b-4ed5-97f5-7bb40dec980b" containerName="main"
Nov 02 08:40:11.597923 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.597763    6210 cpu_manager.go:414] "containerMap: removing container" podUID="007e502b-178a-4249-a138-f583cc7a4508" containerName="main"
Nov 02 08:40:11.597923 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.597767    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="007e502b-178a-4249-a138-f583cc7a4508" containerName="main"
Nov 02 08:40:11.597923 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.597784    6210 cpu_manager.go:414] "containerMap: removing container" podUID="744edbc8-e19d-4047-a841-a5b0f9b51562" containerName="istio-proxy"
Nov 02 08:40:11.597923 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.597788    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="744edbc8-e19d-4047-a841-a5b0f9b51562" containerName="istio-proxy"
Nov 02 08:40:11.597923 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.597800    6210 cpu_manager.go:414] "containerMap: removing container" podUID="36a05f34-aef7-440a-9a18-8c6b9812990a" containerName="istio-proxy"
Nov 02 08:40:11.597923 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.597805    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="36a05f34-aef7-440a-9a18-8c6b9812990a" containerName="istio-proxy"
Nov 02 08:40:11.597923 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.597814    6210 cpu_manager.go:414] "containerMap: removing container" podUID="dc856144-2439-489a-b4a8-c0a1ddd02cdf" containerName="main"
Nov 02 08:40:11.597923 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.597818    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dc856144-2439-489a-b4a8-c0a1ddd02cdf" containerName="main"
Nov 02 08:40:11.597923 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.597825    6210 cpu_manager.go:414] "containerMap: removing container" podUID="eba9e1b0-c9f1-4ecf-994b-750dfd592c2f" containerName="maas-api"
Nov 02 08:40:11.597923 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.597829    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="eba9e1b0-c9f1-4ecf-994b-750dfd592c2f" containerName="maas-api"
Nov 02 08:40:11.597923 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.597836    6210 cpu_manager.go:414] "containerMap: removing container" podUID="09185775-6eca-468f-a7c3-9793d2cb43b7" containerName="istio-proxy"
Nov 02 08:40:11.597923 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.597840    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="09185775-6eca-468f-a7c3-9793d2cb43b7" containerName="istio-proxy"
Nov 02 08:40:11.597923 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.597851    6210 cpu_manager.go:414] "containerMap: removing container" podUID="49b40212-55da-41b0-904e-cbab2dc73648" containerName="main"
Nov 02 08:40:11.597923 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.597855    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="49b40212-55da-41b0-904e-cbab2dc73648" containerName="main"
Nov 02 08:40:11.597923 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.597861    6210 cpu_manager.go:414] "containerMap: removing container" podUID="b8490c0b-3384-43b7-a143-6c1db756aafe" containerName="main"
Nov 02 08:40:11.597923 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.597865    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b8490c0b-3384-43b7-a143-6c1db756aafe" containerName="main"
Nov 02 08:40:11.597923 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.597890    6210 cpu_manager.go:414] "containerMap: removing container" podUID="ab1cc655-53d5-4b53-8041-bb102a2d133e" containerName="istio-proxy"
Nov 02 08:40:11.597923 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.597897    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ab1cc655-53d5-4b53-8041-bb102a2d133e" containerName="istio-proxy"
Nov 02 08:40:11.597923 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.597920    6210 cpu_manager.go:414] "containerMap: removing container" podUID="533b692f-58b1-4609-b173-914d4a183be8" containerName="payload-processing"
Nov 02 08:40:11.597923 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.597927    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="533b692f-58b1-4609-b173-914d4a183be8" containerName="payload-processing"
Nov 02 08:40:11.598475 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.597937    6210 cpu_manager.go:414] "containerMap: removing container" podUID="931e577d-0e59-4304-b6eb-7b2b5e9834ba" containerName="payload-pre-processing"
Nov 02 08:40:11.598475 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.597943    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="931e577d-0e59-4304-b6eb-7b2b5e9834ba" containerName="payload-pre-processing"
Nov 02 08:40:11.598475 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.597956    6210 cpu_manager.go:414] "containerMap: removing container" podUID="5bb9c875-1508-474c-bf31-34e2bacbe3bd" containerName="main"
Nov 02 08:40:11.598475 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.597962    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5bb9c875-1508-474c-bf31-34e2bacbe3bd" containerName="main"
Nov 02 08:40:11.598475 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.598069    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="ac5e7ab8-bf7b-43a1-8943-334c1641a3d2" containerName="istio-proxy"
Nov 02 08:40:11.598475 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.598083    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="50c20741-ec88-47cf-8b93-23f3ff1ed7cd" containerName="istio-proxy"
Nov 02 08:40:11.598475 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.598095    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="5d4395c6-343b-4ed5-97f5-7bb40dec980b" containerName="main"
Nov 02 08:40:11.598475 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.598104    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="007e502b-178a-4249-a138-f583cc7a4508" containerName="main"
Nov 02 08:40:11.598475 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.598115    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="744edbc8-e19d-4047-a841-a5b0f9b51562" containerName="istio-proxy"
Nov 02 08:40:11.598475 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.598125    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="36a05f34-aef7-440a-9a18-8c6b9812990a" containerName="istio-proxy"
Nov 02 08:40:11.598475 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.598134    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="dc856144-2439-489a-b4a8-c0a1ddd02cdf" containerName="main"
Nov 02 08:40:11.598475 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.598142    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="eba9e1b0-c9f1-4ecf-994b-750dfd592c2f" containerName="maas-api"
Nov 02 08:40:11.598475 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.598152    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="09185775-6eca-468f-a7c3-9793d2cb43b7" containerName="istio-proxy"
Nov 02 08:40:11.598475 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.598160    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="49b40212-55da-41b0-904e-cbab2dc73648" containerName="main"
Nov 02 08:40:11.598475 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.598170    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="b8490c0b-3384-43b7-a143-6c1db756aafe" containerName="main"
Nov 02 08:40:11.598475 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.598179    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="ab1cc655-53d5-4b53-8041-bb102a2d133e" containerName="istio-proxy"
Nov 02 08:40:11.598475 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.598190    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="533b692f-58b1-4609-b173-914d4a183be8" containerName="payload-processing"
Nov 02 08:40:11.598475 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.598198    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="931e577d-0e59-4304-b6eb-7b2b5e9834ba" containerName="payload-pre-processing"
Nov 02 08:40:11.598475 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.598205    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="5bb9c875-1508-474c-bf31-34e2bacbe3bd" containerName="main"
Nov 02 08:40:11.623953 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.623080    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg"
Nov 02 08:40:11.645829 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.645785    6210 generic.go:356] "Generic (PLEG): container finished" podID="b8490c0b-3384-43b7-a143-6c1db756aafe" containerID="fb00fb1c873618b0b3343887eabe78f29f619a570b1734406fd979df30a76a62" exitCode=0
Nov 02 08:40:11.646414 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.646064    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn"
Nov 02 08:40:11.648129 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.646087    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn" event={"ID":"b8490c0b-3384-43b7-a143-6c1db756aafe","Type":"ContainerDied","Data":"fb00fb1c873618b0b3343887eabe78f29f619a570b1734406fd979df30a76a62"}
Nov 02 08:40:11.648239 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.648155    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn" event={"ID":"b8490c0b-3384-43b7-a143-6c1db756aafe","Type":"ContainerDied","Data":"db0a1525aeb3e386b923cccd510906fc3ff08c832945a7ada6c643716edb8ba1"}
Nov 02 08:40:11.648239 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.648184    6210 scope.go:122] "RemoveContainer" containerID="fb00fb1c873618b0b3343887eabe78f29f619a570b1734406fd979df30a76a62"
Nov 02 08:40:11.651498 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.651471    6210 generic.go:356] "Generic (PLEG): container finished" podID="5bb9c875-1508-474c-bf31-34e2bacbe3bd" containerID="accb0f79ca5064d59aa38ae086061dcbb1c80e9eeb447f52bc1a56dee618daa0" exitCode=0
Nov 02 08:40:11.651611 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.651537    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc"
Nov 02 08:40:11.651674 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.651654    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc" event={"ID":"5bb9c875-1508-474c-bf31-34e2bacbe3bd","Type":"ContainerDied","Data":"accb0f79ca5064d59aa38ae086061dcbb1c80e9eeb447f52bc1a56dee618daa0"}
Nov 02 08:40:11.651729 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.651685    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc" event={"ID":"5bb9c875-1508-474c-bf31-34e2bacbe3bd","Type":"ContainerDied","Data":"31a3df6062f5c56ddc8494895b81b58014e41fb39f915f13685b1f8961455730"}
Nov 02 08:40:11.655914 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.653525    6210 generic.go:356] "Generic (PLEG): container finished" podID="dc856144-2439-489a-b4a8-c0a1ddd02cdf" containerID="338932fd77bd63f3f75318cdad691439752494232602f7d1f2d604a0853d0373" exitCode=0
Nov 02 08:40:11.655914 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.654113    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98"
Nov 02 08:40:11.657667 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.657644    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98" event={"ID":"dc856144-2439-489a-b4a8-c0a1ddd02cdf","Type":"ContainerDied","Data":"338932fd77bd63f3f75318cdad691439752494232602f7d1f2d604a0853d0373"}
Nov 02 08:40:11.657775 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.657682    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98" event={"ID":"dc856144-2439-489a-b4a8-c0a1ddd02cdf","Type":"ContainerDied","Data":"2e202b1ad9d34d9bc30c90230f058e8718f6f83e5873941743cd434eed7d5490"}
Nov 02 08:40:11.660736 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.660712    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37c3a1ab-c654-4773-b912-7f0a9b7df6b7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg\" (UID: \"37c3a1ab-c654-4773-b912-7f0a9b7df6b7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg"
Nov 02 08:40:11.660934 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.660917    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxzkl\" (UniqueName: \"kubernetes.io/projected/37c3a1ab-c654-4773-b912-7f0a9b7df6b7-kube-api-access-nxzkl\") pod \"payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg\" (UID: \"37c3a1ab-c654-4773-b912-7f0a9b7df6b7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg"
Nov 02 08:40:11.666252 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.666227    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg"]
Nov 02 08:40:11.667152 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.667003    6210 scope.go:122] "RemoveContainer" containerID="fb00fb1c873618b0b3343887eabe78f29f619a570b1734406fd979df30a76a62"
Nov 02 08:40:11.667370 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:40:11.667345    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb00fb1c873618b0b3343887eabe78f29f619a570b1734406fd979df30a76a62\": container with ID starting with fb00fb1c873618b0b3343887eabe78f29f619a570b1734406fd979df30a76a62 not found: ID does not exist" containerID="fb00fb1c873618b0b3343887eabe78f29f619a570b1734406fd979df30a76a62"
Nov 02 08:40:11.667589 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.667377    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb00fb1c873618b0b3343887eabe78f29f619a570b1734406fd979df30a76a62"} err="failed to get container status \"fb00fb1c873618b0b3343887eabe78f29f619a570b1734406fd979df30a76a62\": rpc error: code = NotFound desc = could not find container \"fb00fb1c873618b0b3343887eabe78f29f619a570b1734406fd979df30a76a62\": container with ID starting with fb00fb1c873618b0b3343887eabe78f29f619a570b1734406fd979df30a76a62 not found: ID does not exist"
Nov 02 08:40:11.667589 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.667402    6210 scope.go:122] "RemoveContainer" containerID="accb0f79ca5064d59aa38ae086061dcbb1c80e9eeb447f52bc1a56dee618daa0"
Nov 02 08:40:11.673334 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.673312    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-45fc31\""
Nov 02 08:40:11.674372 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.674348    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-45fc31-dockercfg-b2dq6\""
Nov 02 08:40:11.678558 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.678472    6210 scope.go:122] "RemoveContainer" containerID="accb0f79ca5064d59aa38ae086061dcbb1c80e9eeb447f52bc1a56dee618daa0"
Nov 02 08:40:11.679020 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:40:11.678779    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"accb0f79ca5064d59aa38ae086061dcbb1c80e9eeb447f52bc1a56dee618daa0\": container with ID starting with accb0f79ca5064d59aa38ae086061dcbb1c80e9eeb447f52bc1a56dee618daa0 not found: ID does not exist" containerID="accb0f79ca5064d59aa38ae086061dcbb1c80e9eeb447f52bc1a56dee618daa0"
Nov 02 08:40:11.679020 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.678814    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"accb0f79ca5064d59aa38ae086061dcbb1c80e9eeb447f52bc1a56dee618daa0"} err="failed to get container status \"accb0f79ca5064d59aa38ae086061dcbb1c80e9eeb447f52bc1a56dee618daa0\": rpc error: code = NotFound desc = could not find container \"accb0f79ca5064d59aa38ae086061dcbb1c80e9eeb447f52bc1a56dee618daa0\": container with ID starting with accb0f79ca5064d59aa38ae086061dcbb1c80e9eeb447f52bc1a56dee618daa0 not found: ID does not exist"
Nov 02 08:40:11.679020 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.678836    6210 scope.go:122] "RemoveContainer" containerID="338932fd77bd63f3f75318cdad691439752494232602f7d1f2d604a0853d0373"
Nov 02 08:40:11.690378 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.690350    6210 scope.go:122] "RemoveContainer" containerID="338932fd77bd63f3f75318cdad691439752494232602f7d1f2d604a0853d0373"
Nov 02 08:40:11.690692 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:40:11.690669    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"338932fd77bd63f3f75318cdad691439752494232602f7d1f2d604a0853d0373\": container with ID starting with 338932fd77bd63f3f75318cdad691439752494232602f7d1f2d604a0853d0373 not found: ID does not exist" containerID="338932fd77bd63f3f75318cdad691439752494232602f7d1f2d604a0853d0373"
Nov 02 08:40:11.690795 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.690698    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"338932fd77bd63f3f75318cdad691439752494232602f7d1f2d604a0853d0373"} err="failed to get container status \"338932fd77bd63f3f75318cdad691439752494232602f7d1f2d604a0853d0373\": rpc error: code = NotFound desc = could not find container \"338932fd77bd63f3f75318cdad691439752494232602f7d1f2d604a0853d0373\": container with ID starting with 338932fd77bd63f3f75318cdad691439752494232602f7d1f2d604a0853d0373 not found: ID does not exist"
Nov 02 08:40:11.762068 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.762030    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxzkl\" (UniqueName: \"kubernetes.io/projected/37c3a1ab-c654-4773-b912-7f0a9b7df6b7-kube-api-access-nxzkl\") pod \"payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg\" (UID: \"37c3a1ab-c654-4773-b912-7f0a9b7df6b7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg"
Nov 02 08:40:11.762266 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.762181    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37c3a1ab-c654-4773-b912-7f0a9b7df6b7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg\" (UID: \"37c3a1ab-c654-4773-b912-7f0a9b7df6b7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg"
Nov 02 08:40:11.763031 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.763005    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37c3a1ab-c654-4773-b912-7f0a9b7df6b7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg\" (UID: \"37c3a1ab-c654-4773-b912-7f0a9b7df6b7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg"
Nov 02 08:40:11.826863 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.826812    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxzkl\" (UniqueName: \"kubernetes.io/projected/37c3a1ab-c654-4773-b912-7f0a9b7df6b7-kube-api-access-nxzkl\") pod \"payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg\" (UID: \"37c3a1ab-c654-4773-b912-7f0a9b7df6b7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg"
Nov 02 08:40:11.840206 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.840173    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc"]
Nov 02 08:40:11.848620 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.848593    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-9d77b6/distinct-2-w5-9d77b6-kserve-5647bcb456-bwsqc"]
Nov 02 08:40:11.950171 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.950091    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn"]
Nov 02 08:40:11.952664 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.952639    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg"
Nov 02 08:40:11.956219 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:11.956193    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-9d77b6/premium-w5-9d77b6-kserve-855f94db8d-qtzxn"]
Nov 02 08:40:12.075406 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:12.075363    6210 patch_prober.go:29] interesting pod/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused" start-of-body=
Nov 02 08:40:12.075595 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:12.075414    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2" podUID="72cfa2c7-210c-4e18-961b-4676855ffd42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused"
Nov 02 08:40:12.083507 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:12.083471    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98"]
Nov 02 08:40:12.088400 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:12.088372    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-9d77b6/distinct-w5-9d77b6-kserve-85fc95b54c-4zx98"]
Nov 02 08:40:12.353842 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:12.353815    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5bb9c875-1508-474c-bf31-34e2bacbe3bd" path="/var/lib/kubelet/pods/5bb9c875-1508-474c-bf31-34e2bacbe3bd/volumes"
Nov 02 08:40:12.354621 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:12.354599    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b8490c0b-3384-43b7-a143-6c1db756aafe" path="/var/lib/kubelet/pods/b8490c0b-3384-43b7-a143-6c1db756aafe/volumes"
Nov 02 08:40:12.355053 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:12.355038    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dc856144-2439-489a-b4a8-c0a1ddd02cdf" path="/var/lib/kubelet/pods/dc856144-2439-489a-b4a8-c0a1ddd02cdf/volumes"
Nov 02 08:40:12.355394 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:12.355373    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg"]
Nov 02 08:40:12.356335 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:40:12.356306    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37c3a1ab_c654_4773_b912_7f0a9b7df6b7.slice/crio-55bce8962c7df68a6ea074879d2e1856c206be71f2a8bafb6baa8469548f83a9 WatchSource:0}: Error finding container 55bce8962c7df68a6ea074879d2e1856c206be71f2a8bafb6baa8469548f83a9: Status 404 returned error can't find the container with id 55bce8962c7df68a6ea074879d2e1856c206be71f2a8bafb6baa8469548f83a9
Nov 02 08:40:12.388843 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:12.388818    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg"]
Nov 02 08:40:12.397732 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:12.397712    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg"
Nov 02 08:40:12.452728 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:12.452703    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg"]
Nov 02 08:40:12.470389 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:12.470355    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwq5z\" (UniqueName: \"kubernetes.io/projected/65a5b2a1-a374-4ba9-9330-91c77e3a2f2b-kube-api-access-hwq5z\") pod \"payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg\" (UID: \"65a5b2a1-a374-4ba9-9330-91c77e3a2f2b\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg"
Nov 02 08:40:12.470559 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:12.470414    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/65a5b2a1-a374-4ba9-9330-91c77e3a2f2b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg\" (UID: \"65a5b2a1-a374-4ba9-9330-91c77e3a2f2b\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg"
Nov 02 08:40:12.571661 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:12.571619    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwq5z\" (UniqueName: \"kubernetes.io/projected/65a5b2a1-a374-4ba9-9330-91c77e3a2f2b-kube-api-access-hwq5z\") pod \"payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg\" (UID: \"65a5b2a1-a374-4ba9-9330-91c77e3a2f2b\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg"
Nov 02 08:40:12.571862 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:12.571686    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/65a5b2a1-a374-4ba9-9330-91c77e3a2f2b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg\" (UID: \"65a5b2a1-a374-4ba9-9330-91c77e3a2f2b\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg"
Nov 02 08:40:12.572454 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:12.572434    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/65a5b2a1-a374-4ba9-9330-91c77e3a2f2b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg\" (UID: \"65a5b2a1-a374-4ba9-9330-91c77e3a2f2b\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg"
Nov 02 08:40:12.627660 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:12.627570    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwq5z\" (UniqueName: \"kubernetes.io/projected/65a5b2a1-a374-4ba9-9330-91c77e3a2f2b-kube-api-access-hwq5z\") pod \"payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg\" (UID: \"65a5b2a1-a374-4ba9-9330-91c77e3a2f2b\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg"
Nov 02 08:40:12.661481 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:12.661444    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg" event={"ID":"37c3a1ab-c654-4773-b912-7f0a9b7df6b7","Type":"ContainerStarted","Data":"45dee344696d049aed4c22b9985abda60d17b62c094b04a1c157779cc36cea21"}
Nov 02 08:40:12.662026 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:12.661499    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg" event={"ID":"37c3a1ab-c654-4773-b912-7f0a9b7df6b7","Type":"ContainerStarted","Data":"55bce8962c7df68a6ea074879d2e1856c206be71f2a8bafb6baa8469548f83a9"}
Nov 02 08:40:12.662026 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:12.661642    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg"
Nov 02 08:40:12.748248 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:12.748220    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg"
Nov 02 08:40:12.781313 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:12.781257    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg" podStartSLOduration=1.78124112 podStartE2EDuration="1.78124112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:40:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:40:12.780411982 +0000 UTC m=+2002.538840716" watchObservedRunningTime="2026-11-02 08:40:12.78124112 +0000 UTC m=+2002.539669853"
Nov 02 08:40:13.089930 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:13.087296    6210 patch_prober.go:29] interesting pod/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused" start-of-body=
Nov 02 08:40:13.089930 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:13.087362    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2" podUID="72cfa2c7-210c-4e18-961b-4676855ffd42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused"
Nov 02 08:40:13.217923 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:13.211678    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg"]
Nov 02 08:40:13.672667 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:13.672632    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg" event={"ID":"65a5b2a1-a374-4ba9-9330-91c77e3a2f2b","Type":"ContainerStarted","Data":"3ff24aab7063d5cc050166add695c7304fbbd1bde9ef9b2662d1d5fa96e8b8c8"}
Nov 02 08:40:13.673099 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:13.672692    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg" event={"ID":"65a5b2a1-a374-4ba9-9330-91c77e3a2f2b","Type":"ContainerStarted","Data":"6ad6a0a74912a15b8d93006ea52a7b0bf5cc15ebc122930952295c47ba0be979"}
Nov 02 08:40:13.673099 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:13.672979    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg"
Nov 02 08:40:14.075214 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:14.075179    6210 patch_prober.go:29] interesting pod/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused" start-of-body=
Nov 02 08:40:14.075460 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:14.075244    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2" podUID="72cfa2c7-210c-4e18-961b-4676855ffd42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused"
Nov 02 08:40:15.075450 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:15.075414    6210 patch_prober.go:29] interesting pod/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused" start-of-body=
Nov 02 08:40:15.075839 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:15.075470    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2" podUID="72cfa2c7-210c-4e18-961b-4676855ffd42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused"
Nov 02 08:40:16.076015 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:16.075978    6210 patch_prober.go:29] interesting pod/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused" start-of-body=
Nov 02 08:40:16.076447 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:16.076031    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2" podUID="72cfa2c7-210c-4e18-961b-4676855ffd42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused"
Nov 02 08:40:17.079854 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:17.079818    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:40:17.081002 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:17.080975    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:40:17.243478 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:17.243411    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg" podStartSLOduration=5.243391999 podStartE2EDuration="5.243391999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:40:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:40:13.795266609 +0000 UTC m=+2003.553695364" watchObservedRunningTime="2026-11-02 08:40:17.243391999 +0000 UTC m=+2007.001820732"
Nov 02 08:40:19.264838 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:19.264805    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"]
Nov 02 08:40:19.265383 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:19.265072    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk" podUID="7b188ece-fdd4-4d3c-b641-85e1c19ec1a5" containerName="istio-proxy" containerID="cri-o://3cea9139971c6c6f15efb52b3fc540c0a6127bfb36a124c15d6120db3f8a2116" gracePeriod=30
Nov 02 08:40:22.973187 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:22.973153    6210 patch_prober.go:29] interesting pod/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 08:40:22.973547 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:22.973235    6210 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk" podUID="7b188ece-fdd4-4d3c-b641-85e1c19ec1a5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 08:40:23.675673 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:23.675642    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg"
Nov 02 08:40:24.515244 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.515219    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"
Nov 02 08:40:24.558972 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.558946    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-credential-socket\") pod \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\" (UID: \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\") "
Nov 02 08:40:24.559111 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.558986    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-istiod-ca-cert\") pod \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\" (UID: \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\") "
Nov 02 08:40:24.559111 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.559028    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-istio-envoy\") pod \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\" (UID: \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\") "
Nov 02 08:40:24.559111 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.559064    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-istio-data\") pod \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\" (UID: \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\") "
Nov 02 08:40:24.559111 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.559083    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-workload-socket\") pod \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\" (UID: \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\") "
Nov 02 08:40:24.559289 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.559163    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-istio-podinfo\") pod \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\" (UID: \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\") "
Nov 02 08:40:24.559289 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.559197    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-credential-socket" pod "7b188ece-fdd4-4d3c-b641-85e1c19ec1a5" (UID: "7b188ece-fdd4-4d3c-b641-85e1c19ec1a5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:40:24.559289 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.559205    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-istio-token\" (UniqueName: \"kubernetes.io/projected/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-istio-token\") pod \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\" (UID: \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\") "
Nov 02 08:40:24.559450 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.559348    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-istio-data" pod "7b188ece-fdd4-4d3c-b641-85e1c19ec1a5" (UID: "7b188ece-fdd4-4d3c-b641-85e1c19ec1a5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:40:24.559450 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.559373    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-kube-api-access-r9ncz\" (UniqueName: \"kubernetes.io/projected/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-kube-api-access-r9ncz\") pod \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\" (UID: \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\") "
Nov 02 08:40:24.559450 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.559414    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-workload-certs\") pod \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\" (UID: \"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5\") "
Nov 02 08:40:24.559596 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.559503    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-workload-socket" pod "7b188ece-fdd4-4d3c-b641-85e1c19ec1a5" (UID: "7b188ece-fdd4-4d3c-b641-85e1c19ec1a5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:40:24.559596 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.559510    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-istiod-ca-cert" pod "7b188ece-fdd4-4d3c-b641-85e1c19ec1a5" (UID: "7b188ece-fdd4-4d3c-b641-85e1c19ec1a5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:40:24.559798 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.559775    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-workload-certs" pod "7b188ece-fdd4-4d3c-b641-85e1c19ec1a5" (UID: "7b188ece-fdd4-4d3c-b641-85e1c19ec1a5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:40:24.560155 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.560134    6210 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-workload-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:24.560212 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.560165    6210 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-credential-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:24.560212 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.560180    6210 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-istiod-ca-cert\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:24.560212 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.560198    6210 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-istio-data\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:24.560312 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.560215    6210 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-workload-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:24.561359 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.561322    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-istio-token" pod "7b188ece-fdd4-4d3c-b641-85e1c19ec1a5" (UID: "7b188ece-fdd4-4d3c-b641-85e1c19ec1a5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:40:24.561438 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.561421    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-istio-podinfo" pod "7b188ece-fdd4-4d3c-b641-85e1c19ec1a5" (UID: "7b188ece-fdd4-4d3c-b641-85e1c19ec1a5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 08:40:24.561763 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.561741    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-istio-envoy" pod "7b188ece-fdd4-4d3c-b641-85e1c19ec1a5" (UID: "7b188ece-fdd4-4d3c-b641-85e1c19ec1a5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:40:24.561763 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.561745    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-kube-api-access-r9ncz" pod "7b188ece-fdd4-4d3c-b641-85e1c19ec1a5" (UID: "7b188ece-fdd4-4d3c-b641-85e1c19ec1a5"). InnerVolumeSpecName "kube-api-access-r9ncz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:40:24.661799 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.661724    6210 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-istio-envoy\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:24.661799 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.661751    6210 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-istio-podinfo\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:24.661799 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.661760    6210 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-istio-token\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:24.661799 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.661769    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9ncz\" (UniqueName: \"kubernetes.io/projected/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5-kube-api-access-r9ncz\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:24.683062 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.683032    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg"
Nov 02 08:40:24.740392 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.740359    6210 generic.go:356] "Generic (PLEG): container finished" podID="7b188ece-fdd4-4d3c-b641-85e1c19ec1a5" containerID="3cea9139971c6c6f15efb52b3fc540c0a6127bfb36a124c15d6120db3f8a2116" exitCode=0
Nov 02 08:40:24.740577 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.740411    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"
Nov 02 08:40:24.740577 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.740435    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk" event={"ID":"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5","Type":"ContainerDied","Data":"3cea9139971c6c6f15efb52b3fc540c0a6127bfb36a124c15d6120db3f8a2116"}
Nov 02 08:40:24.740577 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.740490    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk" event={"ID":"7b188ece-fdd4-4d3c-b641-85e1c19ec1a5","Type":"ContainerDied","Data":"b002aba74db473d2755531f372c1f98931ad34d2f7b02baeb47ba1cc205fd603"}
Nov 02 08:40:24.740577 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.740513    6210 scope.go:122] "RemoveContainer" containerID="3cea9139971c6c6f15efb52b3fc540c0a6127bfb36a124c15d6120db3f8a2116"
Nov 02 08:40:24.757114 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.757088    6210 scope.go:122] "RemoveContainer" containerID="3cea9139971c6c6f15efb52b3fc540c0a6127bfb36a124c15d6120db3f8a2116"
Nov 02 08:40:24.757945 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:40:24.757914    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cea9139971c6c6f15efb52b3fc540c0a6127bfb36a124c15d6120db3f8a2116\": container with ID starting with 3cea9139971c6c6f15efb52b3fc540c0a6127bfb36a124c15d6120db3f8a2116 not found: ID does not exist" containerID="3cea9139971c6c6f15efb52b3fc540c0a6127bfb36a124c15d6120db3f8a2116"
Nov 02 08:40:24.758080 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.757957    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cea9139971c6c6f15efb52b3fc540c0a6127bfb36a124c15d6120db3f8a2116"} err="failed to get container status \"3cea9139971c6c6f15efb52b3fc540c0a6127bfb36a124c15d6120db3f8a2116\": rpc error: code = NotFound desc = could not find container \"3cea9139971c6c6f15efb52b3fc540c0a6127bfb36a124c15d6120db3f8a2116\": container with ID starting with 3cea9139971c6c6f15efb52b3fc540c0a6127bfb36a124c15d6120db3f8a2116 not found: ID does not exist"
Nov 02 08:40:24.934011 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.933923    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"]
Nov 02 08:40:24.938536 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:24.938507    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk"]
Nov 02 08:40:26.353663 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:26.353632    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7b188ece-fdd4-4d3c-b641-85e1c19ec1a5" path="/var/lib/kubelet/pods/7b188ece-fdd4-4d3c-b641-85e1c19ec1a5/volumes"
Nov 02 08:40:30.822059 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:40:30.822021    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:40:49.506489 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:49.506454    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj"]
Nov 02 08:40:49.507054 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:49.506666    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj" podUID="7b5d1715-0d89-42c0-a004-e0f47ba14e76" containerName="maas-api" containerID="cri-o://cf053c6c6e6a5a196eb8fc7b452c81892e8c96b3a11a8b98af9165bead7be3a8" gracePeriod=30
Nov 02 08:40:49.827923 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:49.827862    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj"
Nov 02 08:40:49.903001 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:49.902966    6210 generic.go:356] "Generic (PLEG): container finished" podID="7b5d1715-0d89-42c0-a004-e0f47ba14e76" containerID="cf053c6c6e6a5a196eb8fc7b452c81892e8c96b3a11a8b98af9165bead7be3a8" exitCode=0
Nov 02 08:40:49.903184 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:49.903021    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj" event={"ID":"7b5d1715-0d89-42c0-a004-e0f47ba14e76","Type":"ContainerDied","Data":"cf053c6c6e6a5a196eb8fc7b452c81892e8c96b3a11a8b98af9165bead7be3a8"}
Nov 02 08:40:49.903184 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:49.903072    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj" event={"ID":"7b5d1715-0d89-42c0-a004-e0f47ba14e76","Type":"ContainerDied","Data":"b6710551e9a612f7747319973e8e09f6d0d99548f2f450a6a0bde4d3726f4f2c"}
Nov 02 08:40:49.903184 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:49.903027    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj"
Nov 02 08:40:49.903184 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:49.903099    6210 scope.go:122] "RemoveContainer" containerID="cf053c6c6e6a5a196eb8fc7b452c81892e8c96b3a11a8b98af9165bead7be3a8"
Nov 02 08:40:49.913593 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:49.913383    6210 scope.go:122] "RemoveContainer" containerID="cf053c6c6e6a5a196eb8fc7b452c81892e8c96b3a11a8b98af9165bead7be3a8"
Nov 02 08:40:49.913752 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:40:49.913731    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf053c6c6e6a5a196eb8fc7b452c81892e8c96b3a11a8b98af9165bead7be3a8\": container with ID starting with cf053c6c6e6a5a196eb8fc7b452c81892e8c96b3a11a8b98af9165bead7be3a8 not found: ID does not exist" containerID="cf053c6c6e6a5a196eb8fc7b452c81892e8c96b3a11a8b98af9165bead7be3a8"
Nov 02 08:40:49.913852 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:49.913765    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf053c6c6e6a5a196eb8fc7b452c81892e8c96b3a11a8b98af9165bead7be3a8"} err="failed to get container status \"cf053c6c6e6a5a196eb8fc7b452c81892e8c96b3a11a8b98af9165bead7be3a8\": rpc error: code = NotFound desc = could not find container \"cf053c6c6e6a5a196eb8fc7b452c81892e8c96b3a11a8b98af9165bead7be3a8\": container with ID starting with cf053c6c6e6a5a196eb8fc7b452c81892e8c96b3a11a8b98af9165bead7be3a8 not found: ID does not exist"
Nov 02 08:40:49.931404 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:49.931382    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7b5d1715-0d89-42c0-a004-e0f47ba14e76-kube-api-access-79298\" (UniqueName: \"kubernetes.io/projected/7b5d1715-0d89-42c0-a004-e0f47ba14e76-kube-api-access-79298\") pod \"7b5d1715-0d89-42c0-a004-e0f47ba14e76\" (UID: \"7b5d1715-0d89-42c0-a004-e0f47ba14e76\") "
Nov 02 08:40:49.931511 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:49.931424    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7b5d1715-0d89-42c0-a004-e0f47ba14e76-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b5d1715-0d89-42c0-a004-e0f47ba14e76-openshift-service-ca\") pod \"7b5d1715-0d89-42c0-a004-e0f47ba14e76\" (UID: \"7b5d1715-0d89-42c0-a004-e0f47ba14e76\") "
Nov 02 08:40:49.931562 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:49.931543    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7b5d1715-0d89-42c0-a004-e0f47ba14e76-metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b5d1715-0d89-42c0-a004-e0f47ba14e76-metrics-certs\") pod \"7b5d1715-0d89-42c0-a004-e0f47ba14e76\" (UID: \"7b5d1715-0d89-42c0-a004-e0f47ba14e76\") "
Nov 02 08:40:49.931615 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:49.931599    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7b5d1715-0d89-42c0-a004-e0f47ba14e76-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b5d1715-0d89-42c0-a004-e0f47ba14e76-maas-api-tls\") pod \"7b5d1715-0d89-42c0-a004-e0f47ba14e76\" (UID: \"7b5d1715-0d89-42c0-a004-e0f47ba14e76\") "
Nov 02 08:40:49.931975 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:49.931835    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b5d1715-0d89-42c0-a004-e0f47ba14e76-openshift-service-ca" pod "7b5d1715-0d89-42c0-a004-e0f47ba14e76" (UID: "7b5d1715-0d89-42c0-a004-e0f47ba14e76"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:40:49.932197 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:49.932175    6210 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b5d1715-0d89-42c0-a004-e0f47ba14e76-openshift-service-ca\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:49.933700 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:49.933672    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b5d1715-0d89-42c0-a004-e0f47ba14e76-kube-api-access-79298" pod "7b5d1715-0d89-42c0-a004-e0f47ba14e76" (UID: "7b5d1715-0d89-42c0-a004-e0f47ba14e76"). InnerVolumeSpecName "kube-api-access-79298". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:40:49.933817 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:49.933708    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b5d1715-0d89-42c0-a004-e0f47ba14e76-maas-api-tls" pod "7b5d1715-0d89-42c0-a004-e0f47ba14e76" (UID: "7b5d1715-0d89-42c0-a004-e0f47ba14e76"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:40:49.934016 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:49.933988    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b5d1715-0d89-42c0-a004-e0f47ba14e76-metrics-certs" pod "7b5d1715-0d89-42c0-a004-e0f47ba14e76" (UID: "7b5d1715-0d89-42c0-a004-e0f47ba14e76"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:40:50.036764 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:50.036714    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79298\" (UniqueName: \"kubernetes.io/projected/7b5d1715-0d89-42c0-a004-e0f47ba14e76-kube-api-access-79298\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:50.036764 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:50.036766    6210 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b5d1715-0d89-42c0-a004-e0f47ba14e76-metrics-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:50.037071 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:50.036782    6210 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b5d1715-0d89-42c0-a004-e0f47ba14e76-maas-api-tls\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:40:50.316965 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:50.316935    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj"]
Nov 02 08:40:50.322579 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:50.322550    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-69a9bb-8449dcffcf-4slpj"]
Nov 02 08:40:50.352865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:50.352839    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7b5d1715-0d89-42c0-a004-e0f47ba14e76" path="/var/lib/kubelet/pods/7b5d1715-0d89-42c0-a004-e0f47ba14e76/volumes"
Nov 02 08:40:58.909440 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:58.909406    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"]
Nov 02 08:40:58.909857 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:58.909668    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9" podUID="3375cf1d-ea97-41c2-87c5-09dfad6fc5f4" containerName="istio-proxy" containerID="cri-o://382fef4808544e2c5466c751552eece34328592fad1b72c4d5ba73bea632a74d" gracePeriod=30
Nov 02 08:40:58.925639 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:58.925601    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"]
Nov 02 08:40:58.925811 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:58.925791    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br" podUID="3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33" containerName="istio-proxy" containerID="cri-o://bdc887b0ab0c95e314124c833037ae89ce94a222950a24a39c2c5039eeade5de" gracePeriod=30
Nov 02 08:40:59.222720 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:59.222685    6210 patch_prober.go:29] interesting pod/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 08:40:59.222927 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:59.222753    6210 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9" podUID="3375cf1d-ea97-41c2-87c5-09dfad6fc5f4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 08:40:59.535149 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:59.535066    6210 patch_prober.go:29] interesting pod/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 08:40:59.535149 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:40:59.535139    6210 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br" podUID="3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 08:41:00.820582 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:41:00.820546    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:41:01.321423 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.321384    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr"]
Nov 02 08:41:01.321980 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.321966    6210 cpu_manager.go:414] "containerMap: removing container" podUID="7b5d1715-0d89-42c0-a004-e0f47ba14e76" containerName="maas-api"
Nov 02 08:41:01.322033 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.321981    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7b5d1715-0d89-42c0-a004-e0f47ba14e76" containerName="maas-api"
Nov 02 08:41:01.322033 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.321997    6210 cpu_manager.go:414] "containerMap: removing container" podUID="7b188ece-fdd4-4d3c-b641-85e1c19ec1a5" containerName="istio-proxy"
Nov 02 08:41:01.322033 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.322003    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7b188ece-fdd4-4d3c-b641-85e1c19ec1a5" containerName="istio-proxy"
Nov 02 08:41:01.322129 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.322103    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="7b5d1715-0d89-42c0-a004-e0f47ba14e76" containerName="maas-api"
Nov 02 08:41:01.322129 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.322112    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="7b188ece-fdd4-4d3c-b641-85e1c19ec1a5" containerName="istio-proxy"
Nov 02 08:41:01.327457 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.327366    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr"
Nov 02 08:41:01.391912 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.388660    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-zmgsp\""
Nov 02 08:41:01.408284 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.408247    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ac56a56-b745-46f0-8095-fcf3636a41a0-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-mjrfr\" (UID: \"8ac56a56-b745-46f0-8095-fcf3636a41a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr"
Nov 02 08:41:01.408629 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.408598    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ac56a56-b745-46f0-8095-fcf3636a41a0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-mjrfr\" (UID: \"8ac56a56-b745-46f0-8095-fcf3636a41a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr"
Nov 02 08:41:01.408782 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.408643    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ac56a56-b745-46f0-8095-fcf3636a41a0-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-mjrfr\" (UID: \"8ac56a56-b745-46f0-8095-fcf3636a41a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr"
Nov 02 08:41:01.408782 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.408694    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ac56a56-b745-46f0-8095-fcf3636a41a0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-mjrfr\" (UID: \"8ac56a56-b745-46f0-8095-fcf3636a41a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr"
Nov 02 08:41:01.408782 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.408734    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ac56a56-b745-46f0-8095-fcf3636a41a0-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-mjrfr\" (UID: \"8ac56a56-b745-46f0-8095-fcf3636a41a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr"
Nov 02 08:41:01.409008 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.408833    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ac56a56-b745-46f0-8095-fcf3636a41a0-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-mjrfr\" (UID: \"8ac56a56-b745-46f0-8095-fcf3636a41a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr"
Nov 02 08:41:01.409008 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.408855    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szfhn\" (UniqueName: \"kubernetes.io/projected/8ac56a56-b745-46f0-8095-fcf3636a41a0-kube-api-access-szfhn\") pod \"maas-default-gateway-openshift-default-769df7846c-mjrfr\" (UID: \"8ac56a56-b745-46f0-8095-fcf3636a41a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr"
Nov 02 08:41:01.409008 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.408965    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ac56a56-b745-46f0-8095-fcf3636a41a0-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-mjrfr\" (UID: \"8ac56a56-b745-46f0-8095-fcf3636a41a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr"
Nov 02 08:41:01.409162 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.409042    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ac56a56-b745-46f0-8095-fcf3636a41a0-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-mjrfr\" (UID: \"8ac56a56-b745-46f0-8095-fcf3636a41a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr"
Nov 02 08:41:01.429723 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.429673    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr"]
Nov 02 08:41:01.510396 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.510358    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ac56a56-b745-46f0-8095-fcf3636a41a0-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-mjrfr\" (UID: \"8ac56a56-b745-46f0-8095-fcf3636a41a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr"
Nov 02 08:41:01.510590 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.510459    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ac56a56-b745-46f0-8095-fcf3636a41a0-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-mjrfr\" (UID: \"8ac56a56-b745-46f0-8095-fcf3636a41a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr"
Nov 02 08:41:01.510590 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.510495    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ac56a56-b745-46f0-8095-fcf3636a41a0-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-mjrfr\" (UID: \"8ac56a56-b745-46f0-8095-fcf3636a41a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr"
Nov 02 08:41:01.510590 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.510526    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ac56a56-b745-46f0-8095-fcf3636a41a0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-mjrfr\" (UID: \"8ac56a56-b745-46f0-8095-fcf3636a41a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr"
Nov 02 08:41:01.510804 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.510692    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ac56a56-b745-46f0-8095-fcf3636a41a0-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-mjrfr\" (UID: \"8ac56a56-b745-46f0-8095-fcf3636a41a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr"
Nov 02 08:41:01.510804 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.510775    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ac56a56-b745-46f0-8095-fcf3636a41a0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-mjrfr\" (UID: \"8ac56a56-b745-46f0-8095-fcf3636a41a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr"
Nov 02 08:41:01.510940 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.510824    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ac56a56-b745-46f0-8095-fcf3636a41a0-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-mjrfr\" (UID: \"8ac56a56-b745-46f0-8095-fcf3636a41a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr"
Nov 02 08:41:01.510940 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.510838    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ac56a56-b745-46f0-8095-fcf3636a41a0-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-mjrfr\" (UID: \"8ac56a56-b745-46f0-8095-fcf3636a41a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr"
Nov 02 08:41:01.510940 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.510866    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ac56a56-b745-46f0-8095-fcf3636a41a0-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-mjrfr\" (UID: \"8ac56a56-b745-46f0-8095-fcf3636a41a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr"
Nov 02 08:41:01.511097 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.510989    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ac56a56-b745-46f0-8095-fcf3636a41a0-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-mjrfr\" (UID: \"8ac56a56-b745-46f0-8095-fcf3636a41a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr"
Nov 02 08:41:01.511097 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.511022    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szfhn\" (UniqueName: \"kubernetes.io/projected/8ac56a56-b745-46f0-8095-fcf3636a41a0-kube-api-access-szfhn\") pod \"maas-default-gateway-openshift-default-769df7846c-mjrfr\" (UID: \"8ac56a56-b745-46f0-8095-fcf3636a41a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr"
Nov 02 08:41:01.511244 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.511223    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ac56a56-b745-46f0-8095-fcf3636a41a0-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-mjrfr\" (UID: \"8ac56a56-b745-46f0-8095-fcf3636a41a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr"
Nov 02 08:41:01.511355 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.511340    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ac56a56-b745-46f0-8095-fcf3636a41a0-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-mjrfr\" (UID: \"8ac56a56-b745-46f0-8095-fcf3636a41a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr"
Nov 02 08:41:01.511587 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.511563    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ac56a56-b745-46f0-8095-fcf3636a41a0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-mjrfr\" (UID: \"8ac56a56-b745-46f0-8095-fcf3636a41a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr"
Nov 02 08:41:01.513409 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.513381    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ac56a56-b745-46f0-8095-fcf3636a41a0-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-mjrfr\" (UID: \"8ac56a56-b745-46f0-8095-fcf3636a41a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr"
Nov 02 08:41:01.513610 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.513593    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ac56a56-b745-46f0-8095-fcf3636a41a0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-mjrfr\" (UID: \"8ac56a56-b745-46f0-8095-fcf3636a41a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr"
Nov 02 08:41:01.564726 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.564687    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ac56a56-b745-46f0-8095-fcf3636a41a0-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-mjrfr\" (UID: \"8ac56a56-b745-46f0-8095-fcf3636a41a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr"
Nov 02 08:41:01.564919 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.564868    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szfhn\" (UniqueName: \"kubernetes.io/projected/8ac56a56-b745-46f0-8095-fcf3636a41a0-kube-api-access-szfhn\") pod \"maas-default-gateway-openshift-default-769df7846c-mjrfr\" (UID: \"8ac56a56-b745-46f0-8095-fcf3636a41a0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr"
Nov 02 08:41:01.641168 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:01.641083    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr"
Nov 02 08:41:02.059323 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:02.059286    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr"]
Nov 02 08:41:02.099811 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:41:02.099670    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ac56a56_b745_46f0_8095_fcf3636a41a0.slice/crio-292d53f4d9b4a9bc4b63eecc30a5c4f4fb72c25b1de1ce6fc6b553944d60abe8 WatchSource:0}: Error finding container 292d53f4d9b4a9bc4b63eecc30a5c4f4fb72c25b1de1ce6fc6b553944d60abe8: Status 404 returned error can't find the container with id 292d53f4d9b4a9bc4b63eecc30a5c4f4fb72c25b1de1ce6fc6b553944d60abe8
Nov 02 08:41:02.139902 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:02.136472    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:41:02.139902 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:02.136579    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:41:02.139902 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:02.136628    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:41:02.977790 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:02.977753    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr" event={"ID":"8ac56a56-b745-46f0-8095-fcf3636a41a0","Type":"ContainerStarted","Data":"c3d77f4f34c5a296a1b45a0580892877eda79ca1a9b3e1af9f7856ffa3f135da"}
Nov 02 08:41:02.977972 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:02.977811    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr" event={"ID":"8ac56a56-b745-46f0-8095-fcf3636a41a0","Type":"ContainerStarted","Data":"292d53f4d9b4a9bc4b63eecc30a5c4f4fb72c25b1de1ce6fc6b553944d60abe8"}
Nov 02 08:41:03.641778 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:03.641746    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr"
Nov 02 08:41:03.643316 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:03.643293    6210 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-mjrfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.100:15021/healthz/ready\": dial tcp 10.134.0.100:15021: connect: connection refused" start-of-body=
Nov 02 08:41:03.643429 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:03.643337    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr" podUID="8ac56a56-b745-46f0-8095-fcf3636a41a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.100:15021/healthz/ready\": dial tcp 10.134.0.100:15021: connect: connection refused"
Nov 02 08:41:04.248296 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.248263    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"
Nov 02 08:41:04.282456 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.282430    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"
Nov 02 08:41:04.356689 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.356663    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-workload-certs\") pod \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\" (UID: \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\") "
Nov 02 08:41:04.356912 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.356703    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-kube-api-access-kjwwm\" (UniqueName: \"kubernetes.io/projected/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-kube-api-access-kjwwm\") pod \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\" (UID: \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\") "
Nov 02 08:41:04.356912 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.356786    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-istio-data\") pod \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\" (UID: \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\") "
Nov 02 08:41:04.356912 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.356848    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-istio-envoy\") pod \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\" (UID: \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\") "
Nov 02 08:41:04.357105 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.356951    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-istio-token\" (UniqueName: \"kubernetes.io/projected/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-istio-token\") pod \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\" (UID: \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\") "
Nov 02 08:41:04.357105 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.356981    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-istio-podinfo\") pod \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\" (UID: \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\") "
Nov 02 08:41:04.357105 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.356982    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-workload-certs" pod "3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33" (UID: "3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:41:04.357105 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.357027    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-istio-data\") pod \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\" (UID: \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\") "
Nov 02 08:41:04.357105 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.357058    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-istio-podinfo\") pod \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\" (UID: \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\") "
Nov 02 08:41:04.357105 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.357100    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-istio-envoy\") pod \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\" (UID: \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\") "
Nov 02 08:41:04.357414 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.357133    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-istiod-ca-cert\") pod \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\" (UID: \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\") "
Nov 02 08:41:04.357414 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.357158    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-istio-data" pod "3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33" (UID: "3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:41:04.357414 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.357160    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-istio-token\" (UniqueName: \"kubernetes.io/projected/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-istio-token\") pod \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\" (UID: \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\") "
Nov 02 08:41:04.357840 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.357656    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-istio-data" pod "3375cf1d-ea97-41c2-87c5-09dfad6fc5f4" (UID: "3375cf1d-ea97-41c2-87c5-09dfad6fc5f4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:41:04.357968 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.357838    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-workload-socket\") pod \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\" (UID: \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\") "
Nov 02 08:41:04.357968 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.357900    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-kube-api-access-kgv7t\" (UniqueName: \"kubernetes.io/projected/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-kube-api-access-kgv7t\") pod \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\" (UID: \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\") "
Nov 02 08:41:04.358083 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.357970    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-workload-certs\") pod \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\" (UID: \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\") "
Nov 02 08:41:04.358083 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.358014    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-workload-socket\") pod \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\" (UID: \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\") "
Nov 02 08:41:04.358083 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.358069    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-istiod-ca-cert\") pod \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\" (UID: \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\") "
Nov 02 08:41:04.358232 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.358154    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-credential-socket\") pod \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\" (UID: \"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4\") "
Nov 02 08:41:04.358232 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.358192    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-credential-socket\") pod \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\" (UID: \"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33\") "
Nov 02 08:41:04.359487 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.358595    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-workload-socket" pod "3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33" (UID: "3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:41:04.359487 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.358749    6210 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-istio-data\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:41:04.359487 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.358768    6210 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-workload-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:41:04.359487 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.358777    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-credential-socket" pod "3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33" (UID: "3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:41:04.359487 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.358786    6210 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-workload-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:41:04.359487 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.358819    6210 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-istio-data\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:41:04.359487 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.358853    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-istiod-ca-cert" pod "3375cf1d-ea97-41c2-87c5-09dfad6fc5f4" (UID: "3375cf1d-ea97-41c2-87c5-09dfad6fc5f4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:41:04.359487 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.359053    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-credential-socket" pod "3375cf1d-ea97-41c2-87c5-09dfad6fc5f4" (UID: "3375cf1d-ea97-41c2-87c5-09dfad6fc5f4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:41:04.359487 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.359076    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-workload-certs" pod "3375cf1d-ea97-41c2-87c5-09dfad6fc5f4" (UID: "3375cf1d-ea97-41c2-87c5-09dfad6fc5f4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:41:04.359487 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.359100    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-istiod-ca-cert" pod "3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33" (UID: "3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:41:04.359487 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.359456    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-workload-socket" pod "3375cf1d-ea97-41c2-87c5-09dfad6fc5f4" (UID: "3375cf1d-ea97-41c2-87c5-09dfad6fc5f4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:41:04.361435 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.360395    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-istio-envoy" pod "3375cf1d-ea97-41c2-87c5-09dfad6fc5f4" (UID: "3375cf1d-ea97-41c2-87c5-09dfad6fc5f4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:41:04.362158 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.362128    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-istio-podinfo" pod "3375cf1d-ea97-41c2-87c5-09dfad6fc5f4" (UID: "3375cf1d-ea97-41c2-87c5-09dfad6fc5f4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 08:41:04.362427 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.362404    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-kube-api-access-kgv7t" pod "3375cf1d-ea97-41c2-87c5-09dfad6fc5f4" (UID: "3375cf1d-ea97-41c2-87c5-09dfad6fc5f4"). InnerVolumeSpecName "kube-api-access-kgv7t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:41:04.363938 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.362496    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-kube-api-access-kjwwm" pod "3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33" (UID: "3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33"). InnerVolumeSpecName "kube-api-access-kjwwm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:41:04.363938 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.362526    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-istio-token" pod "3375cf1d-ea97-41c2-87c5-09dfad6fc5f4" (UID: "3375cf1d-ea97-41c2-87c5-09dfad6fc5f4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:41:04.363938 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.363215    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-istio-envoy" pod "3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33" (UID: "3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:41:04.363938 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.363651    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-istio-podinfo" pod "3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33" (UID: "3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 08:41:04.364590 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.364327    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-istio-token" pod "3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33" (UID: "3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:41:04.423911 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.422457    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr" podStartSLOduration=3.422435729 podStartE2EDuration="3.422435729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:41:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:41:03.095338354 +0000 UTC m=+2052.853767086" watchObservedRunningTime="2026-11-02 08:41:04.422435729 +0000 UTC m=+2054.180864462"
Nov 02 08:41:04.462443 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.462397    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjwwm\" (UniqueName: \"kubernetes.io/projected/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-kube-api-access-kjwwm\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:41:04.462443 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.462440    6210 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-istio-envoy\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:41:04.462715 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.462457    6210 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-istio-token\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:41:04.462715 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.462471    6210 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-istio-podinfo\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:41:04.462715 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.462486    6210 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-istio-podinfo\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:41:04.462715 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.462499    6210 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-istio-envoy\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:41:04.462715 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.462512    6210 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-istiod-ca-cert\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:41:04.462715 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.462526    6210 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-istio-token\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:41:04.462715 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.462539    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgv7t\" (UniqueName: \"kubernetes.io/projected/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-kube-api-access-kgv7t\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:41:04.462715 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.462556    6210 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-workload-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:41:04.462715 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.462570    6210 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-workload-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:41:04.462715 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.462583    6210 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-istiod-ca-cert\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:41:04.462715 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.462599    6210 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4-credential-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:41:04.462715 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.462614    6210 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33-credential-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:41:04.642653 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.642507    6210 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-mjrfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.100:15021/healthz/ready\": dial tcp 10.134.0.100:15021: connect: connection refused" start-of-body=
Nov 02 08:41:04.642653 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.642593    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr" podUID="8ac56a56-b745-46f0-8095-fcf3636a41a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.100:15021/healthz/ready\": dial tcp 10.134.0.100:15021: connect: connection refused"
Nov 02 08:41:04.997160 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.997124    6210 generic.go:356] "Generic (PLEG): container finished" podID="3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33" containerID="bdc887b0ab0c95e314124c833037ae89ce94a222950a24a39c2c5039eeade5de" exitCode=0
Nov 02 08:41:04.997352 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.997185    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"
Nov 02 08:41:04.997352 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.997206    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br" event={"ID":"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33","Type":"ContainerDied","Data":"bdc887b0ab0c95e314124c833037ae89ce94a222950a24a39c2c5039eeade5de"}
Nov 02 08:41:04.997352 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.997285    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br" event={"ID":"3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33","Type":"ContainerDied","Data":"4c8df96aeaf6228a5bff22f00320d7fccf9972206ff5a7ec2bd95916edec89f9"}
Nov 02 08:41:04.997352 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.997313    6210 scope.go:122] "RemoveContainer" containerID="bdc887b0ab0c95e314124c833037ae89ce94a222950a24a39c2c5039eeade5de"
Nov 02 08:41:05.010340 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.999015    6210 generic.go:356] "Generic (PLEG): container finished" podID="3375cf1d-ea97-41c2-87c5-09dfad6fc5f4" containerID="382fef4808544e2c5466c751552eece34328592fad1b72c4d5ba73bea632a74d" exitCode=0
Nov 02 08:41:05.010340 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.999085    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"
Nov 02 08:41:05.010340 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.999130    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9" event={"ID":"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4","Type":"ContainerDied","Data":"382fef4808544e2c5466c751552eece34328592fad1b72c4d5ba73bea632a74d"}
Nov 02 08:41:05.010340 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:04.999167    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9" event={"ID":"3375cf1d-ea97-41c2-87c5-09dfad6fc5f4","Type":"ContainerDied","Data":"9e5a6780c8fd10a4c210505b47060d0a9dbcfc44f0db378da3752a4046ef25cb"}
Nov 02 08:41:05.071662 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:05.070499    6210 scope.go:122] "RemoveContainer" containerID="bdc887b0ab0c95e314124c833037ae89ce94a222950a24a39c2c5039eeade5de"
Nov 02 08:41:05.071662 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:41:05.071039    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdc887b0ab0c95e314124c833037ae89ce94a222950a24a39c2c5039eeade5de\": container with ID starting with bdc887b0ab0c95e314124c833037ae89ce94a222950a24a39c2c5039eeade5de not found: ID does not exist" containerID="bdc887b0ab0c95e314124c833037ae89ce94a222950a24a39c2c5039eeade5de"
Nov 02 08:41:05.071662 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:05.071079    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdc887b0ab0c95e314124c833037ae89ce94a222950a24a39c2c5039eeade5de"} err="failed to get container status \"bdc887b0ab0c95e314124c833037ae89ce94a222950a24a39c2c5039eeade5de\": rpc error: code = NotFound desc = could not find container \"bdc887b0ab0c95e314124c833037ae89ce94a222950a24a39c2c5039eeade5de\": container with ID starting with bdc887b0ab0c95e314124c833037ae89ce94a222950a24a39c2c5039eeade5de not found: ID does not exist"
Nov 02 08:41:05.071662 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:05.071157    6210 scope.go:122] "RemoveContainer" containerID="382fef4808544e2c5466c751552eece34328592fad1b72c4d5ba73bea632a74d"
Nov 02 08:41:05.082202 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:05.082179    6210 scope.go:122] "RemoveContainer" containerID="382fef4808544e2c5466c751552eece34328592fad1b72c4d5ba73bea632a74d"
Nov 02 08:41:05.082494 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:41:05.082469    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"382fef4808544e2c5466c751552eece34328592fad1b72c4d5ba73bea632a74d\": container with ID starting with 382fef4808544e2c5466c751552eece34328592fad1b72c4d5ba73bea632a74d not found: ID does not exist" containerID="382fef4808544e2c5466c751552eece34328592fad1b72c4d5ba73bea632a74d"
Nov 02 08:41:05.082592 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:05.082506    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"382fef4808544e2c5466c751552eece34328592fad1b72c4d5ba73bea632a74d"} err="failed to get container status \"382fef4808544e2c5466c751552eece34328592fad1b72c4d5ba73bea632a74d\": rpc error: code = NotFound desc = could not find container \"382fef4808544e2c5466c751552eece34328592fad1b72c4d5ba73bea632a74d\": container with ID starting with 382fef4808544e2c5466c751552eece34328592fad1b72c4d5ba73bea632a74d not found: ID does not exist"
Nov 02 08:41:05.153020 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:05.152981    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"]
Nov 02 08:41:05.158400 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:05.158371    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9"]
Nov 02 08:41:05.264468 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:05.264429    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"]
Nov 02 08:41:05.268213 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:05.268188    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br"]
Nov 02 08:41:05.642267 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:05.642180    6210 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-mjrfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.100:15021/healthz/ready\": dial tcp 10.134.0.100:15021: connect: connection refused" start-of-body=
Nov 02 08:41:05.642267 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:05.642234    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr" podUID="8ac56a56-b745-46f0-8095-fcf3636a41a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.100:15021/healthz/ready\": dial tcp 10.134.0.100:15021: connect: connection refused"
Nov 02 08:41:06.352011 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:06.351979    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3375cf1d-ea97-41c2-87c5-09dfad6fc5f4" path="/var/lib/kubelet/pods/3375cf1d-ea97-41c2-87c5-09dfad6fc5f4/volumes"
Nov 02 08:41:06.352483 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:06.352469    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33" path="/var/lib/kubelet/pods/3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33/volumes"
Nov 02 08:41:06.642153 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:06.642066    6210 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-mjrfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.100:15021/healthz/ready\": dial tcp 10.134.0.100:15021: connect: connection refused" start-of-body=
Nov 02 08:41:06.642153 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:06.642124    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr" podUID="8ac56a56-b745-46f0-8095-fcf3636a41a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.100:15021/healthz/ready\": dial tcp 10.134.0.100:15021: connect: connection refused"
Nov 02 08:41:07.642070 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:07.642039    6210 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-mjrfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.100:15021/healthz/ready\": dial tcp 10.134.0.100:15021: connect: connection refused" start-of-body=
Nov 02 08:41:07.642524 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:07.642090    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr" podUID="8ac56a56-b745-46f0-8095-fcf3636a41a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.100:15021/healthz/ready\": dial tcp 10.134.0.100:15021: connect: connection refused"
Nov 02 08:41:08.642040 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:08.642006    6210 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-mjrfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.100:15021/healthz/ready\": dial tcp 10.134.0.100:15021: connect: connection refused" start-of-body=
Nov 02 08:41:08.642198 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:08.642070    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr" podUID="8ac56a56-b745-46f0-8095-fcf3636a41a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.100:15021/healthz/ready\": dial tcp 10.134.0.100:15021: connect: connection refused"
Nov 02 08:41:09.641992 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:09.641950    6210 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-mjrfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.100:15021/healthz/ready\": dial tcp 10.134.0.100:15021: connect: connection refused" start-of-body=
Nov 02 08:41:09.642180 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:09.642024    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr" podUID="8ac56a56-b745-46f0-8095-fcf3636a41a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.100:15021/healthz/ready\": dial tcp 10.134.0.100:15021: connect: connection refused"
Nov 02 08:41:10.652585 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:10.652547    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr"
Nov 02 08:41:10.653182 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:10.652846    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr"
Nov 02 08:41:10.653627 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:10.653609    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr"
Nov 02 08:41:16.461077 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:16.461043    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw"]
Nov 02 08:41:16.461532 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:16.461519    6210 cpu_manager.go:414] "containerMap: removing container" podUID="3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33" containerName="istio-proxy"
Nov 02 08:41:16.461572 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:16.461533    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33" containerName="istio-proxy"
Nov 02 08:41:16.461572 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:16.461559    6210 cpu_manager.go:414] "containerMap: removing container" podUID="3375cf1d-ea97-41c2-87c5-09dfad6fc5f4" containerName="istio-proxy"
Nov 02 08:41:16.461572 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:16.461565    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3375cf1d-ea97-41c2-87c5-09dfad6fc5f4" containerName="istio-proxy"
Nov 02 08:41:16.461661 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:16.461629    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="3375cf1d-ea97-41c2-87c5-09dfad6fc5f4" containerName="istio-proxy"
Nov 02 08:41:16.461661 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:16.461643    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="3fb0e4fc-48cd-4d2f-8b52-0ac422f14a33" containerName="istio-proxy"
Nov 02 08:41:16.464771 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:16.464744    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw"
Nov 02 08:41:16.566029 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:16.565985    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-rs4mw\" (UID: \"6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw"
Nov 02 08:41:16.566414 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:16.566391    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-rs4mw\" (UID: \"6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw"
Nov 02 08:41:16.566678 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:16.566658    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-rs4mw\" (UID: \"6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw"
Nov 02 08:41:16.570051 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:16.566859    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-rs4mw\" (UID: \"6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw"
Nov 02 08:41:16.570051 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:16.569579    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf45n\" (UniqueName: \"kubernetes.io/projected/6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db-kube-api-access-xf45n\") pod \"maas-default-gateway-openshift-default-769df7846c-rs4mw\" (UID: \"6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw"
Nov 02 08:41:16.570051 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:16.569620    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-rs4mw\" (UID: \"6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw"
Nov 02 08:41:16.570051 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:16.569668    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-rs4mw\" (UID: \"6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw"
Nov 02 08:41:16.570051 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:16.569714    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-rs4mw\" (UID: \"6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw"
Nov 02 08:41:16.570051 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:16.569776    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-rs4mw\" (UID: \"6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw"
Nov 02 08:41:16.665324 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:16.665292    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw"]
Nov 02 08:41:16.670848 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:16.670816    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-rs4mw\" (UID: \"6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw"
Nov 02 08:41:16.671029 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:16.670872    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-rs4mw\" (UID: \"6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw"
Nov 02 08:41:16.671029 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:16.670939    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-rs4mw\" (UID: \"6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw"
Nov 02 08:41:16.671029 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:16.670980    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-rs4mw\" (UID: \"6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw"
Nov 02 08:41:16.671029 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:16.671025    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf45n\" (UniqueName: \"kubernetes.io/projected/6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db-kube-api-access-xf45n\") pod \"maas-default-gateway-openshift-default-769df7846c-rs4mw\" (UID: \"6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw"
Nov 02 08:41:16.671254 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:16.671051    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-rs4mw\" (UID: \"6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw"
Nov 02 08:41:16.671381 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:16.671360    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-rs4mw\" (UID: \"6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw"
Nov 02 08:41:16.671503 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:16.671482    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-rs4mw\" (UID: \"6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw"
Nov 02 08:41:16.671562 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:16.671523    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-rs4mw\" (UID: \"6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw"
Nov 02 08:41:16.671562 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:16.671552    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-rs4mw\" (UID: \"6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw"
Nov 02 08:41:16.671685 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:16.671636    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-rs4mw\" (UID: \"6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw"
Nov 02 08:41:16.671810 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:16.671788    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-rs4mw\" (UID: \"6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw"
Nov 02 08:41:16.672009 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:16.671988    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-rs4mw\" (UID: \"6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw"
Nov 02 08:41:16.672080 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:16.672010    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-rs4mw\" (UID: \"6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw"
Nov 02 08:41:16.673866 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:16.673837    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-rs4mw\" (UID: \"6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw"
Nov 02 08:41:16.674123 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:16.674078    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-rs4mw\" (UID: \"6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw"
Nov 02 08:41:16.724614 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:16.724544    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-rs4mw\" (UID: \"6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw"
Nov 02 08:41:16.724804 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:16.724784    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf45n\" (UniqueName: \"kubernetes.io/projected/6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db-kube-api-access-xf45n\") pod \"maas-default-gateway-openshift-default-769df7846c-rs4mw\" (UID: \"6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw"
Nov 02 08:41:16.777700 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:16.777675    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw"
Nov 02 08:41:17.199354 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:17.199331    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw"]
Nov 02 08:41:17.201486 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:41:17.201415    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cfb49c1_db8b_4764_b8c5_fbdb57d0a5db.slice/crio-27126afb57c04e6f4c3cc61c16c239d452c31fce562333bf70a9fac4e7218346 WatchSource:0}: Error finding container 27126afb57c04e6f4c3cc61c16c239d452c31fce562333bf70a9fac4e7218346: Status 404 returned error can't find the container with id 27126afb57c04e6f4c3cc61c16c239d452c31fce562333bf70a9fac4e7218346
Nov 02 08:41:17.205084 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:17.205051    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:41:17.205163 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:17.205127    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:41:17.205201 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:17.205164    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:41:18.095985 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:18.095948    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw" event={"ID":"6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db","Type":"ContainerStarted","Data":"3df1086752326444f280ea236d656558783154d194be4e9eb912d50b510c6e69"}
Nov 02 08:41:18.096487 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:18.096004    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw" event={"ID":"6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db","Type":"ContainerStarted","Data":"27126afb57c04e6f4c3cc61c16c239d452c31fce562333bf70a9fac4e7218346"}
Nov 02 08:41:18.297525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:18.297470    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw" podStartSLOduration=2.297455537 podStartE2EDuration="2.297455537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:41:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:41:18.251221979 +0000 UTC m=+2068.009650711" watchObservedRunningTime="2026-11-02 08:41:18.297455537 +0000 UTC m=+2068.055884270"
Nov 02 08:41:18.778759 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:18.778720    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw"
Nov 02 08:41:18.780336 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:18.780307    6210 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-rs4mw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.101:15021/healthz/ready\": dial tcp 10.134.0.101:15021: connect: connection refused" start-of-body=
Nov 02 08:41:18.780462 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:18.780359    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw" podUID="6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.101:15021/healthz/ready\": dial tcp 10.134.0.101:15021: connect: connection refused"
Nov 02 08:41:19.778724 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:19.778681    6210 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-rs4mw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.101:15021/healthz/ready\": dial tcp 10.134.0.101:15021: connect: connection refused" start-of-body=
Nov 02 08:41:19.779283 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:19.778740    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw" podUID="6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.101:15021/healthz/ready\": dial tcp 10.134.0.101:15021: connect: connection refused"
Nov 02 08:41:20.778691 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:20.778639    6210 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-rs4mw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.101:15021/healthz/ready\": dial tcp 10.134.0.101:15021: connect: connection refused" start-of-body=
Nov 02 08:41:20.779037 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:20.778773    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw" podUID="6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.101:15021/healthz/ready\": dial tcp 10.134.0.101:15021: connect: connection refused"
Nov 02 08:41:21.778311 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:21.778272    6210 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-rs4mw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.101:15021/healthz/ready\": dial tcp 10.134.0.101:15021: connect: connection refused" start-of-body=
Nov 02 08:41:21.778610 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:21.778578    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw" podUID="6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.101:15021/healthz/ready\": dial tcp 10.134.0.101:15021: connect: connection refused"
Nov 02 08:41:22.778027 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:22.777992    6210 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-rs4mw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.101:15021/healthz/ready\": dial tcp 10.134.0.101:15021: connect: connection refused" start-of-body=
Nov 02 08:41:22.778519 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:22.778068    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw" podUID="6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.101:15021/healthz/ready\": dial tcp 10.134.0.101:15021: connect: connection refused"
Nov 02 08:41:23.778241 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:23.778200    6210 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-rs4mw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.101:15021/healthz/ready\": dial tcp 10.134.0.101:15021: connect: connection refused" start-of-body=
Nov 02 08:41:23.778779 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:23.778272    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw" podUID="6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.101:15021/healthz/ready\": dial tcp 10.134.0.101:15021: connect: connection refused"
Nov 02 08:41:24.778525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:24.778485    6210 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-rs4mw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.101:15021/healthz/ready\": dial tcp 10.134.0.101:15021: connect: connection refused" start-of-body=
Nov 02 08:41:24.778962 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:24.778541    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw" podUID="6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.101:15021/healthz/ready\": dial tcp 10.134.0.101:15021: connect: connection refused"
Nov 02 08:41:26.298604 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:26.298537    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw"
Nov 02 08:41:26.299561 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:26.299540    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw"
Nov 02 08:41:26.300299 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:26.300278    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw"
Nov 02 08:41:30.058719 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:30.058684    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"]
Nov 02 08:41:30.059432 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:30.059394    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6" podUID="75541fe0-a299-4697-a692-0a0c72d810f1" containerName="istio-proxy" containerID="cri-o://27ef2786d73c2fbc76c950825d1045bce77c299da7ad4d1d059d1cb8817198de" gracePeriod=30
Nov 02 08:41:30.822664 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:41:30.822625    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:41:35.267706 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:35.267668    6210 generic.go:356] "Generic (PLEG): container finished" podID="75541fe0-a299-4697-a692-0a0c72d810f1" containerID="27ef2786d73c2fbc76c950825d1045bce77c299da7ad4d1d059d1cb8817198de" exitCode=0
Nov 02 08:41:35.268121 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:35.267736    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6" event={"ID":"75541fe0-a299-4697-a692-0a0c72d810f1","Type":"ContainerDied","Data":"27ef2786d73c2fbc76c950825d1045bce77c299da7ad4d1d059d1cb8817198de"}
Nov 02 08:41:35.268121 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:35.267791    6210 scope.go:122] "RemoveContainer" containerID="42b8f7925c270402444f1257285b8246975eec3bf74dc3608a4d789ec8352f25"
Nov 02 08:41:35.325702 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:35.325641    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:41:35.393936 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:35.393902    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/75541fe0-a299-4697-a692-0a0c72d810f1-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75541fe0-a299-4697-a692-0a0c72d810f1-workload-socket\") pod \"75541fe0-a299-4697-a692-0a0c72d810f1\" (UID: \"75541fe0-a299-4697-a692-0a0c72d810f1\") "
Nov 02 08:41:35.394094 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:35.393976    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/75541fe0-a299-4697-a692-0a0c72d810f1-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75541fe0-a299-4697-a692-0a0c72d810f1-istio-envoy\") pod \"75541fe0-a299-4697-a692-0a0c72d810f1\" (UID: \"75541fe0-a299-4697-a692-0a0c72d810f1\") "
Nov 02 08:41:35.394094 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:35.394014    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/75541fe0-a299-4697-a692-0a0c72d810f1-kube-api-access-7r6j8\" (UniqueName: \"kubernetes.io/projected/75541fe0-a299-4697-a692-0a0c72d810f1-kube-api-access-7r6j8\") pod \"75541fe0-a299-4697-a692-0a0c72d810f1\" (UID: \"75541fe0-a299-4697-a692-0a0c72d810f1\") "
Nov 02 08:41:35.394094 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:35.394044    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/75541fe0-a299-4697-a692-0a0c72d810f1-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75541fe0-a299-4697-a692-0a0c72d810f1-credential-socket\") pod \"75541fe0-a299-4697-a692-0a0c72d810f1\" (UID: \"75541fe0-a299-4697-a692-0a0c72d810f1\") "
Nov 02 08:41:35.394094 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:35.394080    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/75541fe0-a299-4697-a692-0a0c72d810f1-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75541fe0-a299-4697-a692-0a0c72d810f1-istiod-ca-cert\") pod \"75541fe0-a299-4697-a692-0a0c72d810f1\" (UID: \"75541fe0-a299-4697-a692-0a0c72d810f1\") "
Nov 02 08:41:35.394323 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:35.394129    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75541fe0-a299-4697-a692-0a0c72d810f1-workload-socket" pod "75541fe0-a299-4697-a692-0a0c72d810f1" (UID: "75541fe0-a299-4697-a692-0a0c72d810f1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:41:35.394323 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:35.394147    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/75541fe0-a299-4697-a692-0a0c72d810f1-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75541fe0-a299-4697-a692-0a0c72d810f1-istio-podinfo\") pod \"75541fe0-a299-4697-a692-0a0c72d810f1\" (UID: \"75541fe0-a299-4697-a692-0a0c72d810f1\") "
Nov 02 08:41:35.394323 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:35.394203    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/75541fe0-a299-4697-a692-0a0c72d810f1-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75541fe0-a299-4697-a692-0a0c72d810f1-istio-data\") pod \"75541fe0-a299-4697-a692-0a0c72d810f1\" (UID: \"75541fe0-a299-4697-a692-0a0c72d810f1\") "
Nov 02 08:41:35.394323 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:35.394257    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/75541fe0-a299-4697-a692-0a0c72d810f1-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75541fe0-a299-4697-a692-0a0c72d810f1-workload-certs\") pod \"75541fe0-a299-4697-a692-0a0c72d810f1\" (UID: \"75541fe0-a299-4697-a692-0a0c72d810f1\") "
Nov 02 08:41:35.394544 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:35.394329    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/75541fe0-a299-4697-a692-0a0c72d810f1-istio-token\" (UniqueName: \"kubernetes.io/projected/75541fe0-a299-4697-a692-0a0c72d810f1-istio-token\") pod \"75541fe0-a299-4697-a692-0a0c72d810f1\" (UID: \"75541fe0-a299-4697-a692-0a0c72d810f1\") "
Nov 02 08:41:35.394544 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:35.394474    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75541fe0-a299-4697-a692-0a0c72d810f1-istiod-ca-cert" pod "75541fe0-a299-4697-a692-0a0c72d810f1" (UID: "75541fe0-a299-4697-a692-0a0c72d810f1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:41:35.394713 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:35.394662    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75541fe0-a299-4697-a692-0a0c72d810f1-credential-socket" pod "75541fe0-a299-4697-a692-0a0c72d810f1" (UID: "75541fe0-a299-4697-a692-0a0c72d810f1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:41:35.394713 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:35.394694    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75541fe0-a299-4697-a692-0a0c72d810f1-istio-data" pod "75541fe0-a299-4697-a692-0a0c72d810f1" (UID: "75541fe0-a299-4697-a692-0a0c72d810f1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:41:35.394942 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:35.394917    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75541fe0-a299-4697-a692-0a0c72d810f1-workload-certs" pod "75541fe0-a299-4697-a692-0a0c72d810f1" (UID: "75541fe0-a299-4697-a692-0a0c72d810f1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:41:35.395075 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:35.395044    6210 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75541fe0-a299-4697-a692-0a0c72d810f1-workload-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:41:35.395212 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:35.395171    6210 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75541fe0-a299-4697-a692-0a0c72d810f1-credential-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:41:35.395212 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:35.395186    6210 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75541fe0-a299-4697-a692-0a0c72d810f1-istiod-ca-cert\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:41:35.395340 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:35.395217    6210 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75541fe0-a299-4697-a692-0a0c72d810f1-istio-data\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:41:35.396411 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:35.396385    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75541fe0-a299-4697-a692-0a0c72d810f1-kube-api-access-7r6j8" pod "75541fe0-a299-4697-a692-0a0c72d810f1" (UID: "75541fe0-a299-4697-a692-0a0c72d810f1"). InnerVolumeSpecName "kube-api-access-7r6j8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:41:35.396506 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:35.396460    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75541fe0-a299-4697-a692-0a0c72d810f1-istio-envoy" pod "75541fe0-a299-4697-a692-0a0c72d810f1" (UID: "75541fe0-a299-4697-a692-0a0c72d810f1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:41:35.397005 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:35.396987    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/75541fe0-a299-4697-a692-0a0c72d810f1-istio-podinfo" pod "75541fe0-a299-4697-a692-0a0c72d810f1" (UID: "75541fe0-a299-4697-a692-0a0c72d810f1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 08:41:35.397084 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:35.397063    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75541fe0-a299-4697-a692-0a0c72d810f1-istio-token" pod "75541fe0-a299-4697-a692-0a0c72d810f1" (UID: "75541fe0-a299-4697-a692-0a0c72d810f1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:41:35.496894 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:35.496852    6210 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75541fe0-a299-4697-a692-0a0c72d810f1-istio-podinfo\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:41:35.497054 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:35.496909    6210 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75541fe0-a299-4697-a692-0a0c72d810f1-workload-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:41:35.497054 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:35.496921    6210 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75541fe0-a299-4697-a692-0a0c72d810f1-istio-token\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:41:35.497054 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:35.496929    6210 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75541fe0-a299-4697-a692-0a0c72d810f1-istio-envoy\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:41:35.497054 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:35.496938    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7r6j8\" (UniqueName: \"kubernetes.io/projected/75541fe0-a299-4697-a692-0a0c72d810f1-kube-api-access-7r6j8\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:41:36.275460 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:36.275424    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"
Nov 02 08:41:36.275937 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:36.275469    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6" event={"ID":"75541fe0-a299-4697-a692-0a0c72d810f1","Type":"ContainerDied","Data":"b5dc769a93fc831b666c5de07a6de00a351ee0e06b40d052d379bc97f9d0eaaf"}
Nov 02 08:41:36.275937 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:36.275531    6210 scope.go:122] "RemoveContainer" containerID="27ef2786d73c2fbc76c950825d1045bce77c299da7ad4d1d059d1cb8817198de"
Nov 02 08:41:36.428112 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:36.428081    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"]
Nov 02 08:41:36.474626 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:36.474595    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6"]
Nov 02 08:41:36.770057 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:36.770012    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"]
Nov 02 08:41:36.770318 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:36.770268    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss" podUID="0d4b6238-1d69-4655-b56b-1ea82f38910e" containerName="istio-proxy" containerID="cri-o://431528b82dbb4c48e3ce2fdde3bd1b21c74f4db164080af02b485958277fb954" gracePeriod=30
Nov 02 08:41:38.352574 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:38.352544    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="75541fe0-a299-4697-a692-0a0c72d810f1" path="/var/lib/kubelet/pods/75541fe0-a299-4697-a692-0a0c72d810f1/volumes"
Nov 02 08:41:42.055601 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:42.055572    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"
Nov 02 08:41:42.173735 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:42.173697    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d4b6238-1d69-4655-b56b-1ea82f38910e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d4b6238-1d69-4655-b56b-1ea82f38910e-credential-socket\") pod \"0d4b6238-1d69-4655-b56b-1ea82f38910e\" (UID: \"0d4b6238-1d69-4655-b56b-1ea82f38910e\") "
Nov 02 08:41:42.173949 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:42.173747    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d4b6238-1d69-4655-b56b-1ea82f38910e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d4b6238-1d69-4655-b56b-1ea82f38910e-workload-certs\") pod \"0d4b6238-1d69-4655-b56b-1ea82f38910e\" (UID: \"0d4b6238-1d69-4655-b56b-1ea82f38910e\") "
Nov 02 08:41:42.173949 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:42.173817    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0d4b6238-1d69-4655-b56b-1ea82f38910e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d4b6238-1d69-4655-b56b-1ea82f38910e-istio-podinfo\") pod \"0d4b6238-1d69-4655-b56b-1ea82f38910e\" (UID: \"0d4b6238-1d69-4655-b56b-1ea82f38910e\") "
Nov 02 08:41:42.173949 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:42.173859    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d4b6238-1d69-4655-b56b-1ea82f38910e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d4b6238-1d69-4655-b56b-1ea82f38910e-istio-data\") pod \"0d4b6238-1d69-4655-b56b-1ea82f38910e\" (UID: \"0d4b6238-1d69-4655-b56b-1ea82f38910e\") "
Nov 02 08:41:42.173949 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:42.173938    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0d4b6238-1d69-4655-b56b-1ea82f38910e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d4b6238-1d69-4655-b56b-1ea82f38910e-istiod-ca-cert\") pod \"0d4b6238-1d69-4655-b56b-1ea82f38910e\" (UID: \"0d4b6238-1d69-4655-b56b-1ea82f38910e\") "
Nov 02 08:41:42.174185 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:42.173969    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0d4b6238-1d69-4655-b56b-1ea82f38910e-istio-token\" (UniqueName: \"kubernetes.io/projected/0d4b6238-1d69-4655-b56b-1ea82f38910e-istio-token\") pod \"0d4b6238-1d69-4655-b56b-1ea82f38910e\" (UID: \"0d4b6238-1d69-4655-b56b-1ea82f38910e\") "
Nov 02 08:41:42.174185 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:42.174010    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d4b6238-1d69-4655-b56b-1ea82f38910e-credential-socket" pod "0d4b6238-1d69-4655-b56b-1ea82f38910e" (UID: "0d4b6238-1d69-4655-b56b-1ea82f38910e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:41:42.174185 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:42.174050    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0d4b6238-1d69-4655-b56b-1ea82f38910e-kube-api-access-spmhr\" (UniqueName: \"kubernetes.io/projected/0d4b6238-1d69-4655-b56b-1ea82f38910e-kube-api-access-spmhr\") pod \"0d4b6238-1d69-4655-b56b-1ea82f38910e\" (UID: \"0d4b6238-1d69-4655-b56b-1ea82f38910e\") "
Nov 02 08:41:42.174185 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:42.174097    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d4b6238-1d69-4655-b56b-1ea82f38910e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d4b6238-1d69-4655-b56b-1ea82f38910e-workload-socket\") pod \"0d4b6238-1d69-4655-b56b-1ea82f38910e\" (UID: \"0d4b6238-1d69-4655-b56b-1ea82f38910e\") "
Nov 02 08:41:42.174185 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:42.174158    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d4b6238-1d69-4655-b56b-1ea82f38910e-workload-certs" pod "0d4b6238-1d69-4655-b56b-1ea82f38910e" (UID: "0d4b6238-1d69-4655-b56b-1ea82f38910e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:41:42.174447 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:42.174212    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d4b6238-1d69-4655-b56b-1ea82f38910e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d4b6238-1d69-4655-b56b-1ea82f38910e-istio-envoy\") pod \"0d4b6238-1d69-4655-b56b-1ea82f38910e\" (UID: \"0d4b6238-1d69-4655-b56b-1ea82f38910e\") "
Nov 02 08:41:42.174447 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:42.174216    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d4b6238-1d69-4655-b56b-1ea82f38910e-istio-data" pod "0d4b6238-1d69-4655-b56b-1ea82f38910e" (UID: "0d4b6238-1d69-4655-b56b-1ea82f38910e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:41:42.174447 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:42.174348    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d4b6238-1d69-4655-b56b-1ea82f38910e-workload-socket" pod "0d4b6238-1d69-4655-b56b-1ea82f38910e" (UID: "0d4b6238-1d69-4655-b56b-1ea82f38910e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:41:42.174447 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:42.174379    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d4b6238-1d69-4655-b56b-1ea82f38910e-istiod-ca-cert" pod "0d4b6238-1d69-4655-b56b-1ea82f38910e" (UID: "0d4b6238-1d69-4655-b56b-1ea82f38910e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:41:42.174768 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:42.174737    6210 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d4b6238-1d69-4655-b56b-1ea82f38910e-credential-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:41:42.174768 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:42.174763    6210 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d4b6238-1d69-4655-b56b-1ea82f38910e-workload-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:41:42.174995 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:42.174779    6210 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d4b6238-1d69-4655-b56b-1ea82f38910e-istio-data\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:41:42.174995 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:42.174793    6210 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d4b6238-1d69-4655-b56b-1ea82f38910e-istiod-ca-cert\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:41:42.174995 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:42.174807    6210 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d4b6238-1d69-4655-b56b-1ea82f38910e-workload-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:41:42.176149 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:42.176121    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0d4b6238-1d69-4655-b56b-1ea82f38910e-istio-podinfo" pod "0d4b6238-1d69-4655-b56b-1ea82f38910e" (UID: "0d4b6238-1d69-4655-b56b-1ea82f38910e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 08:41:42.176251 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:42.176191    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d4b6238-1d69-4655-b56b-1ea82f38910e-istio-token" pod "0d4b6238-1d69-4655-b56b-1ea82f38910e" (UID: "0d4b6238-1d69-4655-b56b-1ea82f38910e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:41:42.176251 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:42.176213    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d4b6238-1d69-4655-b56b-1ea82f38910e-istio-envoy" pod "0d4b6238-1d69-4655-b56b-1ea82f38910e" (UID: "0d4b6238-1d69-4655-b56b-1ea82f38910e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:41:42.176251 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:42.176226    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d4b6238-1d69-4655-b56b-1ea82f38910e-kube-api-access-spmhr" pod "0d4b6238-1d69-4655-b56b-1ea82f38910e" (UID: "0d4b6238-1d69-4655-b56b-1ea82f38910e"). InnerVolumeSpecName "kube-api-access-spmhr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:41:42.276565 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:42.276530    6210 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d4b6238-1d69-4655-b56b-1ea82f38910e-istio-podinfo\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:41:42.276565 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:42.276567    6210 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d4b6238-1d69-4655-b56b-1ea82f38910e-istio-token\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:41:42.276766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:42.276584    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spmhr\" (UniqueName: \"kubernetes.io/projected/0d4b6238-1d69-4655-b56b-1ea82f38910e-kube-api-access-spmhr\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:41:42.276766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:42.276600    6210 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d4b6238-1d69-4655-b56b-1ea82f38910e-istio-envoy\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:41:42.310374 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:42.310293    6210 generic.go:356] "Generic (PLEG): container finished" podID="0d4b6238-1d69-4655-b56b-1ea82f38910e" containerID="431528b82dbb4c48e3ce2fdde3bd1b21c74f4db164080af02b485958277fb954" exitCode=0
Nov 02 08:41:42.310374 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:42.310338    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"
Nov 02 08:41:42.310537 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:42.310379    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss" event={"ID":"0d4b6238-1d69-4655-b56b-1ea82f38910e","Type":"ContainerDied","Data":"431528b82dbb4c48e3ce2fdde3bd1b21c74f4db164080af02b485958277fb954"}
Nov 02 08:41:42.310537 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:42.310433    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss" event={"ID":"0d4b6238-1d69-4655-b56b-1ea82f38910e","Type":"ContainerDied","Data":"f2ae726905a90a25ff8dbd5bc175aeff5ce44dc51931bef8408486b59e15fba6"}
Nov 02 08:41:42.310537 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:42.310458    6210 scope.go:122] "RemoveContainer" containerID="431528b82dbb4c48e3ce2fdde3bd1b21c74f4db164080af02b485958277fb954"
Nov 02 08:41:42.320537 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:42.320521    6210 scope.go:122] "RemoveContainer" containerID="431528b82dbb4c48e3ce2fdde3bd1b21c74f4db164080af02b485958277fb954"
Nov 02 08:41:42.320792 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:41:42.320774    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"431528b82dbb4c48e3ce2fdde3bd1b21c74f4db164080af02b485958277fb954\": container with ID starting with 431528b82dbb4c48e3ce2fdde3bd1b21c74f4db164080af02b485958277fb954 not found: ID does not exist" containerID="431528b82dbb4c48e3ce2fdde3bd1b21c74f4db164080af02b485958277fb954"
Nov 02 08:41:42.320844 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:42.320801    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"431528b82dbb4c48e3ce2fdde3bd1b21c74f4db164080af02b485958277fb954"} err="failed to get container status \"431528b82dbb4c48e3ce2fdde3bd1b21c74f4db164080af02b485958277fb954\": rpc error: code = NotFound desc = could not find container \"431528b82dbb4c48e3ce2fdde3bd1b21c74f4db164080af02b485958277fb954\": container with ID starting with 431528b82dbb4c48e3ce2fdde3bd1b21c74f4db164080af02b485958277fb954 not found: ID does not exist"
Nov 02 08:41:42.465653 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:42.465621    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"]
Nov 02 08:41:42.469753 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:42.469729    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss"]
Nov 02 08:41:44.352287 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:44.352255    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0d4b6238-1d69-4655-b56b-1ea82f38910e" path="/var/lib/kubelet/pods/0d4b6238-1d69-4655-b56b-1ea82f38910e/volumes"
Nov 02 08:41:46.672404 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:46.672369    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"]
Nov 02 08:41:46.672868 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:46.672854    6210 cpu_manager.go:414] "containerMap: removing container" podUID="75541fe0-a299-4697-a692-0a0c72d810f1" containerName="istio-proxy"
Nov 02 08:41:46.672947 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:46.672870    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="75541fe0-a299-4697-a692-0a0c72d810f1" containerName="istio-proxy"
Nov 02 08:41:46.672947 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:46.672929    6210 cpu_manager.go:414] "containerMap: removing container" podUID="0d4b6238-1d69-4655-b56b-1ea82f38910e" containerName="istio-proxy"
Nov 02 08:41:46.672947 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:46.672935    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0d4b6238-1d69-4655-b56b-1ea82f38910e" containerName="istio-proxy"
Nov 02 08:41:46.673042 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:46.672999    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="75541fe0-a299-4697-a692-0a0c72d810f1" containerName="istio-proxy"
Nov 02 08:41:46.673042 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:46.673013    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="0d4b6238-1d69-4655-b56b-1ea82f38910e" containerName="istio-proxy"
Nov 02 08:41:46.676770 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:46.676744    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"
Nov 02 08:41:46.830205 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:46.830170    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44308bc3-7924-4f67-9207-5e259da60774-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-h55xg\" (UID: \"44308bc3-7924-4f67-9207-5e259da60774\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"
Nov 02 08:41:46.830205 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:46.830206    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44308bc3-7924-4f67-9207-5e259da60774-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-h55xg\" (UID: \"44308bc3-7924-4f67-9207-5e259da60774\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"
Nov 02 08:41:46.830445 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:46.830320    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44308bc3-7924-4f67-9207-5e259da60774-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-h55xg\" (UID: \"44308bc3-7924-4f67-9207-5e259da60774\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"
Nov 02 08:41:46.830445 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:46.830388    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44308bc3-7924-4f67-9207-5e259da60774-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-h55xg\" (UID: \"44308bc3-7924-4f67-9207-5e259da60774\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"
Nov 02 08:41:46.830523 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:46.830467    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44308bc3-7924-4f67-9207-5e259da60774-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-h55xg\" (UID: \"44308bc3-7924-4f67-9207-5e259da60774\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"
Nov 02 08:41:46.830523 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:46.830489    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44308bc3-7924-4f67-9207-5e259da60774-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-h55xg\" (UID: \"44308bc3-7924-4f67-9207-5e259da60774\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"
Nov 02 08:41:46.830611 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:46.830574    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hwqt\" (UniqueName: \"kubernetes.io/projected/44308bc3-7924-4f67-9207-5e259da60774-kube-api-access-4hwqt\") pod \"maas-default-gateway-openshift-default-769df7846c-h55xg\" (UID: \"44308bc3-7924-4f67-9207-5e259da60774\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"
Nov 02 08:41:46.830611 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:46.830605    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44308bc3-7924-4f67-9207-5e259da60774-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-h55xg\" (UID: \"44308bc3-7924-4f67-9207-5e259da60774\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"
Nov 02 08:41:46.830703 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:46.830641    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44308bc3-7924-4f67-9207-5e259da60774-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-h55xg\" (UID: \"44308bc3-7924-4f67-9207-5e259da60774\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"
Nov 02 08:41:46.882272 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:46.882238    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"]
Nov 02 08:41:46.931383 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:46.931297    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44308bc3-7924-4f67-9207-5e259da60774-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-h55xg\" (UID: \"44308bc3-7924-4f67-9207-5e259da60774\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"
Nov 02 08:41:46.931541 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:46.931402    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44308bc3-7924-4f67-9207-5e259da60774-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-h55xg\" (UID: \"44308bc3-7924-4f67-9207-5e259da60774\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"
Nov 02 08:41:46.931541 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:46.931438    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44308bc3-7924-4f67-9207-5e259da60774-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-h55xg\" (UID: \"44308bc3-7924-4f67-9207-5e259da60774\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"
Nov 02 08:41:46.931541 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:46.931477    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hwqt\" (UniqueName: \"kubernetes.io/projected/44308bc3-7924-4f67-9207-5e259da60774-kube-api-access-4hwqt\") pod \"maas-default-gateway-openshift-default-769df7846c-h55xg\" (UID: \"44308bc3-7924-4f67-9207-5e259da60774\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"
Nov 02 08:41:46.931541 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:46.931516    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44308bc3-7924-4f67-9207-5e259da60774-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-h55xg\" (UID: \"44308bc3-7924-4f67-9207-5e259da60774\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"
Nov 02 08:41:46.931770 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:46.931569    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44308bc3-7924-4f67-9207-5e259da60774-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-h55xg\" (UID: \"44308bc3-7924-4f67-9207-5e259da60774\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"
Nov 02 08:41:46.931770 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:46.931631    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44308bc3-7924-4f67-9207-5e259da60774-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-h55xg\" (UID: \"44308bc3-7924-4f67-9207-5e259da60774\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"
Nov 02 08:41:46.931770 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:46.931656    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44308bc3-7924-4f67-9207-5e259da60774-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-h55xg\" (UID: \"44308bc3-7924-4f67-9207-5e259da60774\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"
Nov 02 08:41:46.931770 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:46.931719    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44308bc3-7924-4f67-9207-5e259da60774-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-h55xg\" (UID: \"44308bc3-7924-4f67-9207-5e259da60774\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"
Nov 02 08:41:46.932032 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:46.932004    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44308bc3-7924-4f67-9207-5e259da60774-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-h55xg\" (UID: \"44308bc3-7924-4f67-9207-5e259da60774\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"
Nov 02 08:41:46.932098 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:46.932028    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44308bc3-7924-4f67-9207-5e259da60774-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-h55xg\" (UID: \"44308bc3-7924-4f67-9207-5e259da60774\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"
Nov 02 08:41:46.932160 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:46.932100    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44308bc3-7924-4f67-9207-5e259da60774-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-h55xg\" (UID: \"44308bc3-7924-4f67-9207-5e259da60774\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"
Nov 02 08:41:46.932197 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:46.932150    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44308bc3-7924-4f67-9207-5e259da60774-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-h55xg\" (UID: \"44308bc3-7924-4f67-9207-5e259da60774\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"
Nov 02 08:41:46.932253 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:46.932230    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44308bc3-7924-4f67-9207-5e259da60774-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-h55xg\" (UID: \"44308bc3-7924-4f67-9207-5e259da60774\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"
Nov 02 08:41:46.933732 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:46.933708    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44308bc3-7924-4f67-9207-5e259da60774-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-h55xg\" (UID: \"44308bc3-7924-4f67-9207-5e259da60774\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"
Nov 02 08:41:46.934030 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:46.934011    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44308bc3-7924-4f67-9207-5e259da60774-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-h55xg\" (UID: \"44308bc3-7924-4f67-9207-5e259da60774\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"
Nov 02 08:41:46.985471 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:46.985428    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44308bc3-7924-4f67-9207-5e259da60774-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-h55xg\" (UID: \"44308bc3-7924-4f67-9207-5e259da60774\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"
Nov 02 08:41:46.985629 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:46.985559    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hwqt\" (UniqueName: \"kubernetes.io/projected/44308bc3-7924-4f67-9207-5e259da60774-kube-api-access-4hwqt\") pod \"maas-default-gateway-openshift-default-769df7846c-h55xg\" (UID: \"44308bc3-7924-4f67-9207-5e259da60774\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"
Nov 02 08:41:46.990304 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:46.990278    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"
Nov 02 08:41:47.402106 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:47.402079    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"]
Nov 02 08:41:47.404742 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:41:47.404707    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44308bc3_7924_4f67_9207_5e259da60774.slice/crio-db4c99bd8976894372fb013b59843635d23e4cc4fa412e4406a8f7a76430214a WatchSource:0}: Error finding container db4c99bd8976894372fb013b59843635d23e4cc4fa412e4406a8f7a76430214a: Status 404 returned error can't find the container with id db4c99bd8976894372fb013b59843635d23e4cc4fa412e4406a8f7a76430214a
Nov 02 08:41:47.407202 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:47.407164    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:41:47.407300 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:47.407250    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:41:47.407341 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:47.407294    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:41:47.998836 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:47.998792    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"]
Nov 02 08:41:47.999652 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:47.999630    6210 cpu_manager.go:414] "containerMap: removing container" podUID="75541fe0-a299-4697-a692-0a0c72d810f1" containerName="istio-proxy"
Nov 02 08:41:47.999713 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:47.999656    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="75541fe0-a299-4697-a692-0a0c72d810f1" containerName="istio-proxy"
Nov 02 08:41:47.999827 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:47.999808    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="75541fe0-a299-4697-a692-0a0c72d810f1" containerName="istio-proxy"
Nov 02 08:41:48.004040 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.004018    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"
Nov 02 08:41:48.056487 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.056455    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-9ceb40-openshift-default-dockercfg-6d8wp\""
Nov 02 08:41:48.106129 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.106094    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"]
Nov 02 08:41:48.147247 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.147216    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-istio-token\") pod \"e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc\" (UID: \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\") " pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"
Nov 02 08:41:48.147415 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.147257    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-workload-socket\") pod \"e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc\" (UID: \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\") " pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"
Nov 02 08:41:48.147415 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.147343    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-istio-podinfo\") pod \"e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc\" (UID: \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\") " pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"
Nov 02 08:41:48.147490 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.147471    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-credential-socket\") pod \"e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc\" (UID: \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\") " pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"
Nov 02 08:41:48.147560 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.147544    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-workload-certs\") pod \"e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc\" (UID: \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\") " pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"
Nov 02 08:41:48.147600 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.147589    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-istiod-ca-cert\") pod \"e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc\" (UID: \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\") " pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"
Nov 02 08:41:48.147671 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.147659    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-istio-envoy\") pod \"e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc\" (UID: \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\") " pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"
Nov 02 08:41:48.147703 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.147695    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-istio-data\") pod \"e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc\" (UID: \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\") " pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"
Nov 02 08:41:48.147736 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.147710    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvns8\" (UniqueName: \"kubernetes.io/projected/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-kube-api-access-nvns8\") pod \"e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc\" (UID: \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\") " pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"
Nov 02 08:41:48.249070 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.248981    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-workload-certs\") pod \"e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc\" (UID: \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\") " pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"
Nov 02 08:41:48.249070 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.249022    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-istiod-ca-cert\") pod \"e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc\" (UID: \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\") " pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"
Nov 02 08:41:48.249262 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.249154    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-istio-envoy\") pod \"e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc\" (UID: \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\") " pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"
Nov 02 08:41:48.249262 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.249205    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-istio-data\") pod \"e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc\" (UID: \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\") " pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"
Nov 02 08:41:48.249262 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.249231    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvns8\" (UniqueName: \"kubernetes.io/projected/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-kube-api-access-nvns8\") pod \"e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc\" (UID: \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\") " pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"
Nov 02 08:41:48.249419 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.249282    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-istio-token\") pod \"e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc\" (UID: \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\") " pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"
Nov 02 08:41:48.249419 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.249324    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-workload-socket\") pod \"e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc\" (UID: \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\") " pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"
Nov 02 08:41:48.249539 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.249507    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-istio-podinfo\") pod \"e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc\" (UID: \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\") " pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"
Nov 02 08:41:48.249625 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.249593    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-workload-socket\") pod \"e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc\" (UID: \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\") " pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"
Nov 02 08:41:48.249670 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.249618    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-istio-data\") pod \"e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc\" (UID: \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\") " pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"
Nov 02 08:41:48.249670 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.249655    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-credential-socket\") pod \"e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc\" (UID: \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\") " pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"
Nov 02 08:41:48.249764 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.249739    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-workload-certs\") pod \"e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc\" (UID: \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\") " pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"
Nov 02 08:41:48.249764 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.249751    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-istiod-ca-cert\") pod \"e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc\" (UID: \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\") " pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"
Nov 02 08:41:48.250018 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.249993    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-credential-socket\") pod \"e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc\" (UID: \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\") " pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"
Nov 02 08:41:48.251421 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.251398    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-istio-envoy\") pod \"e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc\" (UID: \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\") " pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"
Nov 02 08:41:48.251765 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.251746    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-istio-podinfo\") pod \"e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc\" (UID: \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\") " pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"
Nov 02 08:41:48.327660 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.327622    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvns8\" (UniqueName: \"kubernetes.io/projected/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-kube-api-access-nvns8\") pod \"e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc\" (UID: \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\") " pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"
Nov 02 08:41:48.330103 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.330046    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-istio-token\") pod \"e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc\" (UID: \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\") " pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"
Nov 02 08:41:48.337749 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.337729    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"
Nov 02 08:41:48.351607 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.351579    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg" event={"ID":"44308bc3-7924-4f67-9207-5e259da60774","Type":"ContainerStarted","Data":"71b54a3e0aba91f64f53acac5147c3807e16ac7a3c7b9a39103c7e4964848727"}
Nov 02 08:41:48.351710 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.351624    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg" event={"ID":"44308bc3-7924-4f67-9207-5e259da60774","Type":"ContainerStarted","Data":"db4c99bd8976894372fb013b59843635d23e4cc4fa412e4406a8f7a76430214a"}
Nov 02 08:41:48.753039 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.752271    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg" podStartSLOduration=2.752253547 podStartE2EDuration="2.752253547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:41:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:41:48.46191463 +0000 UTC m=+2098.220343363" watchObservedRunningTime="2026-11-02 08:41:48.752253547 +0000 UTC m=+2098.510682281"
Nov 02 08:41:48.754378 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.754351    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"]
Nov 02 08:41:48.758011 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:41:48.757984    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba783530_7ca4_4b53_95c3_dcbbb6edd53a.slice/crio-52894317ea09618d9ab9ba987b0b39c8fa173db9f73301231989c8251502d9e4 WatchSource:0}: Error finding container 52894317ea09618d9ab9ba987b0b39c8fa173db9f73301231989c8251502d9e4: Status 404 returned error can't find the container with id 52894317ea09618d9ab9ba987b0b39c8fa173db9f73301231989c8251502d9e4
Nov 02 08:41:48.764041 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.764008    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:41:48.764113 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.764074    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:41:48.764159 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.764112    6210 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 08:41:48.991278 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.991246    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"
Nov 02 08:41:48.992527 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.992497    6210 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-h55xg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.102:15021/healthz/ready\": dial tcp 10.134.0.102:15021: connect: connection refused" start-of-body=
Nov 02 08:41:48.992630 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:48.992559    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg" podUID="44308bc3-7924-4f67-9207-5e259da60774" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.102:15021/healthz/ready\": dial tcp 10.134.0.102:15021: connect: connection refused"
Nov 02 08:41:49.358969 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:49.358931    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc" event={"ID":"ba783530-7ca4-4b53-95c3-dcbbb6edd53a","Type":"ContainerStarted","Data":"3fed9145472723d764b044bef1d414bef1d083b82930a375bfec791702252948"}
Nov 02 08:41:49.360154 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:49.360131    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc" event={"ID":"ba783530-7ca4-4b53-95c3-dcbbb6edd53a","Type":"ContainerStarted","Data":"52894317ea09618d9ab9ba987b0b39c8fa173db9f73301231989c8251502d9e4"}
Nov 02 08:41:49.473252 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:49.473206    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc" podStartSLOduration=2.47319144 podStartE2EDuration="2.47319144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:41:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:41:49.471356043 +0000 UTC m=+2099.229784777" watchObservedRunningTime="2026-11-02 08:41:49.47319144 +0000 UTC m=+2099.231620166"
Nov 02 08:41:49.653979 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:49.653724    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69"]
Nov 02 08:41:49.657816 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:49.657797    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69"
Nov 02 08:41:49.726904 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:49.712404    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-praxis-b-ad4580-serving-cert\""
Nov 02 08:41:49.749905 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:49.742764    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69"]
Nov 02 08:41:49.767627 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:49.767572    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6-maas-api-tls\") pod \"maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69\" (UID: \"88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69"
Nov 02 08:41:49.767824 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:49.767787    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6-openshift-service-ca\") pod \"maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69\" (UID: \"88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69"
Nov 02 08:41:49.767928 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:49.767823    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6-metrics-certs\") pod \"maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69\" (UID: \"88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69"
Nov 02 08:41:49.767990 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:49.767933    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn6p2\" (UniqueName: \"kubernetes.io/projected/88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6-kube-api-access-sn6p2\") pod \"maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69\" (UID: \"88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69"
Nov 02 08:41:49.868673 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:49.868646    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6-openshift-service-ca\") pod \"maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69\" (UID: \"88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69"
Nov 02 08:41:49.868929 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:49.868911    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6-metrics-certs\") pod \"maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69\" (UID: \"88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69"
Nov 02 08:41:49.869111 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:49.869099    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn6p2\" (UniqueName: \"kubernetes.io/projected/88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6-kube-api-access-sn6p2\") pod \"maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69\" (UID: \"88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69"
Nov 02 08:41:49.869231 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:49.869221    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6-maas-api-tls\") pod \"maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69\" (UID: \"88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69"
Nov 02 08:41:49.869521 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:41:49.869498    6210 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-praxis-b-ad4580-serving-cert: secret "maas-api-e2e-praxis-b-ad4580-serving-cert" not found
Nov 02 08:41:49.869708 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:41:49.869683    6210 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6-maas-api-tls podName:88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6 nodeName:}" failed. No retries permitted until 2026-11-02 08:41:50.369660307 +0000 UTC m=+2100.128089033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6-maas-api-tls") pod "maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69" (UID: "88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6") : secret "maas-api-e2e-praxis-b-ad4580-serving-cert" not found
Nov 02 08:41:49.870994 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:49.870975    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6-openshift-service-ca\") pod \"maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69\" (UID: \"88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69"
Nov 02 08:41:49.873655 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:49.873630    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6-metrics-certs\") pod \"maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69\" (UID: \"88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69"
Nov 02 08:41:49.939092 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:49.935793    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn6p2\" (UniqueName: \"kubernetes.io/projected/88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6-kube-api-access-sn6p2\") pod \"maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69\" (UID: \"88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69"
Nov 02 08:41:49.998913 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:49.994210    6210 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-h55xg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.102:15021/healthz/ready\": dial tcp 10.134.0.102:15021: connect: connection refused" start-of-body=
Nov 02 08:41:49.998913 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:49.994269    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg" podUID="44308bc3-7924-4f67-9207-5e259da60774" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.102:15021/healthz/ready\": dial tcp 10.134.0.102:15021: connect: connection refused"
Nov 02 08:41:50.354807 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:50.354770    6210 patch_prober.go:29] interesting pod/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.103:15021/healthz/ready\": dial tcp 10.134.0.103:15021: connect: connection refused" start-of-body=
Nov 02 08:41:50.355005 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:50.354828    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc" podUID="ba783530-7ca4-4b53-95c3-dcbbb6edd53a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.103:15021/healthz/ready\": dial tcp 10.134.0.103:15021: connect: connection refused"
Nov 02 08:41:50.359391 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:50.359367    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"
Nov 02 08:41:50.379823 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:50.379795    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6-maas-api-tls\") pod \"maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69\" (UID: \"88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69"
Nov 02 08:41:50.382246 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:50.382224    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6-maas-api-tls\") pod \"maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69\" (UID: \"88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69"
Nov 02 08:41:50.572305 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:50.572268    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69"
Nov 02 08:41:50.695619 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:50.693131    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q_f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae/extract/0.log"
Nov 02 08:41:50.696715 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:50.696693    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q_f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae/extract/0.log"
Nov 02 08:41:50.771153 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:50.771119    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb77f_3e7ae74c-fcd8-4820-a8b7-769a5fff9f15/ovn-acl-logging/0.log"
Nov 02 08:41:50.773291 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:50.773269    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb77f_3e7ae74c-fcd8-4820-a8b7-769a5fff9f15/ovn-acl-logging/0.log"
Nov 02 08:41:50.885537 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:50.885513    6210 scope.go:122] "RemoveContainer" containerID="228ebeac28a204756ffeabe93aa7de20170e63b6ddcad033490d1030a94e3a5a"
Nov 02 08:41:50.991159 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:50.991132    6210 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-h55xg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.102:15021/healthz/ready\": dial tcp 10.134.0.102:15021: connect: connection refused" start-of-body=
Nov 02 08:41:50.991261 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:50.991184    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg" podUID="44308bc3-7924-4f67-9207-5e259da60774" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.102:15021/healthz/ready\": dial tcp 10.134.0.102:15021: connect: connection refused"
Nov 02 08:41:50.998174 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:50.998151    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69"]
Nov 02 08:41:51.051928 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:51.051495    6210 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 02 08:41:51.359618 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:51.359395    6210 patch_prober.go:29] interesting pod/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.103:15021/healthz/ready\": dial tcp 10.134.0.103:15021: connect: connection refused" start-of-body=
Nov 02 08:41:51.359618 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:51.359456    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc" podUID="ba783530-7ca4-4b53-95c3-dcbbb6edd53a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.103:15021/healthz/ready\": dial tcp 10.134.0.103:15021: connect: connection refused"
Nov 02 08:41:51.372900 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:51.371405    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69" event={"ID":"88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6","Type":"ContainerStarted","Data":"a0d9020a84b637d0117e42bed35f1218b1771cd43aa65b47ab2d3412d7e8aff0"}
Nov 02 08:41:51.996904 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:51.995270    6210 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-h55xg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.102:15021/healthz/ready\": dial tcp 10.134.0.102:15021: connect: connection refused" start-of-body=
Nov 02 08:41:51.996904 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:51.995330    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg" podUID="44308bc3-7924-4f67-9207-5e259da60774" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.102:15021/healthz/ready\": dial tcp 10.134.0.102:15021: connect: connection refused"
Nov 02 08:41:52.341766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:52.341649    6210 patch_prober.go:29] interesting pod/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.103:15021/healthz/ready\": dial tcp 10.134.0.103:15021: connect: connection refused" start-of-body=
Nov 02 08:41:52.341766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:52.341705    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc" podUID="ba783530-7ca4-4b53-95c3-dcbbb6edd53a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.103:15021/healthz/ready\": dial tcp 10.134.0.103:15021: connect: connection refused"
Nov 02 08:41:52.380429 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:52.380397    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69" event={"ID":"88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6","Type":"ContainerStarted","Data":"ba936b859057f316a4a79468e7983719512b3a7d1d9eae98ff15a44a416bee94"}
Nov 02 08:41:52.380818 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:52.380523    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69"
Nov 02 08:41:52.499994 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:52.499927    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69" podStartSLOduration=2.411728414 podStartE2EDuration="3.499908955s" totalImagesPullingTime="1.088180541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:41:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:41:52.499142851 +0000 UTC m=+2102.257571589" watchObservedRunningTime="2026-11-02 08:41:52.499908955 +0000 UTC m=+2102.258337688"
Nov 02 08:41:53.000903 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:52.994249    6210 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-h55xg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.102:15021/healthz/ready\": dial tcp 10.134.0.102:15021: connect: connection refused" start-of-body=
Nov 02 08:41:53.000903 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:52.994311    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg" podUID="44308bc3-7924-4f67-9207-5e259da60774" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.102:15021/healthz/ready\": dial tcp 10.134.0.102:15021: connect: connection refused"
Nov 02 08:41:53.339960 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:53.339407    6210 patch_prober.go:29] interesting pod/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.103:15021/healthz/ready\": dial tcp 10.134.0.103:15021: connect: connection refused" start-of-body=
Nov 02 08:41:53.339960 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:53.339469    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc" podUID="ba783530-7ca4-4b53-95c3-dcbbb6edd53a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.103:15021/healthz/ready\": dial tcp 10.134.0.103:15021: connect: connection refused"
Nov 02 08:41:53.991079 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:53.991043    6210 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-h55xg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.102:15021/healthz/ready\": dial tcp 10.134.0.102:15021: connect: connection refused" start-of-body=
Nov 02 08:41:53.991505 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:53.991100    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg" podUID="44308bc3-7924-4f67-9207-5e259da60774" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.102:15021/healthz/ready\": dial tcp 10.134.0.102:15021: connect: connection refused"
Nov 02 08:41:54.339176 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:54.339097    6210 patch_prober.go:29] interesting pod/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.103:15021/healthz/ready\": dial tcp 10.134.0.103:15021: connect: connection refused" start-of-body=
Nov 02 08:41:54.339176 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:54.339150    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc" podUID="ba783530-7ca4-4b53-95c3-dcbbb6edd53a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.103:15021/healthz/ready\": dial tcp 10.134.0.103:15021: connect: connection refused"
Nov 02 08:41:54.991747 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:54.991697    6210 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-h55xg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.102:15021/healthz/ready\": dial tcp 10.134.0.102:15021: connect: connection refused" start-of-body=
Nov 02 08:41:54.992302 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:54.991776    6210 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg" podUID="44308bc3-7924-4f67-9207-5e259da60774" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.102:15021/healthz/ready\": dial tcp 10.134.0.102:15021: connect: connection refused"
Nov 02 08:41:55.344081 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:55.344003    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"
Nov 02 08:41:55.344338 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:55.344304    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"
Nov 02 08:41:55.345057 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:55.345023    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"
Nov 02 08:41:56.128373 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:56.128339    6210 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"
Nov 02 08:41:56.128912 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:56.128773    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"
Nov 02 08:41:56.129698 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:56.129675    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"
Nov 02 08:41:58.392307 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:41:58.392278    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69"
Nov 02 08:42:00.820939 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:42:00.820873    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:42:06.035419 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.035381    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9"]
Nov 02 08:42:06.035861 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.035596    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9" podUID="2150ad95-e6b8-4529-b40c-83119a744da3" containerName="maas-api" containerID="cri-o://677e4546b8aa066086d061e5dc47da6c944fa3bec41218f22df64a134a9c0f9e" gracePeriod=30
Nov 02 08:42:06.137584 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.137541    6210 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9" podUID="2150ad95-e6b8-4529-b40c-83119a744da3" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.93:8443/health\": dial tcp 10.134.0.93:8443: connect: connection refused"
Nov 02 08:42:06.361870 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.361840    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9"
Nov 02 08:42:06.393867 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.393839    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2150ad95-e6b8-4529-b40c-83119a744da3-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2150ad95-e6b8-4529-b40c-83119a744da3-openshift-service-ca\") pod \"2150ad95-e6b8-4529-b40c-83119a744da3\" (UID: \"2150ad95-e6b8-4529-b40c-83119a744da3\") "
Nov 02 08:42:06.394047 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.394026    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2150ad95-e6b8-4529-b40c-83119a744da3-metrics-certs\" (UniqueName: \"kubernetes.io/secret/2150ad95-e6b8-4529-b40c-83119a744da3-metrics-certs\") pod \"2150ad95-e6b8-4529-b40c-83119a744da3\" (UID: \"2150ad95-e6b8-4529-b40c-83119a744da3\") "
Nov 02 08:42:06.394106 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.394064    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2150ad95-e6b8-4529-b40c-83119a744da3-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2150ad95-e6b8-4529-b40c-83119a744da3-maas-api-tls\") pod \"2150ad95-e6b8-4529-b40c-83119a744da3\" (UID: \"2150ad95-e6b8-4529-b40c-83119a744da3\") "
Nov 02 08:42:06.394298 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.394253    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2150ad95-e6b8-4529-b40c-83119a744da3-kube-api-access-mptmk\" (UniqueName: \"kubernetes.io/projected/2150ad95-e6b8-4529-b40c-83119a744da3-kube-api-access-mptmk\") pod \"2150ad95-e6b8-4529-b40c-83119a744da3\" (UID: \"2150ad95-e6b8-4529-b40c-83119a744da3\") "
Nov 02 08:42:06.394390 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.394255    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2150ad95-e6b8-4529-b40c-83119a744da3-openshift-service-ca" pod "2150ad95-e6b8-4529-b40c-83119a744da3" (UID: "2150ad95-e6b8-4529-b40c-83119a744da3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:42:06.394813 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.394789    6210 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2150ad95-e6b8-4529-b40c-83119a744da3-openshift-service-ca\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:42:06.396726 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.396695    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2150ad95-e6b8-4529-b40c-83119a744da3-kube-api-access-mptmk" pod "2150ad95-e6b8-4529-b40c-83119a744da3" (UID: "2150ad95-e6b8-4529-b40c-83119a744da3"). InnerVolumeSpecName "kube-api-access-mptmk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:42:06.396834 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.396746    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2150ad95-e6b8-4529-b40c-83119a744da3-maas-api-tls" pod "2150ad95-e6b8-4529-b40c-83119a744da3" (UID: "2150ad95-e6b8-4529-b40c-83119a744da3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:42:06.396834 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.396798    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2150ad95-e6b8-4529-b40c-83119a744da3-metrics-certs" pod "2150ad95-e6b8-4529-b40c-83119a744da3" (UID: "2150ad95-e6b8-4529-b40c-83119a744da3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:42:06.483432 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.483387    6210 generic.go:356] "Generic (PLEG): container finished" podID="2150ad95-e6b8-4529-b40c-83119a744da3" containerID="677e4546b8aa066086d061e5dc47da6c944fa3bec41218f22df64a134a9c0f9e" exitCode=0
Nov 02 08:42:06.484019 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.483989    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9" event={"ID":"2150ad95-e6b8-4529-b40c-83119a744da3","Type":"ContainerDied","Data":"677e4546b8aa066086d061e5dc47da6c944fa3bec41218f22df64a134a9c0f9e"}
Nov 02 08:42:06.484279 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.484263    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9" event={"ID":"2150ad95-e6b8-4529-b40c-83119a744da3","Type":"ContainerDied","Data":"cef074985c454224999a335f69690effb24514e0bead4be2ece8663cfc1c1f17"}
Nov 02 08:42:06.484432 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.484418    6210 scope.go:122] "RemoveContainer" containerID="677e4546b8aa066086d061e5dc47da6c944fa3bec41218f22df64a134a9c0f9e"
Nov 02 08:42:06.484656 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.484193    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9"
Nov 02 08:42:06.496857 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.496786    6210 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2150ad95-e6b8-4529-b40c-83119a744da3-metrics-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:42:06.496857 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.496818    6210 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2150ad95-e6b8-4529-b40c-83119a744da3-maas-api-tls\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:42:06.496857 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.496833    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mptmk\" (UniqueName: \"kubernetes.io/projected/2150ad95-e6b8-4529-b40c-83119a744da3-kube-api-access-mptmk\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:42:06.506944 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.506709    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg"]
Nov 02 08:42:06.507524 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.507493    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg" podUID="65a5b2a1-a374-4ba9-9330-91c77e3a2f2b" containerName="payload-processing" containerID="cri-o://3ff24aab7063d5cc050166add695c7304fbbd1bde9ef9b2662d1d5fa96e8b8c8" gracePeriod=30
Nov 02 08:42:06.521795 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.521406    6210 scope.go:122] "RemoveContainer" containerID="677e4546b8aa066086d061e5dc47da6c944fa3bec41218f22df64a134a9c0f9e"
Nov 02 08:42:06.522813 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:42:06.522785    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"677e4546b8aa066086d061e5dc47da6c944fa3bec41218f22df64a134a9c0f9e\": container with ID starting with 677e4546b8aa066086d061e5dc47da6c944fa3bec41218f22df64a134a9c0f9e not found: ID does not exist" containerID="677e4546b8aa066086d061e5dc47da6c944fa3bec41218f22df64a134a9c0f9e"
Nov 02 08:42:06.523045 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.523017    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"677e4546b8aa066086d061e5dc47da6c944fa3bec41218f22df64a134a9c0f9e"} err="failed to get container status \"677e4546b8aa066086d061e5dc47da6c944fa3bec41218f22df64a134a9c0f9e\": rpc error: code = NotFound desc = could not find container \"677e4546b8aa066086d061e5dc47da6c944fa3bec41218f22df64a134a9c0f9e\": container with ID starting with 677e4546b8aa066086d061e5dc47da6c944fa3bec41218f22df64a134a9c0f9e not found: ID does not exist"
Nov 02 08:42:06.566811 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.566786    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg"]
Nov 02 08:42:06.566997 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.566978    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg" podUID="37c3a1ab-c654-4773-b912-7f0a9b7df6b7" containerName="payload-pre-processing" containerID="cri-o://45dee344696d049aed4c22b9985abda60d17b62c094b04a1c157779cc36cea21" gracePeriod=30
Nov 02 08:42:06.642834 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.642761    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9"]
Nov 02 08:42:06.648244 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.648210    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-45fc31-55855567b7-gtvw9"]
Nov 02 08:42:06.832248 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.832218    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg"
Nov 02 08:42:06.848277 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.848255    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg"
Nov 02 08:42:06.901108 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.901038    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/37c3a1ab-c654-4773-b912-7f0a9b7df6b7-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37c3a1ab-c654-4773-b912-7f0a9b7df6b7-plugins-config-volume\") pod \"37c3a1ab-c654-4773-b912-7f0a9b7df6b7\" (UID: \"37c3a1ab-c654-4773-b912-7f0a9b7df6b7\") "
Nov 02 08:42:06.901108 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.901106    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/65a5b2a1-a374-4ba9-9330-91c77e3a2f2b-kube-api-access-hwq5z\" (UniqueName: \"kubernetes.io/projected/65a5b2a1-a374-4ba9-9330-91c77e3a2f2b-kube-api-access-hwq5z\") pod \"65a5b2a1-a374-4ba9-9330-91c77e3a2f2b\" (UID: \"65a5b2a1-a374-4ba9-9330-91c77e3a2f2b\") "
Nov 02 08:42:06.901351 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.901157    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/37c3a1ab-c654-4773-b912-7f0a9b7df6b7-kube-api-access-nxzkl\" (UniqueName: \"kubernetes.io/projected/37c3a1ab-c654-4773-b912-7f0a9b7df6b7-kube-api-access-nxzkl\") pod \"37c3a1ab-c654-4773-b912-7f0a9b7df6b7\" (UID: \"37c3a1ab-c654-4773-b912-7f0a9b7df6b7\") "
Nov 02 08:42:06.901351 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.901211    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/65a5b2a1-a374-4ba9-9330-91c77e3a2f2b-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/65a5b2a1-a374-4ba9-9330-91c77e3a2f2b-plugins-config-volume\") pod \"65a5b2a1-a374-4ba9-9330-91c77e3a2f2b\" (UID: \"65a5b2a1-a374-4ba9-9330-91c77e3a2f2b\") "
Nov 02 08:42:06.901507 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.901482    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37c3a1ab-c654-4773-b912-7f0a9b7df6b7-plugins-config-volume" pod "37c3a1ab-c654-4773-b912-7f0a9b7df6b7" (UID: "37c3a1ab-c654-4773-b912-7f0a9b7df6b7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:42:06.901721 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.901697    6210 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37c3a1ab-c654-4773-b912-7f0a9b7df6b7-plugins-config-volume\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:42:06.901940 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.901917    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65a5b2a1-a374-4ba9-9330-91c77e3a2f2b-plugins-config-volume" pod "65a5b2a1-a374-4ba9-9330-91c77e3a2f2b" (UID: "65a5b2a1-a374-4ba9-9330-91c77e3a2f2b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:42:06.903475 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.903455    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37c3a1ab-c654-4773-b912-7f0a9b7df6b7-kube-api-access-nxzkl" pod "37c3a1ab-c654-4773-b912-7f0a9b7df6b7" (UID: "37c3a1ab-c654-4773-b912-7f0a9b7df6b7"). InnerVolumeSpecName "kube-api-access-nxzkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:42:06.903568 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:06.903480    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65a5b2a1-a374-4ba9-9330-91c77e3a2f2b-kube-api-access-hwq5z" pod "65a5b2a1-a374-4ba9-9330-91c77e3a2f2b" (UID: "65a5b2a1-a374-4ba9-9330-91c77e3a2f2b"). InnerVolumeSpecName "kube-api-access-hwq5z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:42:07.002414 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:07.002383    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwq5z\" (UniqueName: \"kubernetes.io/projected/65a5b2a1-a374-4ba9-9330-91c77e3a2f2b-kube-api-access-hwq5z\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:42:07.002414 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:07.002412    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxzkl\" (UniqueName: \"kubernetes.io/projected/37c3a1ab-c654-4773-b912-7f0a9b7df6b7-kube-api-access-nxzkl\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:42:07.002644 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:07.002424    6210 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/65a5b2a1-a374-4ba9-9330-91c77e3a2f2b-plugins-config-volume\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:42:07.490911 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:07.490866    6210 generic.go:356] "Generic (PLEG): container finished" podID="37c3a1ab-c654-4773-b912-7f0a9b7df6b7" containerID="45dee344696d049aed4c22b9985abda60d17b62c094b04a1c157779cc36cea21" exitCode=0
Nov 02 08:42:07.491378 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:07.490926    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg"
Nov 02 08:42:07.491378 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:07.490950    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg" event={"ID":"37c3a1ab-c654-4773-b912-7f0a9b7df6b7","Type":"ContainerDied","Data":"45dee344696d049aed4c22b9985abda60d17b62c094b04a1c157779cc36cea21"}
Nov 02 08:42:07.491378 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:07.491009    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg" event={"ID":"37c3a1ab-c654-4773-b912-7f0a9b7df6b7","Type":"ContainerDied","Data":"55bce8962c7df68a6ea074879d2e1856c206be71f2a8bafb6baa8469548f83a9"}
Nov 02 08:42:07.491378 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:07.491041    6210 scope.go:122] "RemoveContainer" containerID="45dee344696d049aed4c22b9985abda60d17b62c094b04a1c157779cc36cea21"
Nov 02 08:42:07.492611 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:07.492592    6210 generic.go:356] "Generic (PLEG): container finished" podID="65a5b2a1-a374-4ba9-9330-91c77e3a2f2b" containerID="3ff24aab7063d5cc050166add695c7304fbbd1bde9ef9b2662d1d5fa96e8b8c8" exitCode=0
Nov 02 08:42:07.492724 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:07.492641    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg"
Nov 02 08:42:07.492724 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:07.492684    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg" event={"ID":"65a5b2a1-a374-4ba9-9330-91c77e3a2f2b","Type":"ContainerDied","Data":"3ff24aab7063d5cc050166add695c7304fbbd1bde9ef9b2662d1d5fa96e8b8c8"}
Nov 02 08:42:07.492921 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:07.492740    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg" event={"ID":"65a5b2a1-a374-4ba9-9330-91c77e3a2f2b","Type":"ContainerDied","Data":"6ad6a0a74912a15b8d93006ea52a7b0bf5cc15ebc122930952295c47ba0be979"}
Nov 02 08:42:07.502179 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:07.502162    6210 scope.go:122] "RemoveContainer" containerID="45dee344696d049aed4c22b9985abda60d17b62c094b04a1c157779cc36cea21"
Nov 02 08:42:07.502465 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:42:07.502445    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45dee344696d049aed4c22b9985abda60d17b62c094b04a1c157779cc36cea21\": container with ID starting with 45dee344696d049aed4c22b9985abda60d17b62c094b04a1c157779cc36cea21 not found: ID does not exist" containerID="45dee344696d049aed4c22b9985abda60d17b62c094b04a1c157779cc36cea21"
Nov 02 08:42:07.502527 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:07.502476    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45dee344696d049aed4c22b9985abda60d17b62c094b04a1c157779cc36cea21"} err="failed to get container status \"45dee344696d049aed4c22b9985abda60d17b62c094b04a1c157779cc36cea21\": rpc error: code = NotFound desc = could not find container \"45dee344696d049aed4c22b9985abda60d17b62c094b04a1c157779cc36cea21\": container with ID starting with 45dee344696d049aed4c22b9985abda60d17b62c094b04a1c157779cc36cea21 not found: ID does not exist"
Nov 02 08:42:07.502527 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:07.502498    6210 scope.go:122] "RemoveContainer" containerID="3ff24aab7063d5cc050166add695c7304fbbd1bde9ef9b2662d1d5fa96e8b8c8"
Nov 02 08:42:07.510574 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:07.510554    6210 scope.go:122] "RemoveContainer" containerID="3ff24aab7063d5cc050166add695c7304fbbd1bde9ef9b2662d1d5fa96e8b8c8"
Nov 02 08:42:07.510825 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:42:07.510808    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ff24aab7063d5cc050166add695c7304fbbd1bde9ef9b2662d1d5fa96e8b8c8\": container with ID starting with 3ff24aab7063d5cc050166add695c7304fbbd1bde9ef9b2662d1d5fa96e8b8c8 not found: ID does not exist" containerID="3ff24aab7063d5cc050166add695c7304fbbd1bde9ef9b2662d1d5fa96e8b8c8"
Nov 02 08:42:07.510912 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:07.510832    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ff24aab7063d5cc050166add695c7304fbbd1bde9ef9b2662d1d5fa96e8b8c8"} err="failed to get container status \"3ff24aab7063d5cc050166add695c7304fbbd1bde9ef9b2662d1d5fa96e8b8c8\": rpc error: code = NotFound desc = could not find container \"3ff24aab7063d5cc050166add695c7304fbbd1bde9ef9b2662d1d5fa96e8b8c8\": container with ID starting with 3ff24aab7063d5cc050166add695c7304fbbd1bde9ef9b2662d1d5fa96e8b8c8 not found: ID does not exist"
Nov 02 08:42:07.646490 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:07.646463    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg"]
Nov 02 08:42:07.650294 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:07.650268    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg"]
Nov 02 08:42:07.752523 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:07.752455    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg"]
Nov 02 08:42:07.761201 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:07.761174    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg"]
Nov 02 08:42:08.351668 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:08.351634    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2150ad95-e6b8-4529-b40c-83119a744da3" path="/var/lib/kubelet/pods/2150ad95-e6b8-4529-b40c-83119a744da3/volumes"
Nov 02 08:42:08.352118 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:08.352102    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="37c3a1ab-c654-4773-b912-7f0a9b7df6b7" path="/var/lib/kubelet/pods/37c3a1ab-c654-4773-b912-7f0a9b7df6b7/volumes"
Nov 02 08:42:08.352494 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:08.352480    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="65a5b2a1-a374-4ba9-9330-91c77e3a2f2b" path="/var/lib/kubelet/pods/65a5b2a1-a374-4ba9-9330-91c77e3a2f2b/volumes"
Nov 02 08:42:20.153289 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:20.153256    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp"]
Nov 02 08:42:23.001548 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:23.001512    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk"]
Nov 02 08:42:23.002067 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:23.002048    6210 cpu_manager.go:414] "containerMap: removing container" podUID="65a5b2a1-a374-4ba9-9330-91c77e3a2f2b" containerName="payload-processing"
Nov 02 08:42:23.002067 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:23.002061    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="65a5b2a1-a374-4ba9-9330-91c77e3a2f2b" containerName="payload-processing"
Nov 02 08:42:23.002198 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:23.002077    6210 cpu_manager.go:414] "containerMap: removing container" podUID="2150ad95-e6b8-4529-b40c-83119a744da3" containerName="maas-api"
Nov 02 08:42:23.002198 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:23.002083    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2150ad95-e6b8-4529-b40c-83119a744da3" containerName="maas-api"
Nov 02 08:42:23.002198 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:23.002108    6210 cpu_manager.go:414] "containerMap: removing container" podUID="37c3a1ab-c654-4773-b912-7f0a9b7df6b7" containerName="payload-pre-processing"
Nov 02 08:42:23.002198 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:23.002117    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="37c3a1ab-c654-4773-b912-7f0a9b7df6b7" containerName="payload-pre-processing"
Nov 02 08:42:23.002363 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:23.002206    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="65a5b2a1-a374-4ba9-9330-91c77e3a2f2b" containerName="payload-processing"
Nov 02 08:42:23.002363 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:23.002216    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="2150ad95-e6b8-4529-b40c-83119a744da3" containerName="maas-api"
Nov 02 08:42:23.002363 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:23.002226    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="37c3a1ab-c654-4773-b912-7f0a9b7df6b7" containerName="payload-pre-processing"
Nov 02 08:42:23.015997 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:23.015973    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk"
Nov 02 08:42:23.026527 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:23.026493    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54dd037f-2bf4-430d-b52b-2e35a551a9e6-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk\" (UID: \"54dd037f-2bf4-430d-b52b-2e35a551a9e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk"
Nov 02 08:42:23.026653 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:23.026563    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54dd037f-2bf4-430d-b52b-2e35a551a9e6-metrics-certs\") pod \"maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk\" (UID: \"54dd037f-2bf4-430d-b52b-2e35a551a9e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk"
Nov 02 08:42:23.026653 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:23.026641    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h8dn\" (UniqueName: \"kubernetes.io/projected/54dd037f-2bf4-430d-b52b-2e35a551a9e6-kube-api-access-6h8dn\") pod \"maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk\" (UID: \"54dd037f-2bf4-430d-b52b-2e35a551a9e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk"
Nov 02 08:42:23.026769 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:23.026753    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54dd037f-2bf4-430d-b52b-2e35a551a9e6-maas-api-tls\") pod \"maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk\" (UID: \"54dd037f-2bf4-430d-b52b-2e35a551a9e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk"
Nov 02 08:42:23.065356 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:23.065333    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-2d5a5a-serving-cert\""
Nov 02 08:42:23.066364 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:23.066338    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk"]
Nov 02 08:42:23.127931 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:23.127902    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54dd037f-2bf4-430d-b52b-2e35a551a9e6-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk\" (UID: \"54dd037f-2bf4-430d-b52b-2e35a551a9e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk"
Nov 02 08:42:23.128115 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:23.127955    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54dd037f-2bf4-430d-b52b-2e35a551a9e6-metrics-certs\") pod \"maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk\" (UID: \"54dd037f-2bf4-430d-b52b-2e35a551a9e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk"
Nov 02 08:42:23.128115 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:23.128067    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h8dn\" (UniqueName: \"kubernetes.io/projected/54dd037f-2bf4-430d-b52b-2e35a551a9e6-kube-api-access-6h8dn\") pod \"maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk\" (UID: \"54dd037f-2bf4-430d-b52b-2e35a551a9e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk"
Nov 02 08:42:23.128242 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:23.128164    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54dd037f-2bf4-430d-b52b-2e35a551a9e6-maas-api-tls\") pod \"maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk\" (UID: \"54dd037f-2bf4-430d-b52b-2e35a551a9e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk"
Nov 02 08:42:23.128341 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:42:23.128320    6210 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d5a5a-serving-cert: secret "maas-api-e2e-ipp-b-2d5a5a-serving-cert" not found
Nov 02 08:42:23.128409 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:42:23.128391    6210 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54dd037f-2bf4-430d-b52b-2e35a551a9e6-maas-api-tls podName:54dd037f-2bf4-430d-b52b-2e35a551a9e6 nodeName:}" failed. No retries permitted until 2026-11-02 08:42:23.628370548 +0000 UTC m=+2133.386799261 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/54dd037f-2bf4-430d-b52b-2e35a551a9e6-maas-api-tls") pod "maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk" (UID: "54dd037f-2bf4-430d-b52b-2e35a551a9e6") : secret "maas-api-e2e-ipp-b-2d5a5a-serving-cert" not found
Nov 02 08:42:23.128681 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:23.128659    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54dd037f-2bf4-430d-b52b-2e35a551a9e6-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk\" (UID: \"54dd037f-2bf4-430d-b52b-2e35a551a9e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk"
Nov 02 08:42:23.130460 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:23.130443    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54dd037f-2bf4-430d-b52b-2e35a551a9e6-metrics-certs\") pod \"maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk\" (UID: \"54dd037f-2bf4-430d-b52b-2e35a551a9e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk"
Nov 02 08:42:23.181832 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:23.181799    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h8dn\" (UniqueName: \"kubernetes.io/projected/54dd037f-2bf4-430d-b52b-2e35a551a9e6-kube-api-access-6h8dn\") pod \"maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk\" (UID: \"54dd037f-2bf4-430d-b52b-2e35a551a9e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk"
Nov 02 08:42:23.635465 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:23.635425    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54dd037f-2bf4-430d-b52b-2e35a551a9e6-maas-api-tls\") pod \"maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk\" (UID: \"54dd037f-2bf4-430d-b52b-2e35a551a9e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk"
Nov 02 08:42:23.638095 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:23.638066    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54dd037f-2bf4-430d-b52b-2e35a551a9e6-maas-api-tls\") pod \"maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk\" (UID: \"54dd037f-2bf4-430d-b52b-2e35a551a9e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk"
Nov 02 08:42:23.929669 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:23.929571    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk"
Nov 02 08:42:24.297362 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:24.297332    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk"]
Nov 02 08:42:24.300163 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:42:24.300135    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54dd037f_2bf4_430d_b52b_2e35a551a9e6.slice/crio-99703d73c3b2b91933d1c0dd71821198c5d0054eceb3d1b5fc37cf65373a5b27 WatchSource:0}: Error finding container 99703d73c3b2b91933d1c0dd71821198c5d0054eceb3d1b5fc37cf65373a5b27: Status 404 returned error can't find the container with id 99703d73c3b2b91933d1c0dd71821198c5d0054eceb3d1b5fc37cf65373a5b27
Nov 02 08:42:24.589186 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:24.589102    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk" event={"ID":"54dd037f-2bf4-430d-b52b-2e35a551a9e6","Type":"ContainerStarted","Data":"99703d73c3b2b91933d1c0dd71821198c5d0054eceb3d1b5fc37cf65373a5b27"}
Nov 02 08:42:25.596214 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:25.596132    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk" event={"ID":"54dd037f-2bf4-430d-b52b-2e35a551a9e6","Type":"ContainerStarted","Data":"85ff303aa862af8ac4fc771b5333248aa3fed5bef7f188a2029f17e3e4c5b3fa"}
Nov 02 08:42:25.596574 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:25.596275    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk"
Nov 02 08:42:25.708376 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:25.708326    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk" podStartSLOduration=2.73389032 podStartE2EDuration="3.70831364s" totalImagesPullingTime="974.42332ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:42:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:42:25.706671232 +0000 UTC m=+2135.465099964" watchObservedRunningTime="2026-11-02 08:42:25.70831364 +0000 UTC m=+2135.466742373"
Nov 02 08:42:27.554171 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:27.554137    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm"]
Nov 02 08:42:30.821474 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:42:30.821431    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:42:31.606937 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:31.606899    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk"
Nov 02 08:42:32.555232 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:32.555191    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm" podUID="8fcae226-6893-419e-bf0c-a39b596ae6c8" containerName="payload-pre-processing" containerID="cri-o://bed728ba4e3acd65d500e3cf00325203736a3c0db3ae511093e2396438d2d5d8" gracePeriod=25
Nov 02 08:42:32.809860 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:32.809775    6210 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm" podUID="8fcae226-6893-419e-bf0c-a39b596ae6c8" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 02 08:42:35.174255 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:35.174210    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp" podUID="1b0898b2-a56c-4884-bbac-95d071b8bc00" containerName="main" containerID="cri-o://c9b0e424017c602562834b9ac6ef2a658c32709de7ab3629b63a92e8cfaba6ea" gracePeriod=45
Nov 02 08:42:35.431332 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:35.431267    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp"
Nov 02 08:42:35.594449 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:35.594406    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1b0898b2-a56c-4884-bbac-95d071b8bc00-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b0898b2-a56c-4884-bbac-95d071b8bc00-tls-certs\") pod \"1b0898b2-a56c-4884-bbac-95d071b8bc00\" (UID: \"1b0898b2-a56c-4884-bbac-95d071b8bc00\") "
Nov 02 08:42:35.594689 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:35.594489    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1b0898b2-a56c-4884-bbac-95d071b8bc00-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b0898b2-a56c-4884-bbac-95d071b8bc00-model-cache\") pod \"1b0898b2-a56c-4884-bbac-95d071b8bc00\" (UID: \"1b0898b2-a56c-4884-bbac-95d071b8bc00\") "
Nov 02 08:42:35.594689 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:35.594551    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1b0898b2-a56c-4884-bbac-95d071b8bc00-home\" (UniqueName: \"kubernetes.io/empty-dir/1b0898b2-a56c-4884-bbac-95d071b8bc00-home\") pod \"1b0898b2-a56c-4884-bbac-95d071b8bc00\" (UID: \"1b0898b2-a56c-4884-bbac-95d071b8bc00\") "
Nov 02 08:42:35.594689 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:35.594583    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1b0898b2-a56c-4884-bbac-95d071b8bc00-kube-api-access-lsq7n\" (UniqueName: \"kubernetes.io/projected/1b0898b2-a56c-4884-bbac-95d071b8bc00-kube-api-access-lsq7n\") pod \"1b0898b2-a56c-4884-bbac-95d071b8bc00\" (UID: \"1b0898b2-a56c-4884-bbac-95d071b8bc00\") "
Nov 02 08:42:35.594689 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:35.594611    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1b0898b2-a56c-4884-bbac-95d071b8bc00-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b0898b2-a56c-4884-bbac-95d071b8bc00-tmp-dir\") pod \"1b0898b2-a56c-4884-bbac-95d071b8bc00\" (UID: \"1b0898b2-a56c-4884-bbac-95d071b8bc00\") "
Nov 02 08:42:35.594689 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:35.594638    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1b0898b2-a56c-4884-bbac-95d071b8bc00-dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b0898b2-a56c-4884-bbac-95d071b8bc00-dshm\") pod \"1b0898b2-a56c-4884-bbac-95d071b8bc00\" (UID: \"1b0898b2-a56c-4884-bbac-95d071b8bc00\") "
Nov 02 08:42:35.595399 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:35.595363    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b0898b2-a56c-4884-bbac-95d071b8bc00-tmp-dir" pod "1b0898b2-a56c-4884-bbac-95d071b8bc00" (UID: "1b0898b2-a56c-4884-bbac-95d071b8bc00"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:42:35.595610 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:35.595588    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b0898b2-a56c-4884-bbac-95d071b8bc00-model-cache" pod "1b0898b2-a56c-4884-bbac-95d071b8bc00" (UID: "1b0898b2-a56c-4884-bbac-95d071b8bc00"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:42:35.596130 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:35.596106    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b0898b2-a56c-4884-bbac-95d071b8bc00-home" pod "1b0898b2-a56c-4884-bbac-95d071b8bc00" (UID: "1b0898b2-a56c-4884-bbac-95d071b8bc00"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:42:35.597320 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:35.597281    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b0898b2-a56c-4884-bbac-95d071b8bc00-tls-certs" pod "1b0898b2-a56c-4884-bbac-95d071b8bc00" (UID: "1b0898b2-a56c-4884-bbac-95d071b8bc00"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:42:35.597762 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:35.597736    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b0898b2-a56c-4884-bbac-95d071b8bc00-dshm" pod "1b0898b2-a56c-4884-bbac-95d071b8bc00" (UID: "1b0898b2-a56c-4884-bbac-95d071b8bc00"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:42:35.597851 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:35.597820    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b0898b2-a56c-4884-bbac-95d071b8bc00-kube-api-access-lsq7n" pod "1b0898b2-a56c-4884-bbac-95d071b8bc00" (UID: "1b0898b2-a56c-4884-bbac-95d071b8bc00"). InnerVolumeSpecName "kube-api-access-lsq7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:42:35.651810 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:35.651777    6210 generic.go:356] "Generic (PLEG): container finished" podID="1b0898b2-a56c-4884-bbac-95d071b8bc00" containerID="c9b0e424017c602562834b9ac6ef2a658c32709de7ab3629b63a92e8cfaba6ea" exitCode=0
Nov 02 08:42:35.651985 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:35.651821    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp"
Nov 02 08:42:35.651985 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:35.651859    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp" event={"ID":"1b0898b2-a56c-4884-bbac-95d071b8bc00","Type":"ContainerDied","Data":"c9b0e424017c602562834b9ac6ef2a658c32709de7ab3629b63a92e8cfaba6ea"}
Nov 02 08:42:35.651985 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:35.651938    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp" event={"ID":"1b0898b2-a56c-4884-bbac-95d071b8bc00","Type":"ContainerDied","Data":"edb0ffa22e49fa8d55cf680b75b0d1ec3d60604333f21a4be3b4f2dd25341e77"}
Nov 02 08:42:35.651985 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:35.651962    6210 scope.go:122] "RemoveContainer" containerID="c9b0e424017c602562834b9ac6ef2a658c32709de7ab3629b63a92e8cfaba6ea"
Nov 02 08:42:35.667950 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:35.667926    6210 scope.go:122] "RemoveContainer" containerID="c9b0e424017c602562834b9ac6ef2a658c32709de7ab3629b63a92e8cfaba6ea"
Nov 02 08:42:35.668540 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:42:35.668510    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9b0e424017c602562834b9ac6ef2a658c32709de7ab3629b63a92e8cfaba6ea\": container with ID starting with c9b0e424017c602562834b9ac6ef2a658c32709de7ab3629b63a92e8cfaba6ea not found: ID does not exist" containerID="c9b0e424017c602562834b9ac6ef2a658c32709de7ab3629b63a92e8cfaba6ea"
Nov 02 08:42:35.668635 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:35.668553    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9b0e424017c602562834b9ac6ef2a658c32709de7ab3629b63a92e8cfaba6ea"} err="failed to get container status \"c9b0e424017c602562834b9ac6ef2a658c32709de7ab3629b63a92e8cfaba6ea\": rpc error: code = NotFound desc = could not find container \"c9b0e424017c602562834b9ac6ef2a658c32709de7ab3629b63a92e8cfaba6ea\": container with ID starting with c9b0e424017c602562834b9ac6ef2a658c32709de7ab3629b63a92e8cfaba6ea not found: ID does not exist"
Nov 02 08:42:35.696373 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:35.696309    6210 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b0898b2-a56c-4884-bbac-95d071b8bc00-tls-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:42:35.696373 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:35.696335    6210 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b0898b2-a56c-4884-bbac-95d071b8bc00-model-cache\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:42:35.696373 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:35.696346    6210 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b0898b2-a56c-4884-bbac-95d071b8bc00-home\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:42:35.696373 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:35.696356    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsq7n\" (UniqueName: \"kubernetes.io/projected/1b0898b2-a56c-4884-bbac-95d071b8bc00-kube-api-access-lsq7n\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:42:35.696373 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:35.696366    6210 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b0898b2-a56c-4884-bbac-95d071b8bc00-tmp-dir\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:42:35.696373 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:35.696375    6210 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b0898b2-a56c-4884-bbac-95d071b8bc00-dshm\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:42:35.804556 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:35.804526    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp"]
Nov 02 08:42:35.814315 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:35.814287    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-8e6407/distinct-2-w4-8e6407-kserve-67f6cccdb6-48zlp"]
Nov 02 08:42:36.352323 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:36.352290    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1b0898b2-a56c-4884-bbac-95d071b8bc00" path="/var/lib/kubelet/pods/1b0898b2-a56c-4884-bbac-95d071b8bc00/volumes"
Nov 02 08:42:42.809928 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:42.809864    6210 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm" podUID="8fcae226-6893-419e-bf0c-a39b596ae6c8" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 02 08:42:43.790776 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:43.790739    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht"]
Nov 02 08:42:43.791368 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:43.791347    6210 cpu_manager.go:414] "containerMap: removing container" podUID="1b0898b2-a56c-4884-bbac-95d071b8bc00" containerName="main"
Nov 02 08:42:43.791468 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:43.791370    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1b0898b2-a56c-4884-bbac-95d071b8bc00" containerName="main"
Nov 02 08:42:43.791535 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:43.791490    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="1b0898b2-a56c-4884-bbac-95d071b8bc00" containerName="main"
Nov 02 08:42:43.796059 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:43.796036    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht"
Nov 02 08:42:43.802029 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:43.802003    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d80320f-db3b-4f56-bafd-931d7e53fb1d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht\" (UID: \"9d80320f-db3b-4f56-bafd-931d7e53fb1d\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht"
Nov 02 08:42:43.802145 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:43.802118    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hx8z\" (UniqueName: \"kubernetes.io/projected/9d80320f-db3b-4f56-bafd-931d7e53fb1d-kube-api-access-5hx8z\") pod \"payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht\" (UID: \"9d80320f-db3b-4f56-bafd-931d7e53fb1d\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht"
Nov 02 08:42:43.844581 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:43.844546    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-9ceb40-dockercfg-thfpl\""
Nov 02 08:42:43.844964 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:43.844609    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-9ceb40\""
Nov 02 08:42:43.894049 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:43.894013    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht"]
Nov 02 08:42:43.903255 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:43.903228    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d80320f-db3b-4f56-bafd-931d7e53fb1d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht\" (UID: \"9d80320f-db3b-4f56-bafd-931d7e53fb1d\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht"
Nov 02 08:42:43.903411 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:43.903326    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hx8z\" (UniqueName: \"kubernetes.io/projected/9d80320f-db3b-4f56-bafd-931d7e53fb1d-kube-api-access-5hx8z\") pod \"payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht\" (UID: \"9d80320f-db3b-4f56-bafd-931d7e53fb1d\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht"
Nov 02 08:42:43.904156 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:43.904131    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d80320f-db3b-4f56-bafd-931d7e53fb1d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht\" (UID: \"9d80320f-db3b-4f56-bafd-931d7e53fb1d\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht"
Nov 02 08:42:43.956323 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:43.956290    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hx8z\" (UniqueName: \"kubernetes.io/projected/9d80320f-db3b-4f56-bafd-931d7e53fb1d-kube-api-access-5hx8z\") pod \"payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht\" (UID: \"9d80320f-db3b-4f56-bafd-931d7e53fb1d\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht"
Nov 02 08:42:44.111199 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:44.111098    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht"
Nov 02 08:42:44.486823 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:44.486632    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht"]
Nov 02 08:42:44.489802 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:42:44.489768    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d80320f_db3b_4f56_bafd_931d7e53fb1d.slice/crio-d943a383d292b5eacfd5f70e36db92f6d969b27e108863d4e09e1d2d04e55949 WatchSource:0}: Error finding container d943a383d292b5eacfd5f70e36db92f6d969b27e108863d4e09e1d2d04e55949: Status 404 returned error can't find the container with id d943a383d292b5eacfd5f70e36db92f6d969b27e108863d4e09e1d2d04e55949
Nov 02 08:42:44.721840 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:44.718667    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht" event={"ID":"9d80320f-db3b-4f56-bafd-931d7e53fb1d","Type":"ContainerStarted","Data":"eb2446ac87a068b8c246b1e5bfe5d9fbeeb34541246fd25f85d14d7f47fa7a05"}
Nov 02 08:42:44.727394 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:44.725970    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht" event={"ID":"9d80320f-db3b-4f56-bafd-931d7e53fb1d","Type":"ContainerStarted","Data":"d943a383d292b5eacfd5f70e36db92f6d969b27e108863d4e09e1d2d04e55949"}
Nov 02 08:42:44.727394 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:44.726047    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht"
Nov 02 08:42:44.830338 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:44.830216    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht" podStartSLOduration=1.830197118 podStartE2EDuration="1.830197118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:42:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:42:44.829125436 +0000 UTC m=+2154.587554168" watchObservedRunningTime="2026-11-02 08:42:44.830197118 +0000 UTC m=+2154.588625852"
Nov 02 08:42:52.794609 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:52.794577    6210 generic.go:356] "Generic (PLEG): container finished" podID="8fcae226-6893-419e-bf0c-a39b596ae6c8" containerID="bed728ba4e3acd65d500e3cf00325203736a3c0db3ae511093e2396438d2d5d8" exitCode=0
Nov 02 08:42:52.794988 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:52.794635    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm" event={"ID":"8fcae226-6893-419e-bf0c-a39b596ae6c8","Type":"ContainerDied","Data":"bed728ba4e3acd65d500e3cf00325203736a3c0db3ae511093e2396438d2d5d8"}
Nov 02 08:42:52.824677 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:52.824619    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm"
Nov 02 08:42:52.961679 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:52.961650    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8fcae226-6893-419e-bf0c-a39b596ae6c8-kube-api-access-f8slq\" (UniqueName: \"kubernetes.io/projected/8fcae226-6893-419e-bf0c-a39b596ae6c8-kube-api-access-f8slq\") pod \"8fcae226-6893-419e-bf0c-a39b596ae6c8\" (UID: \"8fcae226-6893-419e-bf0c-a39b596ae6c8\") "
Nov 02 08:42:52.961843 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:52.961761    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8fcae226-6893-419e-bf0c-a39b596ae6c8-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fcae226-6893-419e-bf0c-a39b596ae6c8-plugins-config-volume\") pod \"8fcae226-6893-419e-bf0c-a39b596ae6c8\" (UID: \"8fcae226-6893-419e-bf0c-a39b596ae6c8\") "
Nov 02 08:42:52.962251 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:52.962220    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fcae226-6893-419e-bf0c-a39b596ae6c8-plugins-config-volume" pod "8fcae226-6893-419e-bf0c-a39b596ae6c8" (UID: "8fcae226-6893-419e-bf0c-a39b596ae6c8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:42:52.964086 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:52.964062    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fcae226-6893-419e-bf0c-a39b596ae6c8-kube-api-access-f8slq" pod "8fcae226-6893-419e-bf0c-a39b596ae6c8" (UID: "8fcae226-6893-419e-bf0c-a39b596ae6c8"). InnerVolumeSpecName "kube-api-access-f8slq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:42:53.063727 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:53.063695    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8slq\" (UniqueName: \"kubernetes.io/projected/8fcae226-6893-419e-bf0c-a39b596ae6c8-kube-api-access-f8slq\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:42:53.063727 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:53.063723    6210 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fcae226-6893-419e-bf0c-a39b596ae6c8-plugins-config-volume\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:42:53.801683 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:53.801650    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm" event={"ID":"8fcae226-6893-419e-bf0c-a39b596ae6c8","Type":"ContainerDied","Data":"a1a04e532305845052976158dcd763b25e678ad05aef7ac20315b7edc9ed05b3"}
Nov 02 08:42:53.801683 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:53.801672    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm"
Nov 02 08:42:53.802161 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:53.801718    6210 scope.go:122] "RemoveContainer" containerID="bed728ba4e3acd65d500e3cf00325203736a3c0db3ae511093e2396438d2d5d8"
Nov 02 08:42:53.809499 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:53.809463    6210 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm" podUID="8fcae226-6893-419e-bf0c-a39b596ae6c8" containerName="payload-pre-processing" probeResult="failure" output="timeout: failed to connect service \"10.134.0.41:50052\" within 1s: context deadline exceeded"
Nov 02 08:42:53.809613 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:53.809562    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm"
Nov 02 08:42:53.809613 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:42:53.809579    6210 logging.go:55] [core] [Channel #1595 SubChannel #1596]grpc: addrConn.createTransport failed to connect to {Addr: "10.134.0.41:50052", ServerName: "10.134.0.41:50052", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.134.0.41:50052: operation was canceled"
Nov 02 08:42:53.954997 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:53.954966    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm"]
Nov 02 08:42:53.958044 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:53.958017    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm"]
Nov 02 08:42:54.351585 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:54.351553    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8fcae226-6893-419e-bf0c-a39b596ae6c8" path="/var/lib/kubelet/pods/8fcae226-6893-419e-bf0c-a39b596ae6c8/volumes"
Nov 02 08:42:56.765442 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:42:56.764474    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht"
Nov 02 08:43:00.821497 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:43:00.821459    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:43:30.821042 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:43:30.821004    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:43:35.836700 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:35.836663    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"]
Nov 02 08:43:35.837251 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:35.836912    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2" podUID="72cfa2c7-210c-4e18-961b-4676855ffd42" containerName="istio-proxy" containerID="cri-o://bccbe232dec0adb1d25b8c583e9b4c9b0979461ca917c80e28e0df950435d50b" gracePeriod=30
Nov 02 08:43:41.179838 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:41.179752    6210 generic.go:356] "Generic (PLEG): container finished" podID="72cfa2c7-210c-4e18-961b-4676855ffd42" containerID="bccbe232dec0adb1d25b8c583e9b4c9b0979461ca917c80e28e0df950435d50b" exitCode=0
Nov 02 08:43:41.179838 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:41.179826    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2" event={"ID":"72cfa2c7-210c-4e18-961b-4676855ffd42","Type":"ContainerDied","Data":"bccbe232dec0adb1d25b8c583e9b4c9b0979461ca917c80e28e0df950435d50b"}
Nov 02 08:43:41.180322 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:41.179910    6210 scope.go:122] "RemoveContainer" containerID="2e366b5f1b7288abb73fb3a36cbbf866f95406230fb4ec58fbc561a928d9a5dc"
Nov 02 08:43:41.491773 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:41.491746    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:43:41.546897 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:41.546840    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/72cfa2c7-210c-4e18-961b-4676855ffd42-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72cfa2c7-210c-4e18-961b-4676855ffd42-workload-certs\") pod \"72cfa2c7-210c-4e18-961b-4676855ffd42\" (UID: \"72cfa2c7-210c-4e18-961b-4676855ffd42\") "
Nov 02 08:43:41.547089 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:41.546935    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/72cfa2c7-210c-4e18-961b-4676855ffd42-istio-token\" (UniqueName: \"kubernetes.io/projected/72cfa2c7-210c-4e18-961b-4676855ffd42-istio-token\") pod \"72cfa2c7-210c-4e18-961b-4676855ffd42\" (UID: \"72cfa2c7-210c-4e18-961b-4676855ffd42\") "
Nov 02 08:43:41.547089 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:41.546977    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/72cfa2c7-210c-4e18-961b-4676855ffd42-kube-api-access-49pmn\" (UniqueName: \"kubernetes.io/projected/72cfa2c7-210c-4e18-961b-4676855ffd42-kube-api-access-49pmn\") pod \"72cfa2c7-210c-4e18-961b-4676855ffd42\" (UID: \"72cfa2c7-210c-4e18-961b-4676855ffd42\") "
Nov 02 08:43:41.547089 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:41.547000    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/72cfa2c7-210c-4e18-961b-4676855ffd42-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72cfa2c7-210c-4e18-961b-4676855ffd42-istio-data\") pod \"72cfa2c7-210c-4e18-961b-4676855ffd42\" (UID: \"72cfa2c7-210c-4e18-961b-4676855ffd42\") "
Nov 02 08:43:41.547089 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:41.547030    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/72cfa2c7-210c-4e18-961b-4676855ffd42-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72cfa2c7-210c-4e18-961b-4676855ffd42-credential-socket\") pod \"72cfa2c7-210c-4e18-961b-4676855ffd42\" (UID: \"72cfa2c7-210c-4e18-961b-4676855ffd42\") "
Nov 02 08:43:41.547089 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:41.547068    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/72cfa2c7-210c-4e18-961b-4676855ffd42-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72cfa2c7-210c-4e18-961b-4676855ffd42-workload-socket\") pod \"72cfa2c7-210c-4e18-961b-4676855ffd42\" (UID: \"72cfa2c7-210c-4e18-961b-4676855ffd42\") "
Nov 02 08:43:41.547365 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:41.547095    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/72cfa2c7-210c-4e18-961b-4676855ffd42-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72cfa2c7-210c-4e18-961b-4676855ffd42-istio-envoy\") pod \"72cfa2c7-210c-4e18-961b-4676855ffd42\" (UID: \"72cfa2c7-210c-4e18-961b-4676855ffd42\") "
Nov 02 08:43:41.547365 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:41.547131    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/72cfa2c7-210c-4e18-961b-4676855ffd42-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72cfa2c7-210c-4e18-961b-4676855ffd42-istiod-ca-cert\") pod \"72cfa2c7-210c-4e18-961b-4676855ffd42\" (UID: \"72cfa2c7-210c-4e18-961b-4676855ffd42\") "
Nov 02 08:43:41.547365 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:41.547162    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/72cfa2c7-210c-4e18-961b-4676855ffd42-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72cfa2c7-210c-4e18-961b-4676855ffd42-istio-podinfo\") pod \"72cfa2c7-210c-4e18-961b-4676855ffd42\" (UID: \"72cfa2c7-210c-4e18-961b-4676855ffd42\") "
Nov 02 08:43:41.547365 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:41.547176    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72cfa2c7-210c-4e18-961b-4676855ffd42-workload-certs" pod "72cfa2c7-210c-4e18-961b-4676855ffd42" (UID: "72cfa2c7-210c-4e18-961b-4676855ffd42"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:43:41.547365 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:41.547298    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72cfa2c7-210c-4e18-961b-4676855ffd42-istio-data" pod "72cfa2c7-210c-4e18-961b-4676855ffd42" (UID: "72cfa2c7-210c-4e18-961b-4676855ffd42"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:43:41.547641 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:41.547400    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72cfa2c7-210c-4e18-961b-4676855ffd42-credential-socket" pod "72cfa2c7-210c-4e18-961b-4676855ffd42" (UID: "72cfa2c7-210c-4e18-961b-4676855ffd42"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:43:41.547698 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:41.547680    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72cfa2c7-210c-4e18-961b-4676855ffd42-workload-socket" pod "72cfa2c7-210c-4e18-961b-4676855ffd42" (UID: "72cfa2c7-210c-4e18-961b-4676855ffd42"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:43:41.547761 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:41.547685    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72cfa2c7-210c-4e18-961b-4676855ffd42-istiod-ca-cert" pod "72cfa2c7-210c-4e18-961b-4676855ffd42" (UID: "72cfa2c7-210c-4e18-961b-4676855ffd42"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:43:41.547848 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:41.547825    6210 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72cfa2c7-210c-4e18-961b-4676855ffd42-istio-data\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:43:41.547925 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:41.547855    6210 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72cfa2c7-210c-4e18-961b-4676855ffd42-credential-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:43:41.547925 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:41.547870    6210 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72cfa2c7-210c-4e18-961b-4676855ffd42-workload-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:43:41.547925 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:41.547899    6210 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72cfa2c7-210c-4e18-961b-4676855ffd42-istiod-ca-cert\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:43:41.547925 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:41.547912    6210 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72cfa2c7-210c-4e18-961b-4676855ffd42-workload-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:43:41.549416 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:41.549390    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72cfa2c7-210c-4e18-961b-4676855ffd42-istio-token" pod "72cfa2c7-210c-4e18-961b-4676855ffd42" (UID: "72cfa2c7-210c-4e18-961b-4676855ffd42"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:43:41.549416 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:41.549405    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72cfa2c7-210c-4e18-961b-4676855ffd42-kube-api-access-49pmn" pod "72cfa2c7-210c-4e18-961b-4676855ffd42" (UID: "72cfa2c7-210c-4e18-961b-4676855ffd42"). InnerVolumeSpecName "kube-api-access-49pmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:43:41.549606 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:41.549392    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72cfa2c7-210c-4e18-961b-4676855ffd42-istio-envoy" pod "72cfa2c7-210c-4e18-961b-4676855ffd42" (UID: "72cfa2c7-210c-4e18-961b-4676855ffd42"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:43:41.549659 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:41.549643    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/72cfa2c7-210c-4e18-961b-4676855ffd42-istio-podinfo" pod "72cfa2c7-210c-4e18-961b-4676855ffd42" (UID: "72cfa2c7-210c-4e18-961b-4676855ffd42"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 08:43:41.649065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:41.649023    6210 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72cfa2c7-210c-4e18-961b-4676855ffd42-istio-token\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:43:41.649065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:41.649057    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49pmn\" (UniqueName: \"kubernetes.io/projected/72cfa2c7-210c-4e18-961b-4676855ffd42-kube-api-access-49pmn\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:43:41.649065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:41.649070    6210 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72cfa2c7-210c-4e18-961b-4676855ffd42-istio-envoy\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:43:41.649065 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:41.649079    6210 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72cfa2c7-210c-4e18-961b-4676855ffd42-istio-podinfo\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:43:42.188358 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:42.188316    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2" event={"ID":"72cfa2c7-210c-4e18-961b-4676855ffd42","Type":"ContainerDied","Data":"27ece34fb00beb531a6935e06950e6dda8733fe7e6801bb46cf65a34fcaf4cfd"}
Nov 02 08:43:42.188822 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:42.188379    6210 scope.go:122] "RemoveContainer" containerID="bccbe232dec0adb1d25b8c583e9b4c9b0979461ca917c80e28e0df950435d50b"
Nov 02 08:43:42.188822 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:42.188337    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"
Nov 02 08:43:42.352199 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:42.352162    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"]
Nov 02 08:43:42.395957 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:42.395929    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2"]
Nov 02 08:43:44.352460 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:44.352426    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="72cfa2c7-210c-4e18-961b-4676855ffd42" path="/var/lib/kubelet/pods/72cfa2c7-210c-4e18-961b-4676855ffd42/volumes"
Nov 02 08:43:47.218761 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:47.218725    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t"]
Nov 02 08:43:47.265147 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:47.265118    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b"]
Nov 02 08:43:54.162752 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:54.162718    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c"]
Nov 02 08:43:59.163733 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:43:59.163686    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c" podUID="b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb" containerName="payload-processing" containerID="cri-o://ee8c18753b4a1195ca5d4f911d1e004c968e93853239601f08799092e561e476" gracePeriod=25
Nov 02 08:44:00.829903 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:44:00.829843    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:44:02.127961 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.127915    6210 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c" podUID="b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 02 08:44:02.239846 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.239800    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t" podUID="76c6603b-42f0-4934-9a30-efc0fbc412cb" containerName="main" containerID="cri-o://a7beebd23ec2d6f86e366c12b8c8cab807c8e4d8031cedbcf54d3acdf8f5bdd0" gracePeriod=45
Nov 02 08:44:02.285367 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.285320    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b" podUID="6c761c52-0af5-4c7a-95d5-f47c14f00aa2" containerName="main" containerID="cri-o://c9d71cb5b23228509226762da231513c0979586fac5824ca39dbfd5f55a3ee4e" gracePeriod=45
Nov 02 08:44:02.554381 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.554346    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t"
Nov 02 08:44:02.580434 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.580403    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b"
Nov 02 08:44:02.745914 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.745841    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-dshm\") pod \"6c761c52-0af5-4c7a-95d5-f47c14f00aa2\" (UID: \"6c761c52-0af5-4c7a-95d5-f47c14f00aa2\") "
Nov 02 08:44:02.746229 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.746196    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-model-cache\") pod \"6c761c52-0af5-4c7a-95d5-f47c14f00aa2\" (UID: \"6c761c52-0af5-4c7a-95d5-f47c14f00aa2\") "
Nov 02 08:44:02.746336 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.746285    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-tls-certs\") pod \"6c761c52-0af5-4c7a-95d5-f47c14f00aa2\" (UID: \"6c761c52-0af5-4c7a-95d5-f47c14f00aa2\") "
Nov 02 08:44:02.746336 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.746323    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/76c6603b-42f0-4934-9a30-efc0fbc412cb-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76c6603b-42f0-4934-9a30-efc0fbc412cb-tmp-dir\") pod \"76c6603b-42f0-4934-9a30-efc0fbc412cb\" (UID: \"76c6603b-42f0-4934-9a30-efc0fbc412cb\") "
Nov 02 08:44:02.746471 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.746454    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/76c6603b-42f0-4934-9a30-efc0fbc412cb-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76c6603b-42f0-4934-9a30-efc0fbc412cb-model-cache\") pod \"76c6603b-42f0-4934-9a30-efc0fbc412cb\" (UID: \"76c6603b-42f0-4934-9a30-efc0fbc412cb\") "
Nov 02 08:44:02.746529 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.746489    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/76c6603b-42f0-4934-9a30-efc0fbc412cb-dshm\" (UniqueName: \"kubernetes.io/empty-dir/76c6603b-42f0-4934-9a30-efc0fbc412cb-dshm\") pod \"76c6603b-42f0-4934-9a30-efc0fbc412cb\" (UID: \"76c6603b-42f0-4934-9a30-efc0fbc412cb\") "
Nov 02 08:44:02.746584 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.746555    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-kube-api-access-gp989\" (UniqueName: \"kubernetes.io/projected/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-kube-api-access-gp989\") pod \"6c761c52-0af5-4c7a-95d5-f47c14f00aa2\" (UID: \"6c761c52-0af5-4c7a-95d5-f47c14f00aa2\") "
Nov 02 08:44:02.746639 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.746620    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/76c6603b-42f0-4934-9a30-efc0fbc412cb-home\" (UniqueName: \"kubernetes.io/empty-dir/76c6603b-42f0-4934-9a30-efc0fbc412cb-home\") pod \"76c6603b-42f0-4934-9a30-efc0fbc412cb\" (UID: \"76c6603b-42f0-4934-9a30-efc0fbc412cb\") "
Nov 02 08:44:02.746688 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.746662    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/76c6603b-42f0-4934-9a30-efc0fbc412cb-kube-api-access-nqfvm\" (UniqueName: \"kubernetes.io/projected/76c6603b-42f0-4934-9a30-efc0fbc412cb-kube-api-access-nqfvm\") pod \"76c6603b-42f0-4934-9a30-efc0fbc412cb\" (UID: \"76c6603b-42f0-4934-9a30-efc0fbc412cb\") "
Nov 02 08:44:02.746744 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.746708    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-home\" (UniqueName: \"kubernetes.io/empty-dir/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-home\") pod \"6c761c52-0af5-4c7a-95d5-f47c14f00aa2\" (UID: \"6c761c52-0af5-4c7a-95d5-f47c14f00aa2\") "
Nov 02 08:44:02.746800 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.746749    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/76c6603b-42f0-4934-9a30-efc0fbc412cb-tls-certs\" (UniqueName: \"kubernetes.io/secret/76c6603b-42f0-4934-9a30-efc0fbc412cb-tls-certs\") pod \"76c6603b-42f0-4934-9a30-efc0fbc412cb\" (UID: \"76c6603b-42f0-4934-9a30-efc0fbc412cb\") "
Nov 02 08:44:02.746800 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.746792    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-tmp-dir\") pod \"6c761c52-0af5-4c7a-95d5-f47c14f00aa2\" (UID: \"6c761c52-0af5-4c7a-95d5-f47c14f00aa2\") "
Nov 02 08:44:02.747139 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.747117    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-model-cache" pod "6c761c52-0af5-4c7a-95d5-f47c14f00aa2" (UID: "6c761c52-0af5-4c7a-95d5-f47c14f00aa2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:44:02.747436 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.747419    6210 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-model-cache\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:44:02.747921 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.747802    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-tmp-dir" pod "6c761c52-0af5-4c7a-95d5-f47c14f00aa2" (UID: "6c761c52-0af5-4c7a-95d5-f47c14f00aa2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:44:02.748032 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.748009    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76c6603b-42f0-4934-9a30-efc0fbc412cb-tmp-dir" pod "76c6603b-42f0-4934-9a30-efc0fbc412cb" (UID: "76c6603b-42f0-4934-9a30-efc0fbc412cb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:44:02.748105 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.748065    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-home" pod "6c761c52-0af5-4c7a-95d5-f47c14f00aa2" (UID: "6c761c52-0af5-4c7a-95d5-f47c14f00aa2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:44:02.748349 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.748323    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76c6603b-42f0-4934-9a30-efc0fbc412cb-model-cache" pod "76c6603b-42f0-4934-9a30-efc0fbc412cb" (UID: "76c6603b-42f0-4934-9a30-efc0fbc412cb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:44:02.748431 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.748343    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76c6603b-42f0-4934-9a30-efc0fbc412cb-home" pod "76c6603b-42f0-4934-9a30-efc0fbc412cb" (UID: "76c6603b-42f0-4934-9a30-efc0fbc412cb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:44:02.750824 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.750779    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-tls-certs" pod "6c761c52-0af5-4c7a-95d5-f47c14f00aa2" (UID: "6c761c52-0af5-4c7a-95d5-f47c14f00aa2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:44:02.751108 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.751079    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76c6603b-42f0-4934-9a30-efc0fbc412cb-kube-api-access-nqfvm" pod "76c6603b-42f0-4934-9a30-efc0fbc412cb" (UID: "76c6603b-42f0-4934-9a30-efc0fbc412cb"). InnerVolumeSpecName "kube-api-access-nqfvm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:44:02.751108 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.751088    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76c6603b-42f0-4934-9a30-efc0fbc412cb-dshm" pod "76c6603b-42f0-4934-9a30-efc0fbc412cb" (UID: "76c6603b-42f0-4934-9a30-efc0fbc412cb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:44:02.751256 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.751119    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-kube-api-access-gp989" pod "6c761c52-0af5-4c7a-95d5-f47c14f00aa2" (UID: "6c761c52-0af5-4c7a-95d5-f47c14f00aa2"). InnerVolumeSpecName "kube-api-access-gp989". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:44:02.753175 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.753146    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76c6603b-42f0-4934-9a30-efc0fbc412cb-tls-certs" pod "76c6603b-42f0-4934-9a30-efc0fbc412cb" (UID: "76c6603b-42f0-4934-9a30-efc0fbc412cb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:44:02.758467 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.758426    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-dshm" pod "6c761c52-0af5-4c7a-95d5-f47c14f00aa2" (UID: "6c761c52-0af5-4c7a-95d5-f47c14f00aa2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:44:02.848635 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.848596    6210 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-dshm\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:44:02.848635 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.848628    6210 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-tls-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:44:02.848635 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.848637    6210 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76c6603b-42f0-4934-9a30-efc0fbc412cb-tmp-dir\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:44:02.848635 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.848646    6210 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76c6603b-42f0-4934-9a30-efc0fbc412cb-model-cache\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:44:02.849036 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.848654    6210 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76c6603b-42f0-4934-9a30-efc0fbc412cb-dshm\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:44:02.849036 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.848663    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gp989\" (UniqueName: \"kubernetes.io/projected/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-kube-api-access-gp989\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:44:02.849036 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.848671    6210 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76c6603b-42f0-4934-9a30-efc0fbc412cb-home\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:44:02.849036 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.848679    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqfvm\" (UniqueName: \"kubernetes.io/projected/76c6603b-42f0-4934-9a30-efc0fbc412cb-kube-api-access-nqfvm\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:44:02.849036 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.848690    6210 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-home\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:44:02.849036 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.848698    6210 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76c6603b-42f0-4934-9a30-efc0fbc412cb-tls-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:44:02.849036 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:02.848705    6210 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c761c52-0af5-4c7a-95d5-f47c14f00aa2-tmp-dir\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:44:03.314720 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:03.314680    6210 generic.go:356] "Generic (PLEG): container finished" podID="6c761c52-0af5-4c7a-95d5-f47c14f00aa2" containerID="c9d71cb5b23228509226762da231513c0979586fac5824ca39dbfd5f55a3ee4e" exitCode=0
Nov 02 08:44:03.315259 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:03.314965    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b"
Nov 02 08:44:03.315999 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:03.315781    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b" event={"ID":"6c761c52-0af5-4c7a-95d5-f47c14f00aa2","Type":"ContainerDied","Data":"c9d71cb5b23228509226762da231513c0979586fac5824ca39dbfd5f55a3ee4e"}
Nov 02 08:44:03.315999 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:03.315847    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b" event={"ID":"6c761c52-0af5-4c7a-95d5-f47c14f00aa2","Type":"ContainerDied","Data":"941cedd657ebf40a9c6fd47281e1b1fd7b8d163398d6fcebf6aed1cb413e1e24"}
Nov 02 08:44:03.315999 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:03.315870    6210 scope.go:122] "RemoveContainer" containerID="c9d71cb5b23228509226762da231513c0979586fac5824ca39dbfd5f55a3ee4e"
Nov 02 08:44:03.317864 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:03.317650    6210 generic.go:356] "Generic (PLEG): container finished" podID="76c6603b-42f0-4934-9a30-efc0fbc412cb" containerID="a7beebd23ec2d6f86e366c12b8c8cab807c8e4d8031cedbcf54d3acdf8f5bdd0" exitCode=0
Nov 02 08:44:03.317864 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:03.317797    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t" event={"ID":"76c6603b-42f0-4934-9a30-efc0fbc412cb","Type":"ContainerDied","Data":"a7beebd23ec2d6f86e366c12b8c8cab807c8e4d8031cedbcf54d3acdf8f5bdd0"}
Nov 02 08:44:03.317864 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:03.317832    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t" event={"ID":"76c6603b-42f0-4934-9a30-efc0fbc412cb","Type":"ContainerDied","Data":"dbf8437f961208ce1caca77f5e03f202a03c22aa11e51ad04a268f224405b730"}
Nov 02 08:44:03.317864 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:03.317841    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t"
Nov 02 08:44:03.337682 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:03.337164    6210 scope.go:122] "RemoveContainer" containerID="c9d71cb5b23228509226762da231513c0979586fac5824ca39dbfd5f55a3ee4e"
Nov 02 08:44:03.337925 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:44:03.337748    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9d71cb5b23228509226762da231513c0979586fac5824ca39dbfd5f55a3ee4e\": container with ID starting with c9d71cb5b23228509226762da231513c0979586fac5824ca39dbfd5f55a3ee4e not found: ID does not exist" containerID="c9d71cb5b23228509226762da231513c0979586fac5824ca39dbfd5f55a3ee4e"
Nov 02 08:44:03.337925 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:03.337787    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9d71cb5b23228509226762da231513c0979586fac5824ca39dbfd5f55a3ee4e"} err="failed to get container status \"c9d71cb5b23228509226762da231513c0979586fac5824ca39dbfd5f55a3ee4e\": rpc error: code = NotFound desc = could not find container \"c9d71cb5b23228509226762da231513c0979586fac5824ca39dbfd5f55a3ee4e\": container with ID starting with c9d71cb5b23228509226762da231513c0979586fac5824ca39dbfd5f55a3ee4e not found: ID does not exist"
Nov 02 08:44:03.337925 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:03.337813    6210 scope.go:122] "RemoveContainer" containerID="a7beebd23ec2d6f86e366c12b8c8cab807c8e4d8031cedbcf54d3acdf8f5bdd0"
Nov 02 08:44:03.347384 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:03.347363    6210 scope.go:122] "RemoveContainer" containerID="a7beebd23ec2d6f86e366c12b8c8cab807c8e4d8031cedbcf54d3acdf8f5bdd0"
Nov 02 08:44:03.347692 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:44:03.347670    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7beebd23ec2d6f86e366c12b8c8cab807c8e4d8031cedbcf54d3acdf8f5bdd0\": container with ID starting with a7beebd23ec2d6f86e366c12b8c8cab807c8e4d8031cedbcf54d3acdf8f5bdd0 not found: ID does not exist" containerID="a7beebd23ec2d6f86e366c12b8c8cab807c8e4d8031cedbcf54d3acdf8f5bdd0"
Nov 02 08:44:03.347778 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:03.347702    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7beebd23ec2d6f86e366c12b8c8cab807c8e4d8031cedbcf54d3acdf8f5bdd0"} err="failed to get container status \"a7beebd23ec2d6f86e366c12b8c8cab807c8e4d8031cedbcf54d3acdf8f5bdd0\": rpc error: code = NotFound desc = could not find container \"a7beebd23ec2d6f86e366c12b8c8cab807c8e4d8031cedbcf54d3acdf8f5bdd0\": container with ID starting with a7beebd23ec2d6f86e366c12b8c8cab807c8e4d8031cedbcf54d3acdf8f5bdd0 not found: ID does not exist"
Nov 02 08:44:03.468093 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:03.468056    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b"]
Nov 02 08:44:03.473821 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:03.473792    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-e6ca80/simulator-w0-e6ca80-kserve-5c7fdf4bf4-4kw6b"]
Nov 02 08:44:03.576092 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:03.575999    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t"]
Nov 02 08:44:03.579381 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:03.579354    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-e6ca80/premium-w0-e6ca80-kserve-6d6d46c7d7-9w97t"]
Nov 02 08:44:04.351954 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:04.351925    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6c761c52-0af5-4c7a-95d5-f47c14f00aa2" path="/var/lib/kubelet/pods/6c761c52-0af5-4c7a-95d5-f47c14f00aa2/volumes"
Nov 02 08:44:04.352384 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:04.352371    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="76c6603b-42f0-4934-9a30-efc0fbc412cb" path="/var/lib/kubelet/pods/76c6603b-42f0-4934-9a30-efc0fbc412cb/volumes"
Nov 02 08:44:04.451368 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:04.451327    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"]
Nov 02 08:44:04.451566 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:04.451541    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt" podUID="437a1d86-4301-4d66-864a-2bcb6efae04c" containerName="istio-proxy" containerID="cri-o://9ac203f0a4deb418bb03e9f086d8d696f44778932cd085fa5fe63f5522666f22" gracePeriod=30
Nov 02 08:44:09.704169 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:09.704141    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"
Nov 02 08:44:09.736281 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:09.736203    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/437a1d86-4301-4d66-864a-2bcb6efae04c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/437a1d86-4301-4d66-864a-2bcb6efae04c-istio-data\") pod \"437a1d86-4301-4d66-864a-2bcb6efae04c\" (UID: \"437a1d86-4301-4d66-864a-2bcb6efae04c\") "
Nov 02 08:44:09.736427 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:09.736281    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/437a1d86-4301-4d66-864a-2bcb6efae04c-kube-api-access-rtr6d\" (UniqueName: \"kubernetes.io/projected/437a1d86-4301-4d66-864a-2bcb6efae04c-kube-api-access-rtr6d\") pod \"437a1d86-4301-4d66-864a-2bcb6efae04c\" (UID: \"437a1d86-4301-4d66-864a-2bcb6efae04c\") "
Nov 02 08:44:09.736427 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:09.736311    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/437a1d86-4301-4d66-864a-2bcb6efae04c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/437a1d86-4301-4d66-864a-2bcb6efae04c-istiod-ca-cert\") pod \"437a1d86-4301-4d66-864a-2bcb6efae04c\" (UID: \"437a1d86-4301-4d66-864a-2bcb6efae04c\") "
Nov 02 08:44:09.736427 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:09.736356    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/437a1d86-4301-4d66-864a-2bcb6efae04c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/437a1d86-4301-4d66-864a-2bcb6efae04c-credential-socket\") pod \"437a1d86-4301-4d66-864a-2bcb6efae04c\" (UID: \"437a1d86-4301-4d66-864a-2bcb6efae04c\") "
Nov 02 08:44:09.736615 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:09.736441    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/437a1d86-4301-4d66-864a-2bcb6efae04c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/437a1d86-4301-4d66-864a-2bcb6efae04c-istio-envoy\") pod \"437a1d86-4301-4d66-864a-2bcb6efae04c\" (UID: \"437a1d86-4301-4d66-864a-2bcb6efae04c\") "
Nov 02 08:44:09.736615 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:09.736467    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/437a1d86-4301-4d66-864a-2bcb6efae04c-istio-data" pod "437a1d86-4301-4d66-864a-2bcb6efae04c" (UID: "437a1d86-4301-4d66-864a-2bcb6efae04c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:44:09.736615 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:09.736527    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/437a1d86-4301-4d66-864a-2bcb6efae04c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/437a1d86-4301-4d66-864a-2bcb6efae04c-workload-socket\") pod \"437a1d86-4301-4d66-864a-2bcb6efae04c\" (UID: \"437a1d86-4301-4d66-864a-2bcb6efae04c\") "
Nov 02 08:44:09.736615 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:09.736551    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/437a1d86-4301-4d66-864a-2bcb6efae04c-istio-token\" (UniqueName: \"kubernetes.io/projected/437a1d86-4301-4d66-864a-2bcb6efae04c-istio-token\") pod \"437a1d86-4301-4d66-864a-2bcb6efae04c\" (UID: \"437a1d86-4301-4d66-864a-2bcb6efae04c\") "
Nov 02 08:44:09.736615 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:09.736602    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/437a1d86-4301-4d66-864a-2bcb6efae04c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/437a1d86-4301-4d66-864a-2bcb6efae04c-istio-podinfo\") pod \"437a1d86-4301-4d66-864a-2bcb6efae04c\" (UID: \"437a1d86-4301-4d66-864a-2bcb6efae04c\") "
Nov 02 08:44:09.736865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:09.736616    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/437a1d86-4301-4d66-864a-2bcb6efae04c-credential-socket" pod "437a1d86-4301-4d66-864a-2bcb6efae04c" (UID: "437a1d86-4301-4d66-864a-2bcb6efae04c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:44:09.736865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:09.736644    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/437a1d86-4301-4d66-864a-2bcb6efae04c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/437a1d86-4301-4d66-864a-2bcb6efae04c-workload-certs\") pod \"437a1d86-4301-4d66-864a-2bcb6efae04c\" (UID: \"437a1d86-4301-4d66-864a-2bcb6efae04c\") "
Nov 02 08:44:09.736865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:09.736757    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/437a1d86-4301-4d66-864a-2bcb6efae04c-workload-socket" pod "437a1d86-4301-4d66-864a-2bcb6efae04c" (UID: "437a1d86-4301-4d66-864a-2bcb6efae04c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:44:09.736865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:09.736813    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/437a1d86-4301-4d66-864a-2bcb6efae04c-istiod-ca-cert" pod "437a1d86-4301-4d66-864a-2bcb6efae04c" (UID: "437a1d86-4301-4d66-864a-2bcb6efae04c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:44:09.737126 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:09.736960    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/437a1d86-4301-4d66-864a-2bcb6efae04c-workload-certs" pod "437a1d86-4301-4d66-864a-2bcb6efae04c" (UID: "437a1d86-4301-4d66-864a-2bcb6efae04c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:44:09.737199 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:09.737169    6210 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/437a1d86-4301-4d66-864a-2bcb6efae04c-workload-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:44:09.737260 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:09.737207    6210 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/437a1d86-4301-4d66-864a-2bcb6efae04c-istio-data\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:44:09.737260 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:09.737222    6210 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/437a1d86-4301-4d66-864a-2bcb6efae04c-istiod-ca-cert\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:44:09.737260 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:09.737239    6210 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/437a1d86-4301-4d66-864a-2bcb6efae04c-credential-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:44:09.737260 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:09.737252    6210 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/437a1d86-4301-4d66-864a-2bcb6efae04c-workload-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:44:09.738661 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:09.738634    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/437a1d86-4301-4d66-864a-2bcb6efae04c-istio-envoy" pod "437a1d86-4301-4d66-864a-2bcb6efae04c" (UID: "437a1d86-4301-4d66-864a-2bcb6efae04c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:44:09.738793 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:09.738754    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/437a1d86-4301-4d66-864a-2bcb6efae04c-istio-podinfo" pod "437a1d86-4301-4d66-864a-2bcb6efae04c" (UID: "437a1d86-4301-4d66-864a-2bcb6efae04c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 08:44:09.738938 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:09.738920    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/437a1d86-4301-4d66-864a-2bcb6efae04c-istio-token" pod "437a1d86-4301-4d66-864a-2bcb6efae04c" (UID: "437a1d86-4301-4d66-864a-2bcb6efae04c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:44:09.739013 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:09.738952    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/437a1d86-4301-4d66-864a-2bcb6efae04c-kube-api-access-rtr6d" pod "437a1d86-4301-4d66-864a-2bcb6efae04c" (UID: "437a1d86-4301-4d66-864a-2bcb6efae04c"). InnerVolumeSpecName "kube-api-access-rtr6d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:44:09.838625 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:09.838589    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtr6d\" (UniqueName: \"kubernetes.io/projected/437a1d86-4301-4d66-864a-2bcb6efae04c-kube-api-access-rtr6d\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:44:09.838625 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:09.838621    6210 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/437a1d86-4301-4d66-864a-2bcb6efae04c-istio-envoy\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:44:09.838625 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:09.838632    6210 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/437a1d86-4301-4d66-864a-2bcb6efae04c-istio-token\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:44:09.838848 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:09.838641    6210 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/437a1d86-4301-4d66-864a-2bcb6efae04c-istio-podinfo\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:44:10.355268 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:10.355232    6210 generic.go:356] "Generic (PLEG): container finished" podID="437a1d86-4301-4d66-864a-2bcb6efae04c" containerID="9ac203f0a4deb418bb03e9f086d8d696f44778932cd085fa5fe63f5522666f22" exitCode=0
Nov 02 08:44:10.355444 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:10.355277    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt" event={"ID":"437a1d86-4301-4d66-864a-2bcb6efae04c","Type":"ContainerDied","Data":"9ac203f0a4deb418bb03e9f086d8d696f44778932cd085fa5fe63f5522666f22"}
Nov 02 08:44:10.355444 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:10.355304    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"
Nov 02 08:44:10.355444 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:10.355336    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt" event={"ID":"437a1d86-4301-4d66-864a-2bcb6efae04c","Type":"ContainerDied","Data":"ed077eab93287435e7f97ffceee33988cdcdbcf6e76d4aeb1d712f2db122f6d8"}
Nov 02 08:44:10.355444 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:10.355366    6210 scope.go:122] "RemoveContainer" containerID="9ac203f0a4deb418bb03e9f086d8d696f44778932cd085fa5fe63f5522666f22"
Nov 02 08:44:10.384299 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:10.384275    6210 scope.go:122] "RemoveContainer" containerID="9ac203f0a4deb418bb03e9f086d8d696f44778932cd085fa5fe63f5522666f22"
Nov 02 08:44:10.385209 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:44:10.385162    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ac203f0a4deb418bb03e9f086d8d696f44778932cd085fa5fe63f5522666f22\": container with ID starting with 9ac203f0a4deb418bb03e9f086d8d696f44778932cd085fa5fe63f5522666f22 not found: ID does not exist" containerID="9ac203f0a4deb418bb03e9f086d8d696f44778932cd085fa5fe63f5522666f22"
Nov 02 08:44:10.385387 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:10.385359    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ac203f0a4deb418bb03e9f086d8d696f44778932cd085fa5fe63f5522666f22"} err="failed to get container status \"9ac203f0a4deb418bb03e9f086d8d696f44778932cd085fa5fe63f5522666f22\": rpc error: code = NotFound desc = could not find container \"9ac203f0a4deb418bb03e9f086d8d696f44778932cd085fa5fe63f5522666f22\": container with ID starting with 9ac203f0a4deb418bb03e9f086d8d696f44778932cd085fa5fe63f5522666f22 not found: ID does not exist"
Nov 02 08:44:10.510081 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:10.510048    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"]
Nov 02 08:44:10.556650 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:10.556619    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt"]
Nov 02 08:44:12.128506 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:12.128464    6210 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c" podUID="b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 02 08:44:12.352766 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:12.352731    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="437a1d86-4301-4d66-864a-2bcb6efae04c" path="/var/lib/kubelet/pods/437a1d86-4301-4d66-864a-2bcb6efae04c/volumes"
Nov 02 08:44:19.415222 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:19.415186    6210 generic.go:356] "Generic (PLEG): container finished" podID="b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb" containerID="ee8c18753b4a1195ca5d4f911d1e004c968e93853239601f08799092e561e476" exitCode=0
Nov 02 08:44:19.415685 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:19.415334    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c" event={"ID":"b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb","Type":"ContainerDied","Data":"ee8c18753b4a1195ca5d4f911d1e004c968e93853239601f08799092e561e476"}
Nov 02 08:44:19.453388 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:19.453366    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c"
Nov 02 08:44:19.554305 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:19.553752    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb-kube-api-access-drlhx\" (UniqueName: \"kubernetes.io/projected/b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb-kube-api-access-drlhx\") pod \"b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb\" (UID: \"b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb\") "
Nov 02 08:44:19.554305 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:19.553820    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb-plugins-config-volume\") pod \"b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb\" (UID: \"b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb\") "
Nov 02 08:44:19.554305 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:19.554262    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb-plugins-config-volume" pod "b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb" (UID: "b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:44:19.554544 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:19.554409    6210 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb-plugins-config-volume\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:44:19.556470 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:19.556436    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb-kube-api-access-drlhx" pod "b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb" (UID: "b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb"). InnerVolumeSpecName "kube-api-access-drlhx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:44:19.656079 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:19.656035    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drlhx\" (UniqueName: \"kubernetes.io/projected/b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb-kube-api-access-drlhx\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:44:20.405131 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.405097    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh"]
Nov 02 08:44:20.405539 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.405527    6210 cpu_manager.go:414] "containerMap: removing container" podUID="76c6603b-42f0-4934-9a30-efc0fbc412cb" containerName="main"
Nov 02 08:44:20.405597 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.405540    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="76c6603b-42f0-4934-9a30-efc0fbc412cb" containerName="main"
Nov 02 08:44:20.405597 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.405556    6210 cpu_manager.go:414] "containerMap: removing container" podUID="8fcae226-6893-419e-bf0c-a39b596ae6c8" containerName="payload-pre-processing"
Nov 02 08:44:20.405597 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.405561    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8fcae226-6893-419e-bf0c-a39b596ae6c8" containerName="payload-pre-processing"
Nov 02 08:44:20.405597 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.405571    6210 cpu_manager.go:414] "containerMap: removing container" podUID="b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb" containerName="payload-processing"
Nov 02 08:44:20.405597 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.405575    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb" containerName="payload-processing"
Nov 02 08:44:20.405597 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.405584    6210 cpu_manager.go:414] "containerMap: removing container" podUID="437a1d86-4301-4d66-864a-2bcb6efae04c" containerName="istio-proxy"
Nov 02 08:44:20.405597 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.405589    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="437a1d86-4301-4d66-864a-2bcb6efae04c" containerName="istio-proxy"
Nov 02 08:44:20.405597 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.405598    6210 cpu_manager.go:414] "containerMap: removing container" podUID="72cfa2c7-210c-4e18-961b-4676855ffd42" containerName="istio-proxy"
Nov 02 08:44:20.405847 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.405603    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="72cfa2c7-210c-4e18-961b-4676855ffd42" containerName="istio-proxy"
Nov 02 08:44:20.405847 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.405614    6210 cpu_manager.go:414] "containerMap: removing container" podUID="72cfa2c7-210c-4e18-961b-4676855ffd42" containerName="istio-proxy"
Nov 02 08:44:20.405847 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.405618    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="72cfa2c7-210c-4e18-961b-4676855ffd42" containerName="istio-proxy"
Nov 02 08:44:20.406176 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.406150    6210 cpu_manager.go:414] "containerMap: removing container" podUID="6c761c52-0af5-4c7a-95d5-f47c14f00aa2" containerName="main"
Nov 02 08:44:20.406248 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.406178    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6c761c52-0af5-4c7a-95d5-f47c14f00aa2" containerName="main"
Nov 02 08:44:20.406489 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.406476    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="72cfa2c7-210c-4e18-961b-4676855ffd42" containerName="istio-proxy"
Nov 02 08:44:20.406550 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.406505    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="72cfa2c7-210c-4e18-961b-4676855ffd42" containerName="istio-proxy"
Nov 02 08:44:20.406550 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.406517    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="6c761c52-0af5-4c7a-95d5-f47c14f00aa2" containerName="main"
Nov 02 08:44:20.406550 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.406539    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="76c6603b-42f0-4934-9a30-efc0fbc412cb" containerName="main"
Nov 02 08:44:20.406687 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.406551    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="8fcae226-6893-419e-bf0c-a39b596ae6c8" containerName="payload-pre-processing"
Nov 02 08:44:20.406687 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.406566    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb" containerName="payload-processing"
Nov 02 08:44:20.406687 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.406577    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="437a1d86-4301-4d66-864a-2bcb6efae04c" containerName="istio-proxy"
Nov 02 08:44:20.413024 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.411690    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh"
Nov 02 08:44:20.428812 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.428780    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c" event={"ID":"b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb","Type":"ContainerDied","Data":"597966591f882b7e47bc0a153b7e053f1ce2122d740bb24d2e81d18b718229fb"}
Nov 02 08:44:20.429244 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.428854    6210 scope.go:122] "RemoveContainer" containerID="ee8c18753b4a1195ca5d4f911d1e004c968e93853239601f08799092e561e476"
Nov 02 08:44:20.429244 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.429017    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c"
Nov 02 08:44:20.507395 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.507367    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-2d5a5a\""
Nov 02 08:44:20.507540 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.507406    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-2d5a5a-dockercfg-h5swc\""
Nov 02 08:44:20.509388 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.509369    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh"]
Nov 02 08:44:20.565925 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.565899    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/770f6e96-6147-4a79-b71d-4f2f8898a153-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh\" (UID: \"770f6e96-6147-4a79-b71d-4f2f8898a153\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh"
Nov 02 08:44:20.566046 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.565933    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4h47\" (UniqueName: \"kubernetes.io/projected/770f6e96-6147-4a79-b71d-4f2f8898a153-kube-api-access-m4h47\") pod \"payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh\" (UID: \"770f6e96-6147-4a79-b71d-4f2f8898a153\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh"
Nov 02 08:44:20.624299 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.624237    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c"]
Nov 02 08:44:20.627650 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.627625    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c"]
Nov 02 08:44:20.666975 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.666950    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/770f6e96-6147-4a79-b71d-4f2f8898a153-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh\" (UID: \"770f6e96-6147-4a79-b71d-4f2f8898a153\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh"
Nov 02 08:44:20.667090 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.666983    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4h47\" (UniqueName: \"kubernetes.io/projected/770f6e96-6147-4a79-b71d-4f2f8898a153-kube-api-access-m4h47\") pod \"payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh\" (UID: \"770f6e96-6147-4a79-b71d-4f2f8898a153\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh"
Nov 02 08:44:20.667634 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.667616    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/770f6e96-6147-4a79-b71d-4f2f8898a153-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh\" (UID: \"770f6e96-6147-4a79-b71d-4f2f8898a153\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh"
Nov 02 08:44:20.720683 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.720661    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4h47\" (UniqueName: \"kubernetes.io/projected/770f6e96-6147-4a79-b71d-4f2f8898a153-kube-api-access-m4h47\") pod \"payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh\" (UID: \"770f6e96-6147-4a79-b71d-4f2f8898a153\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh"
Nov 02 08:44:20.729145 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:20.729122    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh"
Nov 02 08:44:21.094954 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:21.094738    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh"]
Nov 02 08:44:21.097533 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:44:21.097501    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod770f6e96_6147_4a79_b71d_4f2f8898a153.slice/crio-5f2b72d0da4e35f7a8749595dcd9026e283b10845bda4befdf1f4505f0bc499b WatchSource:0}: Error finding container 5f2b72d0da4e35f7a8749595dcd9026e283b10845bda4befdf1f4505f0bc499b: Status 404 returned error can't find the container with id 5f2b72d0da4e35f7a8749595dcd9026e283b10845bda4befdf1f4505f0bc499b
Nov 02 08:44:21.201985 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:21.201949    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h"]
Nov 02 08:44:21.206700 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:21.206677    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h"
Nov 02 08:44:21.262138 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:21.262108    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h"]
Nov 02 08:44:21.275025 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:21.274987    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf2mm\" (UniqueName: \"kubernetes.io/projected/0f96589c-cfd5-4685-b45e-f1185121c6bf-kube-api-access-tf2mm\") pod \"payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h\" (UID: \"0f96589c-cfd5-4685-b45e-f1185121c6bf\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h"
Nov 02 08:44:21.275196 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:21.275109    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f96589c-cfd5-4685-b45e-f1185121c6bf-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h\" (UID: \"0f96589c-cfd5-4685-b45e-f1185121c6bf\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h"
Nov 02 08:44:21.376099 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:21.376012    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf2mm\" (UniqueName: \"kubernetes.io/projected/0f96589c-cfd5-4685-b45e-f1185121c6bf-kube-api-access-tf2mm\") pod \"payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h\" (UID: \"0f96589c-cfd5-4685-b45e-f1185121c6bf\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h"
Nov 02 08:44:21.376099 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:21.376063    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f96589c-cfd5-4685-b45e-f1185121c6bf-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h\" (UID: \"0f96589c-cfd5-4685-b45e-f1185121c6bf\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h"
Nov 02 08:44:21.376861 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:21.376836    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f96589c-cfd5-4685-b45e-f1185121c6bf-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h\" (UID: \"0f96589c-cfd5-4685-b45e-f1185121c6bf\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h"
Nov 02 08:44:21.430702 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:21.430653    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf2mm\" (UniqueName: \"kubernetes.io/projected/0f96589c-cfd5-4685-b45e-f1185121c6bf-kube-api-access-tf2mm\") pod \"payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h\" (UID: \"0f96589c-cfd5-4685-b45e-f1185121c6bf\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h"
Nov 02 08:44:21.446732 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:21.446697    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh" event={"ID":"770f6e96-6147-4a79-b71d-4f2f8898a153","Type":"ContainerStarted","Data":"a4696aa8451ae6372fea9bdb1ee8bf2f6025c3d95a4bf3b308769adbf1bcbaa1"}
Nov 02 08:44:21.446915 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:21.446761    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh" event={"ID":"770f6e96-6147-4a79-b71d-4f2f8898a153","Type":"ContainerStarted","Data":"5f2b72d0da4e35f7a8749595dcd9026e283b10845bda4befdf1f4505f0bc499b"}
Nov 02 08:44:21.446915 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:21.446863    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh"
Nov 02 08:44:21.521478 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:21.521433    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h"
Nov 02 08:44:21.553508 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:21.553447    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh" podStartSLOduration=1.553426359 podStartE2EDuration="1.553426359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:44:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:44:21.551824002 +0000 UTC m=+2251.310252735" watchObservedRunningTime="2026-11-02 08:44:21.553426359 +0000 UTC m=+2251.311855092"
Nov 02 08:44:21.892332 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:21.892305    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h"]
Nov 02 08:44:21.898914 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:44:21.894189    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f96589c_cfd5_4685_b45e_f1185121c6bf.slice/crio-be300fa43b932bfae52dbc32c980f2587745257f65e84f90bd2f48c02739b49e WatchSource:0}: Error finding container be300fa43b932bfae52dbc32c980f2587745257f65e84f90bd2f48c02739b49e: Status 404 returned error can't find the container with id be300fa43b932bfae52dbc32c980f2587745257f65e84f90bd2f48c02739b49e
Nov 02 08:44:22.354363 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:22.354326    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb" path="/var/lib/kubelet/pods/b42fd087-dcbf-4cfc-9d12-81ec7cf5fdfb/volumes"
Nov 02 08:44:22.455607 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:22.455552    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h" event={"ID":"0f96589c-cfd5-4685-b45e-f1185121c6bf","Type":"ContainerStarted","Data":"3d9dbae09d2c0a603075a1b557129099335bae286981d214373f7e079d98c187"}
Nov 02 08:44:22.456106 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:22.455652    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h" event={"ID":"0f96589c-cfd5-4685-b45e-f1185121c6bf","Type":"ContainerStarted","Data":"be300fa43b932bfae52dbc32c980f2587745257f65e84f90bd2f48c02739b49e"}
Nov 02 08:44:22.457963 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:22.457936    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h"
Nov 02 08:44:22.566347 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:22.566286    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h" podStartSLOduration=1.5662710720000002 podStartE2EDuration="1.566271072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:44:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:44:22.565734903 +0000 UTC m=+2252.324163635" watchObservedRunningTime="2026-11-02 08:44:22.566271072 +0000 UTC m=+2252.324699804"
Nov 02 08:44:30.822034 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:44:30.821995    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:44:32.457674 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:32.457644    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh"
Nov 02 08:44:32.910474 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:32.910404    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69"]
Nov 02 08:44:32.910718 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:32.910662    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69" podUID="88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6" containerName="maas-api" containerID="cri-o://ba936b859057f316a4a79468e7983719512b3a7d1d9eae98ff15a44a416bee94" gracePeriod=30
Nov 02 08:44:33.204008 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:33.203981    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69"
Nov 02 08:44:33.317898 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:33.317779    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6-openshift-service-ca\") pod \"88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6\" (UID: \"88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6\") "
Nov 02 08:44:33.323901 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:33.319801    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6-maas-api-tls\") pod \"88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6\" (UID: \"88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6\") "
Nov 02 08:44:33.323901 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:33.319941    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6-kube-api-access-sn6p2\" (UniqueName: \"kubernetes.io/projected/88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6-kube-api-access-sn6p2\") pod \"88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6\" (UID: \"88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6\") "
Nov 02 08:44:33.323901 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:33.320001    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6-metrics-certs\" (UniqueName: \"kubernetes.io/secret/88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6-metrics-certs\") pod \"88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6\" (UID: \"88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6\") "
Nov 02 08:44:33.332938 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:33.325626    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6-openshift-service-ca" pod "88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6" (UID: "88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:44:33.332938 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:33.332827    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6-metrics-certs" pod "88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6" (UID: "88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:44:33.339671 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:33.339505    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6-kube-api-access-sn6p2" pod "88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6" (UID: "88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6"). InnerVolumeSpecName "kube-api-access-sn6p2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:44:33.346324 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:33.346289    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6-maas-api-tls" pod "88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6" (UID: "88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:44:33.421372 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:33.421342    6210 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6-openshift-service-ca\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:44:33.421372 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:33.421369    6210 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6-maas-api-tls\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:44:33.421372 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:33.421379    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sn6p2\" (UniqueName: \"kubernetes.io/projected/88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6-kube-api-access-sn6p2\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:44:33.421580 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:33.421388    6210 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6-metrics-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:44:33.513634 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:33.513599    6210 generic.go:356] "Generic (PLEG): container finished" podID="88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6" containerID="ba936b859057f316a4a79468e7983719512b3a7d1d9eae98ff15a44a416bee94" exitCode=0
Nov 02 08:44:33.514115 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:33.513672    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69"
Nov 02 08:44:33.514115 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:33.513695    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69" event={"ID":"88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6","Type":"ContainerDied","Data":"ba936b859057f316a4a79468e7983719512b3a7d1d9eae98ff15a44a416bee94"}
Nov 02 08:44:33.514115 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:33.513753    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69" event={"ID":"88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6","Type":"ContainerDied","Data":"a0d9020a84b637d0117e42bed35f1218b1771cd43aa65b47ab2d3412d7e8aff0"}
Nov 02 08:44:33.514115 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:33.513778    6210 scope.go:122] "RemoveContainer" containerID="ba936b859057f316a4a79468e7983719512b3a7d1d9eae98ff15a44a416bee94"
Nov 02 08:44:33.527608 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:33.527590    6210 scope.go:122] "RemoveContainer" containerID="ba936b859057f316a4a79468e7983719512b3a7d1d9eae98ff15a44a416bee94"
Nov 02 08:44:33.527916 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:44:33.527896    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba936b859057f316a4a79468e7983719512b3a7d1d9eae98ff15a44a416bee94\": container with ID starting with ba936b859057f316a4a79468e7983719512b3a7d1d9eae98ff15a44a416bee94 not found: ID does not exist" containerID="ba936b859057f316a4a79468e7983719512b3a7d1d9eae98ff15a44a416bee94"
Nov 02 08:44:33.527999 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:33.527925    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba936b859057f316a4a79468e7983719512b3a7d1d9eae98ff15a44a416bee94"} err="failed to get container status \"ba936b859057f316a4a79468e7983719512b3a7d1d9eae98ff15a44a416bee94\": rpc error: code = NotFound desc = could not find container \"ba936b859057f316a4a79468e7983719512b3a7d1d9eae98ff15a44a416bee94\": container with ID starting with ba936b859057f316a4a79468e7983719512b3a7d1d9eae98ff15a44a416bee94 not found: ID does not exist"
Nov 02 08:44:33.665680 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:33.665648    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69"]
Nov 02 08:44:33.668726 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:33.668701    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-ad4580-66677c95dc-9jb69"]
Nov 02 08:44:34.351578 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:34.351547    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6" path="/var/lib/kubelet/pods/88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6/volumes"
Nov 02 08:44:34.467903 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:44:34.467850    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h"
Nov 02 08:45:00.161534 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:00.161500    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-d0628e-29893485-hl9gp"]
Nov 02 08:45:00.161995 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:00.161980    6210 cpu_manager.go:414] "containerMap: removing container" podUID="88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6" containerName="maas-api"
Nov 02 08:45:00.162052 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:00.161998    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6" containerName="maas-api"
Nov 02 08:45:00.162092 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:00.162084    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="88b78ebe-7f52-4ecb-bac4-ac99e2a2eba6" containerName="maas-api"
Nov 02 08:45:00.166870 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:00.166847    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-d0628e-29893485-hl9gp"
Nov 02 08:45:00.168246 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:00.168224    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e6ca80-29893485-7f24c"]
Nov 02 08:45:00.171604 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:00.171585    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e6ca80-29893485-7f24c"
Nov 02 08:45:00.188536 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:00.188515    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-9ceb40-29893485-ntwdr"]
Nov 02 08:45:00.191984 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:00.191967    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-9ceb40-29893485-ntwdr"
Nov 02 08:45:00.215855 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:00.215820    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4p9nt\""
Nov 02 08:45:00.265603 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:00.265577    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-d0628e-29893485-hl9gp"]
Nov 02 08:45:00.269197 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:00.269172    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e6ca80-29893485-7f24c"]
Nov 02 08:45:00.274865 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:00.274836    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gwpk\" (UniqueName: \"kubernetes.io/projected/9b59ca11-8aba-4352-9974-50ed7cf4ec0c-kube-api-access-6gwpk\") pod \"maas-api-key-cleanup-e2e-worker-w1-d0628e-29893485-hl9gp\" (UID: \"9b59ca11-8aba-4352-9974-50ed7cf4ec0c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-d0628e-29893485-hl9gp"
Nov 02 08:45:00.274984 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:00.274910    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d02b15e-21f7-4862-9d45-b83285121f60-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-e6ca80-29893485-7f24c\" (UID: \"3d02b15e-21f7-4862-9d45-b83285121f60\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e6ca80-29893485-7f24c"
Nov 02 08:45:00.275050 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:00.275028    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7mng\" (UniqueName: \"kubernetes.io/projected/a4bd30ea-148b-415c-8317-3e10bf064ce6-kube-api-access-z7mng\") pod \"maas-api-key-cleanup-e2e-ipp-a-9ceb40-29893485-ntwdr\" (UID: \"a4bd30ea-148b-415c-8317-3e10bf064ce6\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-9ceb40-29893485-ntwdr"
Nov 02 08:45:00.275179 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:00.275092    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4bd30ea-148b-415c-8317-3e10bf064ce6-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-ipp-a-9ceb40-29893485-ntwdr\" (UID: \"a4bd30ea-148b-415c-8317-3e10bf064ce6\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-9ceb40-29893485-ntwdr"
Nov 02 08:45:00.275179 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:00.275133    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b59ca11-8aba-4352-9974-50ed7cf4ec0c-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w1-d0628e-29893485-hl9gp\" (UID: \"9b59ca11-8aba-4352-9974-50ed7cf4ec0c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-d0628e-29893485-hl9gp"
Nov 02 08:45:00.275179 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:00.275163    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2js2\" (UniqueName: \"kubernetes.io/projected/3d02b15e-21f7-4862-9d45-b83285121f60-kube-api-access-c2js2\") pod \"maas-api-key-cleanup-e2e-worker-w0-e6ca80-29893485-7f24c\" (UID: \"3d02b15e-21f7-4862-9d45-b83285121f60\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e6ca80-29893485-7f24c"
Nov 02 08:45:00.328803 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:00.328756    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-9ceb40-29893485-ntwdr"]
Nov 02 08:45:00.376476 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:00.376445    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7mng\" (UniqueName: \"kubernetes.io/projected/a4bd30ea-148b-415c-8317-3e10bf064ce6-kube-api-access-z7mng\") pod \"maas-api-key-cleanup-e2e-ipp-a-9ceb40-29893485-ntwdr\" (UID: \"a4bd30ea-148b-415c-8317-3e10bf064ce6\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-9ceb40-29893485-ntwdr"
Nov 02 08:45:00.376649 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:00.376509    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4bd30ea-148b-415c-8317-3e10bf064ce6-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-ipp-a-9ceb40-29893485-ntwdr\" (UID: \"a4bd30ea-148b-415c-8317-3e10bf064ce6\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-9ceb40-29893485-ntwdr"
Nov 02 08:45:00.376649 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:00.376544    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b59ca11-8aba-4352-9974-50ed7cf4ec0c-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w1-d0628e-29893485-hl9gp\" (UID: \"9b59ca11-8aba-4352-9974-50ed7cf4ec0c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-d0628e-29893485-hl9gp"
Nov 02 08:45:00.376649 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:00.376572    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2js2\" (UniqueName: \"kubernetes.io/projected/3d02b15e-21f7-4862-9d45-b83285121f60-kube-api-access-c2js2\") pod \"maas-api-key-cleanup-e2e-worker-w0-e6ca80-29893485-7f24c\" (UID: \"3d02b15e-21f7-4862-9d45-b83285121f60\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e6ca80-29893485-7f24c"
Nov 02 08:45:00.376649 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:00.376636    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gwpk\" (UniqueName: \"kubernetes.io/projected/9b59ca11-8aba-4352-9974-50ed7cf4ec0c-kube-api-access-6gwpk\") pod \"maas-api-key-cleanup-e2e-worker-w1-d0628e-29893485-hl9gp\" (UID: \"9b59ca11-8aba-4352-9974-50ed7cf4ec0c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-d0628e-29893485-hl9gp"
Nov 02 08:45:00.377041 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:00.376666    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d02b15e-21f7-4862-9d45-b83285121f60-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-e6ca80-29893485-7f24c\" (UID: \"3d02b15e-21f7-4862-9d45-b83285121f60\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e6ca80-29893485-7f24c"
Nov 02 08:45:00.377440 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:00.377410    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b59ca11-8aba-4352-9974-50ed7cf4ec0c-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w1-d0628e-29893485-hl9gp\" (UID: \"9b59ca11-8aba-4352-9974-50ed7cf4ec0c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-d0628e-29893485-hl9gp"
Nov 02 08:45:00.377552 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:00.377410    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4bd30ea-148b-415c-8317-3e10bf064ce6-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-ipp-a-9ceb40-29893485-ntwdr\" (UID: \"a4bd30ea-148b-415c-8317-3e10bf064ce6\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-9ceb40-29893485-ntwdr"
Nov 02 08:45:00.377552 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:00.377477    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d02b15e-21f7-4862-9d45-b83285121f60-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-e6ca80-29893485-7f24c\" (UID: \"3d02b15e-21f7-4862-9d45-b83285121f60\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e6ca80-29893485-7f24c"
Nov 02 08:45:00.431083 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:00.431001    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gwpk\" (UniqueName: \"kubernetes.io/projected/9b59ca11-8aba-4352-9974-50ed7cf4ec0c-kube-api-access-6gwpk\") pod \"maas-api-key-cleanup-e2e-worker-w1-d0628e-29893485-hl9gp\" (UID: \"9b59ca11-8aba-4352-9974-50ed7cf4ec0c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-d0628e-29893485-hl9gp"
Nov 02 08:45:00.431345 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:00.431323    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2js2\" (UniqueName: \"kubernetes.io/projected/3d02b15e-21f7-4862-9d45-b83285121f60-kube-api-access-c2js2\") pod \"maas-api-key-cleanup-e2e-worker-w0-e6ca80-29893485-7f24c\" (UID: \"3d02b15e-21f7-4862-9d45-b83285121f60\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e6ca80-29893485-7f24c"
Nov 02 08:45:00.431645 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:00.431624    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7mng\" (UniqueName: \"kubernetes.io/projected/a4bd30ea-148b-415c-8317-3e10bf064ce6-kube-api-access-z7mng\") pod \"maas-api-key-cleanup-e2e-ipp-a-9ceb40-29893485-ntwdr\" (UID: \"a4bd30ea-148b-415c-8317-3e10bf064ce6\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-9ceb40-29893485-ntwdr"
Nov 02 08:45:00.481375 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:00.481346    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-d0628e-29893485-hl9gp"
Nov 02 08:45:00.488589 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:00.488568    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e6ca80-29893485-7f24c"
Nov 02 08:45:00.504060 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:00.503807    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-9ceb40-29893485-ntwdr"
Nov 02 08:45:00.820266 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:45:00.820223    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:45:00.857491 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:00.857465    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-d0628e-29893485-hl9gp"]
Nov 02 08:45:00.859416 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:45:00.859378    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b59ca11_8aba_4352_9974_50ed7cf4ec0c.slice/crio-59cfb0d730ce10b642e729138032849b36de7d6af254583eb34aeeea24d6487b WatchSource:0}: Error finding container 59cfb0d730ce10b642e729138032849b36de7d6af254583eb34aeeea24d6487b: Status 404 returned error can't find the container with id 59cfb0d730ce10b642e729138032849b36de7d6af254583eb34aeeea24d6487b
Nov 02 08:45:00.902462 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:00.902437    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e6ca80-29893485-7f24c"]
Nov 02 08:45:00.904362 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:45:00.904329    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d02b15e_21f7_4862_9d45_b83285121f60.slice/crio-67b5b3fd9b68441c35f37b2fba8484ed16f5eea4771eb9107640c3007bf7dbd5 WatchSource:0}: Error finding container 67b5b3fd9b68441c35f37b2fba8484ed16f5eea4771eb9107640c3007bf7dbd5: Status 404 returned error can't find the container with id 67b5b3fd9b68441c35f37b2fba8484ed16f5eea4771eb9107640c3007bf7dbd5
Nov 02 08:45:00.904870 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:00.904655    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-9ceb40-29893485-ntwdr"]
Nov 02 08:45:00.905458 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:45:00.905435    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4bd30ea_148b_415c_8317_3e10bf064ce6.slice/crio-85907cfe2d7bb7f0a720e6df5c01fdbb754ae7fa2b2476c9a35ad41d5b3fe847 WatchSource:0}: Error finding container 85907cfe2d7bb7f0a720e6df5c01fdbb754ae7fa2b2476c9a35ad41d5b3fe847: Status 404 returned error can't find the container with id 85907cfe2d7bb7f0a720e6df5c01fdbb754ae7fa2b2476c9a35ad41d5b3fe847
Nov 02 08:45:01.676415 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:01.676376    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-d0628e-29893485-hl9gp" event={"ID":"9b59ca11-8aba-4352-9974-50ed7cf4ec0c","Type":"ContainerStarted","Data":"d1ec1a84fc9e20c9d77662fab5c851a03eba568df7a25d5c4e8f1cd251d31867"}
Nov 02 08:45:01.676956 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:01.676441    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-d0628e-29893485-hl9gp" event={"ID":"9b59ca11-8aba-4352-9974-50ed7cf4ec0c","Type":"ContainerStarted","Data":"59cfb0d730ce10b642e729138032849b36de7d6af254583eb34aeeea24d6487b"}
Nov 02 08:45:01.677999 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:01.677971    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e6ca80-29893485-7f24c" event={"ID":"3d02b15e-21f7-4862-9d45-b83285121f60","Type":"ContainerStarted","Data":"5cf8517443f5af0a82161243c7eec58599888e0f5a9260a58140546d250556c9"}
Nov 02 08:45:01.678111 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:01.678022    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e6ca80-29893485-7f24c" event={"ID":"3d02b15e-21f7-4862-9d45-b83285121f60","Type":"ContainerStarted","Data":"67b5b3fd9b68441c35f37b2fba8484ed16f5eea4771eb9107640c3007bf7dbd5"}
Nov 02 08:45:01.679484 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:01.679463    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-9ceb40-29893485-ntwdr" event={"ID":"a4bd30ea-148b-415c-8317-3e10bf064ce6","Type":"ContainerStarted","Data":"39b45262e1c552ccd9768e2c390c7b9b0a7dad62da58dac9a40908e85ae5cd77"}
Nov 02 08:45:01.679571 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:01.679499    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-9ceb40-29893485-ntwdr" event={"ID":"a4bd30ea-148b-415c-8317-3e10bf064ce6","Type":"ContainerStarted","Data":"85907cfe2d7bb7f0a720e6df5c01fdbb754ae7fa2b2476c9a35ad41d5b3fe847"}
Nov 02 08:45:01.782659 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:01.782607    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-d0628e-29893485-hl9gp" podStartSLOduration=1.782594072 podStartE2EDuration="1.782594072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:45:01.781951511 +0000 UTC m=+2291.540380244" watchObservedRunningTime="2026-11-02 08:45:01.782594072 +0000 UTC m=+2291.541022823"
Nov 02 08:45:01.890301 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:01.890250    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e6ca80-29893485-7f24c" podStartSLOduration=1.890235867 podStartE2EDuration="1.890235867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:45:01.888929468 +0000 UTC m=+2291.647358197" watchObservedRunningTime="2026-11-02 08:45:01.890235867 +0000 UTC m=+2291.648664599"
Nov 02 08:45:01.997584 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:01.997507    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-9ceb40-29893485-ntwdr" podStartSLOduration=1.997491761 podStartE2EDuration="1.997491761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 08:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:45:01.995060062 +0000 UTC m=+2291.753488793" watchObservedRunningTime="2026-11-02 08:45:01.997491761 +0000 UTC m=+2291.755920494"
Nov 02 08:45:02.687768 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:02.687722    6210 generic.go:356] "Generic (PLEG): container finished" podID="3d02b15e-21f7-4862-9d45-b83285121f60" containerID="5cf8517443f5af0a82161243c7eec58599888e0f5a9260a58140546d250556c9" exitCode=60
Nov 02 08:45:02.688279 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:02.687805    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e6ca80-29893485-7f24c" event={"ID":"3d02b15e-21f7-4862-9d45-b83285121f60","Type":"ContainerDied","Data":"5cf8517443f5af0a82161243c7eec58599888e0f5a9260a58140546d250556c9"}
Nov 02 08:45:02.688279 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:02.688187    6210 scope.go:122] "RemoveContainer" containerID="5cf8517443f5af0a82161243c7eec58599888e0f5a9260a58140546d250556c9"
Nov 02 08:45:02.689654 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:02.689618    6210 generic.go:356] "Generic (PLEG): container finished" podID="a4bd30ea-148b-415c-8317-3e10bf064ce6" containerID="39b45262e1c552ccd9768e2c390c7b9b0a7dad62da58dac9a40908e85ae5cd77" exitCode=60
Nov 02 08:45:02.689765 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:02.689699    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-9ceb40-29893485-ntwdr" event={"ID":"a4bd30ea-148b-415c-8317-3e10bf064ce6","Type":"ContainerDied","Data":"39b45262e1c552ccd9768e2c390c7b9b0a7dad62da58dac9a40908e85ae5cd77"}
Nov 02 08:45:02.689956 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:02.689940    6210 scope.go:122] "RemoveContainer" containerID="39b45262e1c552ccd9768e2c390c7b9b0a7dad62da58dac9a40908e85ae5cd77"
Nov 02 08:45:02.691981 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:02.691556    6210 generic.go:356] "Generic (PLEG): container finished" podID="9b59ca11-8aba-4352-9974-50ed7cf4ec0c" containerID="d1ec1a84fc9e20c9d77662fab5c851a03eba568df7a25d5c4e8f1cd251d31867" exitCode=60
Nov 02 08:45:02.691981 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:02.691591    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-d0628e-29893485-hl9gp" event={"ID":"9b59ca11-8aba-4352-9974-50ed7cf4ec0c","Type":"ContainerDied","Data":"d1ec1a84fc9e20c9d77662fab5c851a03eba568df7a25d5c4e8f1cd251d31867"}
Nov 02 08:45:02.691981 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:02.691805    6210 scope.go:122] "RemoveContainer" containerID="d1ec1a84fc9e20c9d77662fab5c851a03eba568df7a25d5c4e8f1cd251d31867"
Nov 02 08:45:03.698554 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:03.698514    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e6ca80-29893485-7f24c" event={"ID":"3d02b15e-21f7-4862-9d45-b83285121f60","Type":"ContainerStarted","Data":"ba5483fa23b260ad6e197ff075875bbc34f74123a42888172f7e59580559d6f1"}
Nov 02 08:45:03.718085 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:03.718047    6210 generic.go:356] "Generic (PLEG): container finished" podID="a4bd30ea-148b-415c-8317-3e10bf064ce6" containerID="f2e2a0dbbf010ddca7ea48f24a55cd5046af7d9cb75865a13044b531d425f75a" exitCode=60
Nov 02 08:45:03.718269 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:03.718162    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-9ceb40-29893485-ntwdr" event={"ID":"a4bd30ea-148b-415c-8317-3e10bf064ce6","Type":"ContainerDied","Data":"f2e2a0dbbf010ddca7ea48f24a55cd5046af7d9cb75865a13044b531d425f75a"}
Nov 02 08:45:03.718269 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:03.718250    6210 scope.go:122] "RemoveContainer" containerID="39b45262e1c552ccd9768e2c390c7b9b0a7dad62da58dac9a40908e85ae5cd77"
Nov 02 08:45:03.718768 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:03.718740    6210 scope.go:122] "RemoveContainer" containerID="f2e2a0dbbf010ddca7ea48f24a55cd5046af7d9cb75865a13044b531d425f75a"
Nov 02 08:45:03.719107 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:45:03.719077    6210 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-ipp-a-9ceb40-29893485-ntwdr_odh-ai-gateway-infra(a4bd30ea-148b-415c-8317-3e10bf064ce6)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-9ceb40-29893485-ntwdr" podUID="a4bd30ea-148b-415c-8317-3e10bf064ce6"
Nov 02 08:45:03.721540 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:03.721517    6210 generic.go:356] "Generic (PLEG): container finished" podID="9b59ca11-8aba-4352-9974-50ed7cf4ec0c" containerID="ec9764ee2656dba9b98a07ca4c109f502f2bf60f7b8cffac700ff347fc692e8e" exitCode=60
Nov 02 08:45:03.721644 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:03.721557    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-d0628e-29893485-hl9gp" event={"ID":"9b59ca11-8aba-4352-9974-50ed7cf4ec0c","Type":"ContainerDied","Data":"ec9764ee2656dba9b98a07ca4c109f502f2bf60f7b8cffac700ff347fc692e8e"}
Nov 02 08:45:03.721943 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:03.721923    6210 scope.go:122] "RemoveContainer" containerID="ec9764ee2656dba9b98a07ca4c109f502f2bf60f7b8cffac700ff347fc692e8e"
Nov 02 08:45:03.722231 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:45:03.722208    6210 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w1-d0628e-29893485-hl9gp_odh-ai-gateway-infra(9b59ca11-8aba-4352-9974-50ed7cf4ec0c)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-d0628e-29893485-hl9gp" podUID="9b59ca11-8aba-4352-9974-50ed7cf4ec0c"
Nov 02 08:45:03.735405 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:03.735372    6210 scope.go:122] "RemoveContainer" containerID="d1ec1a84fc9e20c9d77662fab5c851a03eba568df7a25d5c4e8f1cd251d31867"
Nov 02 08:45:04.728754 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:04.728722    6210 generic.go:356] "Generic (PLEG): container finished" podID="3d02b15e-21f7-4862-9d45-b83285121f60" containerID="ba5483fa23b260ad6e197ff075875bbc34f74123a42888172f7e59580559d6f1" exitCode=60
Nov 02 08:45:04.729364 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:04.728816    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e6ca80-29893485-7f24c" event={"ID":"3d02b15e-21f7-4862-9d45-b83285121f60","Type":"ContainerDied","Data":"ba5483fa23b260ad6e197ff075875bbc34f74123a42888172f7e59580559d6f1"}
Nov 02 08:45:04.729364 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:04.728893    6210 scope.go:122] "RemoveContainer" containerID="5cf8517443f5af0a82161243c7eec58599888e0f5a9260a58140546d250556c9"
Nov 02 08:45:04.729364 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:04.729116    6210 scope.go:122] "RemoveContainer" containerID="ba5483fa23b260ad6e197ff075875bbc34f74123a42888172f7e59580559d6f1"
Nov 02 08:45:04.729546 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:45:04.729416    6210 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-e6ca80-29893485-7f24c_odh-ai-gateway-infra(3d02b15e-21f7-4862-9d45-b83285121f60)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e6ca80-29893485-7f24c" podUID="3d02b15e-21f7-4862-9d45-b83285121f60"
Nov 02 08:45:04.731014 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:04.730997    6210 scope.go:122] "RemoveContainer" containerID="f2e2a0dbbf010ddca7ea48f24a55cd5046af7d9cb75865a13044b531d425f75a"
Nov 02 08:45:04.731281 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:45:04.731258    6210 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-ipp-a-9ceb40-29893485-ntwdr_odh-ai-gateway-infra(a4bd30ea-148b-415c-8317-3e10bf064ce6)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-9ceb40-29893485-ntwdr" podUID="a4bd30ea-148b-415c-8317-3e10bf064ce6"
Nov 02 08:45:04.732675 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:04.732660    6210 scope.go:122] "RemoveContainer" containerID="ec9764ee2656dba9b98a07ca4c109f502f2bf60f7b8cffac700ff347fc692e8e"
Nov 02 08:45:04.732933 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:45:04.732908    6210 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w1-d0628e-29893485-hl9gp_odh-ai-gateway-infra(9b59ca11-8aba-4352-9974-50ed7cf4ec0c)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-d0628e-29893485-hl9gp" podUID="9b59ca11-8aba-4352-9974-50ed7cf4ec0c"
Nov 02 08:45:05.739689 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:05.739664    6210 scope.go:122] "RemoveContainer" containerID="ba5483fa23b260ad6e197ff075875bbc34f74123a42888172f7e59580559d6f1"
Nov 02 08:45:05.740124 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:45:05.739941    6210 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-e6ca80-29893485-7f24c_odh-ai-gateway-infra(3d02b15e-21f7-4862-9d45-b83285121f60)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e6ca80-29893485-7f24c" podUID="3d02b15e-21f7-4862-9d45-b83285121f60"
Nov 02 08:45:10.874844 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:10.874805    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e6ca80-29893485-7f24c"]
Nov 02 08:45:11.089190 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:11.089157    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e6ca80-29893485-7f24c"
Nov 02 08:45:11.236922 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:11.232286    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3d02b15e-21f7-4862-9d45-b83285121f60-kube-api-access-c2js2\" (UniqueName: \"kubernetes.io/projected/3d02b15e-21f7-4862-9d45-b83285121f60-kube-api-access-c2js2\") pod \"3d02b15e-21f7-4862-9d45-b83285121f60\" (UID: \"3d02b15e-21f7-4862-9d45-b83285121f60\") "
Nov 02 08:45:11.236922 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:11.232390    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3d02b15e-21f7-4862-9d45-b83285121f60-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d02b15e-21f7-4862-9d45-b83285121f60-maas-api-service-ca\") pod \"3d02b15e-21f7-4862-9d45-b83285121f60\" (UID: \"3d02b15e-21f7-4862-9d45-b83285121f60\") "
Nov 02 08:45:11.236922 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:11.233350    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d02b15e-21f7-4862-9d45-b83285121f60-maas-api-service-ca" pod "3d02b15e-21f7-4862-9d45-b83285121f60" (UID: "3d02b15e-21f7-4862-9d45-b83285121f60"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:45:11.236922 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:11.235458    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d02b15e-21f7-4862-9d45-b83285121f60-kube-api-access-c2js2" pod "3d02b15e-21f7-4862-9d45-b83285121f60" (UID: "3d02b15e-21f7-4862-9d45-b83285121f60"). InnerVolumeSpecName "kube-api-access-c2js2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:45:11.333905 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:11.333851    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2js2\" (UniqueName: \"kubernetes.io/projected/3d02b15e-21f7-4862-9d45-b83285121f60-kube-api-access-c2js2\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:45:11.333905 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:11.333895    6210 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d02b15e-21f7-4862-9d45-b83285121f60-maas-api-service-ca\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:45:11.773188 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:11.773158    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e6ca80-29893485-7f24c"
Nov 02 08:45:11.773361 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:11.773189    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e6ca80-29893485-7f24c" event={"ID":"3d02b15e-21f7-4862-9d45-b83285121f60","Type":"ContainerDied","Data":"67b5b3fd9b68441c35f37b2fba8484ed16f5eea4771eb9107640c3007bf7dbd5"}
Nov 02 08:45:11.773361 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:11.773254    6210 scope.go:122] "RemoveContainer" containerID="ba5483fa23b260ad6e197ff075875bbc34f74123a42888172f7e59580559d6f1"
Nov 02 08:45:11.927716 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:11.927553    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e6ca80-29893485-7f24c"]
Nov 02 08:45:11.929632 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:11.929605    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e6ca80-29893485-7f24c"]
Nov 02 08:45:12.351699 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:12.351656    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3d02b15e-21f7-4862-9d45-b83285121f60" path="/var/lib/kubelet/pods/3d02b15e-21f7-4862-9d45-b83285121f60/volumes"
Nov 02 08:45:14.346403 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:14.346374    6210 scope.go:122] "RemoveContainer" containerID="ec9764ee2656dba9b98a07ca4c109f502f2bf60f7b8cffac700ff347fc692e8e"
Nov 02 08:45:14.792137 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:14.792102    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-d0628e-29893485-hl9gp" event={"ID":"9b59ca11-8aba-4352-9974-50ed7cf4ec0c","Type":"ContainerStarted","Data":"d0c8795cef84c2a67dceb59cce933b3328ac6c43856261416de2987a1e9e4d91"}
Nov 02 08:45:15.800890 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:15.800838    6210 generic.go:356] "Generic (PLEG): container finished" podID="9b59ca11-8aba-4352-9974-50ed7cf4ec0c" containerID="d0c8795cef84c2a67dceb59cce933b3328ac6c43856261416de2987a1e9e4d91" exitCode=60
Nov 02 08:45:15.801405 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:15.800910    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-d0628e-29893485-hl9gp" event={"ID":"9b59ca11-8aba-4352-9974-50ed7cf4ec0c","Type":"ContainerDied","Data":"d0c8795cef84c2a67dceb59cce933b3328ac6c43856261416de2987a1e9e4d91"}
Nov 02 08:45:15.801405 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:15.800980    6210 scope.go:122] "RemoveContainer" containerID="ec9764ee2656dba9b98a07ca4c109f502f2bf60f7b8cffac700ff347fc692e8e"
Nov 02 08:45:15.801405 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:15.801355    6210 scope.go:122] "RemoveContainer" containerID="d0c8795cef84c2a67dceb59cce933b3328ac6c43856261416de2987a1e9e4d91"
Nov 02 08:45:15.801917 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:45:15.801681    6210 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w1-d0628e-29893485-hl9gp_odh-ai-gateway-infra(9b59ca11-8aba-4352-9974-50ed7cf4ec0c)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-d0628e-29893485-hl9gp" podUID="9b59ca11-8aba-4352-9974-50ed7cf4ec0c"
Nov 02 08:45:15.907328 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:15.907298    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-d0628e-29893485-hl9gp"]
Nov 02 08:45:16.961772 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:16.961747    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-d0628e-29893485-hl9gp"
Nov 02 08:45:17.121457 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:17.121377    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9b59ca11-8aba-4352-9974-50ed7cf4ec0c-kube-api-access-6gwpk\" (UniqueName: \"kubernetes.io/projected/9b59ca11-8aba-4352-9974-50ed7cf4ec0c-kube-api-access-6gwpk\") pod \"9b59ca11-8aba-4352-9974-50ed7cf4ec0c\" (UID: \"9b59ca11-8aba-4352-9974-50ed7cf4ec0c\") "
Nov 02 08:45:17.121457 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:17.121422    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9b59ca11-8aba-4352-9974-50ed7cf4ec0c-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b59ca11-8aba-4352-9974-50ed7cf4ec0c-maas-api-service-ca\") pod \"9b59ca11-8aba-4352-9974-50ed7cf4ec0c\" (UID: \"9b59ca11-8aba-4352-9974-50ed7cf4ec0c\") "
Nov 02 08:45:17.121853 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:17.121832    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b59ca11-8aba-4352-9974-50ed7cf4ec0c-maas-api-service-ca" pod "9b59ca11-8aba-4352-9974-50ed7cf4ec0c" (UID: "9b59ca11-8aba-4352-9974-50ed7cf4ec0c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:45:17.123441 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:17.123415    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b59ca11-8aba-4352-9974-50ed7cf4ec0c-kube-api-access-6gwpk" pod "9b59ca11-8aba-4352-9974-50ed7cf4ec0c" (UID: "9b59ca11-8aba-4352-9974-50ed7cf4ec0c"). InnerVolumeSpecName "kube-api-access-6gwpk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:45:17.222456 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:17.222426    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gwpk\" (UniqueName: \"kubernetes.io/projected/9b59ca11-8aba-4352-9974-50ed7cf4ec0c-kube-api-access-6gwpk\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:45:17.222456 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:17.222451    6210 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b59ca11-8aba-4352-9974-50ed7cf4ec0c-maas-api-service-ca\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:45:17.345581 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:17.345553    6210 scope.go:122] "RemoveContainer" containerID="f2e2a0dbbf010ddca7ea48f24a55cd5046af7d9cb75865a13044b531d425f75a"
Nov 02 08:45:17.814283 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:17.814244    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-9ceb40-29893485-ntwdr" event={"ID":"a4bd30ea-148b-415c-8317-3e10bf064ce6","Type":"ContainerStarted","Data":"4f73d55d3f0eb7390b4cfdec5e72e4a20c30b5d3b6cdf868a07376dac4cdf798"}
Nov 02 08:45:17.815557 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:17.815535    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-d0628e-29893485-hl9gp"
Nov 02 08:45:17.815672 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:17.815534    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-d0628e-29893485-hl9gp" event={"ID":"9b59ca11-8aba-4352-9974-50ed7cf4ec0c","Type":"ContainerDied","Data":"59cfb0d730ce10b642e729138032849b36de7d6af254583eb34aeeea24d6487b"}
Nov 02 08:45:17.815672 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:17.815659    6210 scope.go:122] "RemoveContainer" containerID="d0c8795cef84c2a67dceb59cce933b3328ac6c43856261416de2987a1e9e4d91"
Nov 02 08:45:18.023840 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:18.023808    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-d0628e-29893485-hl9gp"]
Nov 02 08:45:18.030532 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:18.030500    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-d0628e-29893485-hl9gp"]
Nov 02 08:45:18.352369 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:18.352335    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9b59ca11-8aba-4352-9974-50ed7cf4ec0c" path="/var/lib/kubelet/pods/9b59ca11-8aba-4352-9974-50ed7cf4ec0c/volumes"
Nov 02 08:45:18.823342 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:18.823311    6210 generic.go:356] "Generic (PLEG): container finished" podID="a4bd30ea-148b-415c-8317-3e10bf064ce6" containerID="4f73d55d3f0eb7390b4cfdec5e72e4a20c30b5d3b6cdf868a07376dac4cdf798" exitCode=60
Nov 02 08:45:18.823539 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:18.823381    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-9ceb40-29893485-ntwdr" event={"ID":"a4bd30ea-148b-415c-8317-3e10bf064ce6","Type":"ContainerDied","Data":"4f73d55d3f0eb7390b4cfdec5e72e4a20c30b5d3b6cdf868a07376dac4cdf798"}
Nov 02 08:45:18.823539 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:18.823436    6210 scope.go:122] "RemoveContainer" containerID="f2e2a0dbbf010ddca7ea48f24a55cd5046af7d9cb75865a13044b531d425f75a"
Nov 02 08:45:18.823832 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:18.823808    6210 scope.go:122] "RemoveContainer" containerID="4f73d55d3f0eb7390b4cfdec5e72e4a20c30b5d3b6cdf868a07376dac4cdf798"
Nov 02 08:45:18.824183 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:45:18.824158    6210 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-ipp-a-9ceb40-29893485-ntwdr_odh-ai-gateway-infra(a4bd30ea-148b-415c-8317-3e10bf064ce6)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-9ceb40-29893485-ntwdr" podUID="a4bd30ea-148b-415c-8317-3e10bf064ce6"
Nov 02 08:45:18.928917 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:18.928865    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-9ceb40-29893485-ntwdr"]
Nov 02 08:45:19.994638 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:19.994612    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-9ceb40-29893485-ntwdr"
Nov 02 08:45:20.153333 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:20.153248    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"]
Nov 02 08:45:20.153525 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:20.153491    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv" podUID="3021609f-3cfc-497f-8619-f292b7902deb" containerName="istio-proxy" containerID="cri-o://77defe2284698c8c0c09f53eca9030930feaf197dd1a064143446b3f9cb266a1" gracePeriod=30
Nov 02 08:45:20.153603 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:20.153557    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a4bd30ea-148b-415c-8317-3e10bf064ce6-kube-api-access-z7mng\" (UniqueName: \"kubernetes.io/projected/a4bd30ea-148b-415c-8317-3e10bf064ce6-kube-api-access-z7mng\") pod \"a4bd30ea-148b-415c-8317-3e10bf064ce6\" (UID: \"a4bd30ea-148b-415c-8317-3e10bf064ce6\") "
Nov 02 08:45:20.153720 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:20.153700    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a4bd30ea-148b-415c-8317-3e10bf064ce6-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4bd30ea-148b-415c-8317-3e10bf064ce6-maas-api-service-ca\") pod \"a4bd30ea-148b-415c-8317-3e10bf064ce6\" (UID: \"a4bd30ea-148b-415c-8317-3e10bf064ce6\") "
Nov 02 08:45:20.155203 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:20.155173    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4bd30ea-148b-415c-8317-3e10bf064ce6-maas-api-service-ca" pod "a4bd30ea-148b-415c-8317-3e10bf064ce6" (UID: "a4bd30ea-148b-415c-8317-3e10bf064ce6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:45:20.163222 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:20.163191    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4bd30ea-148b-415c-8317-3e10bf064ce6-kube-api-access-z7mng" pod "a4bd30ea-148b-415c-8317-3e10bf064ce6" (UID: "a4bd30ea-148b-415c-8317-3e10bf064ce6"). InnerVolumeSpecName "kube-api-access-z7mng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:45:20.277906 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:20.256618    6210 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4bd30ea-148b-415c-8317-3e10bf064ce6-maas-api-service-ca\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:45:20.277906 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:20.256654    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7mng\" (UniqueName: \"kubernetes.io/projected/a4bd30ea-148b-415c-8317-3e10bf064ce6-kube-api-access-z7mng\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:45:20.837833 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:20.837797    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-9ceb40-29893485-ntwdr"
Nov 02 08:45:20.838037 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:20.837802    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-9ceb40-29893485-ntwdr" event={"ID":"a4bd30ea-148b-415c-8317-3e10bf064ce6","Type":"ContainerDied","Data":"85907cfe2d7bb7f0a720e6df5c01fdbb754ae7fa2b2476c9a35ad41d5b3fe847"}
Nov 02 08:45:20.838037 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:20.837939    6210 scope.go:122] "RemoveContainer" containerID="4f73d55d3f0eb7390b4cfdec5e72e4a20c30b5d3b6cdf868a07376dac4cdf798"
Nov 02 08:45:20.990444 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:20.990409    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-9ceb40-29893485-ntwdr"]
Nov 02 08:45:21.036731 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:21.036700    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-9ceb40-29893485-ntwdr"]
Nov 02 08:45:22.351701 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:22.351665    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a4bd30ea-148b-415c-8317-3e10bf064ce6" path="/var/lib/kubelet/pods/a4bd30ea-148b-415c-8317-3e10bf064ce6/volumes"
Nov 02 08:45:24.575572 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:24.575535    6210 patch_prober.go:29] interesting pod/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 08:45:24.576106 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:24.575598    6210 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv" podUID="3021609f-3cfc-497f-8619-f292b7902deb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 08:45:25.421223 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:25.421147    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"
Nov 02 08:45:25.431242 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:25.431218    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3021609f-3cfc-497f-8619-f292b7902deb-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3021609f-3cfc-497f-8619-f292b7902deb-istio-data\") pod \"3021609f-3cfc-497f-8619-f292b7902deb\" (UID: \"3021609f-3cfc-497f-8619-f292b7902deb\") "
Nov 02 08:45:25.431381 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:25.431296    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3021609f-3cfc-497f-8619-f292b7902deb-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3021609f-3cfc-497f-8619-f292b7902deb-istio-podinfo\") pod \"3021609f-3cfc-497f-8619-f292b7902deb\" (UID: \"3021609f-3cfc-497f-8619-f292b7902deb\") "
Nov 02 08:45:25.431381 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:25.431318    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3021609f-3cfc-497f-8619-f292b7902deb-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3021609f-3cfc-497f-8619-f292b7902deb-credential-socket\") pod \"3021609f-3cfc-497f-8619-f292b7902deb\" (UID: \"3021609f-3cfc-497f-8619-f292b7902deb\") "
Nov 02 08:45:25.431381 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:25.431346    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3021609f-3cfc-497f-8619-f292b7902deb-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3021609f-3cfc-497f-8619-f292b7902deb-workload-certs\") pod \"3021609f-3cfc-497f-8619-f292b7902deb\" (UID: \"3021609f-3cfc-497f-8619-f292b7902deb\") "
Nov 02 08:45:25.431381 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:25.431367    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3021609f-3cfc-497f-8619-f292b7902deb-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3021609f-3cfc-497f-8619-f292b7902deb-workload-socket\") pod \"3021609f-3cfc-497f-8619-f292b7902deb\" (UID: \"3021609f-3cfc-497f-8619-f292b7902deb\") "
Nov 02 08:45:25.431545 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:25.431409    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3021609f-3cfc-497f-8619-f292b7902deb-istio-token\" (UniqueName: \"kubernetes.io/projected/3021609f-3cfc-497f-8619-f292b7902deb-istio-token\") pod \"3021609f-3cfc-497f-8619-f292b7902deb\" (UID: \"3021609f-3cfc-497f-8619-f292b7902deb\") "
Nov 02 08:45:25.431545 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:25.431447    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3021609f-3cfc-497f-8619-f292b7902deb-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3021609f-3cfc-497f-8619-f292b7902deb-istio-envoy\") pod \"3021609f-3cfc-497f-8619-f292b7902deb\" (UID: \"3021609f-3cfc-497f-8619-f292b7902deb\") "
Nov 02 08:45:25.431545 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:25.431451    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3021609f-3cfc-497f-8619-f292b7902deb-istio-data" pod "3021609f-3cfc-497f-8619-f292b7902deb" (UID: "3021609f-3cfc-497f-8619-f292b7902deb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:45:25.431545 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:25.431492    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3021609f-3cfc-497f-8619-f292b7902deb-kube-api-access-cr6mp\" (UniqueName: \"kubernetes.io/projected/3021609f-3cfc-497f-8619-f292b7902deb-kube-api-access-cr6mp\") pod \"3021609f-3cfc-497f-8619-f292b7902deb\" (UID: \"3021609f-3cfc-497f-8619-f292b7902deb\") "
Nov 02 08:45:25.431545 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:25.431522    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3021609f-3cfc-497f-8619-f292b7902deb-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3021609f-3cfc-497f-8619-f292b7902deb-istiod-ca-cert\") pod \"3021609f-3cfc-497f-8619-f292b7902deb\" (UID: \"3021609f-3cfc-497f-8619-f292b7902deb\") "
Nov 02 08:45:25.431801 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:25.431641    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3021609f-3cfc-497f-8619-f292b7902deb-workload-certs" pod "3021609f-3cfc-497f-8619-f292b7902deb" (UID: "3021609f-3cfc-497f-8619-f292b7902deb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:45:25.431801 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:25.431675    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3021609f-3cfc-497f-8619-f292b7902deb-credential-socket" pod "3021609f-3cfc-497f-8619-f292b7902deb" (UID: "3021609f-3cfc-497f-8619-f292b7902deb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:45:25.431801 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:25.431725    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3021609f-3cfc-497f-8619-f292b7902deb-workload-socket" pod "3021609f-3cfc-497f-8619-f292b7902deb" (UID: "3021609f-3cfc-497f-8619-f292b7902deb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:45:25.432053 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:25.432013    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3021609f-3cfc-497f-8619-f292b7902deb-istiod-ca-cert" pod "3021609f-3cfc-497f-8619-f292b7902deb" (UID: "3021609f-3cfc-497f-8619-f292b7902deb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:45:25.432302 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:25.432261    6210 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3021609f-3cfc-497f-8619-f292b7902deb-istiod-ca-cert\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:45:25.432302 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:25.432290    6210 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3021609f-3cfc-497f-8619-f292b7902deb-istio-data\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:45:25.432470 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:25.432307    6210 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3021609f-3cfc-497f-8619-f292b7902deb-credential-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:45:25.432470 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:25.432322    6210 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3021609f-3cfc-497f-8619-f292b7902deb-workload-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:45:25.432470 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:25.432337    6210 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3021609f-3cfc-497f-8619-f292b7902deb-workload-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:45:25.433648 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:25.433621    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3021609f-3cfc-497f-8619-f292b7902deb-istio-envoy" pod "3021609f-3cfc-497f-8619-f292b7902deb" (UID: "3021609f-3cfc-497f-8619-f292b7902deb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:45:25.433740 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:25.433691    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3021609f-3cfc-497f-8619-f292b7902deb-istio-token" pod "3021609f-3cfc-497f-8619-f292b7902deb" (UID: "3021609f-3cfc-497f-8619-f292b7902deb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:45:25.434008 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:25.433977    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3021609f-3cfc-497f-8619-f292b7902deb-istio-podinfo" pod "3021609f-3cfc-497f-8619-f292b7902deb" (UID: "3021609f-3cfc-497f-8619-f292b7902deb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 08:45:25.434086 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:25.434009    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3021609f-3cfc-497f-8619-f292b7902deb-kube-api-access-cr6mp" pod "3021609f-3cfc-497f-8619-f292b7902deb" (UID: "3021609f-3cfc-497f-8619-f292b7902deb"). InnerVolumeSpecName "kube-api-access-cr6mp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:45:25.533483 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:25.533451    6210 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3021609f-3cfc-497f-8619-f292b7902deb-istio-token\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:45:25.533483 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:25.533480    6210 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3021609f-3cfc-497f-8619-f292b7902deb-istio-envoy\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:45:25.533705 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:25.533493    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cr6mp\" (UniqueName: \"kubernetes.io/projected/3021609f-3cfc-497f-8619-f292b7902deb-kube-api-access-cr6mp\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:45:25.533705 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:25.533504    6210 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3021609f-3cfc-497f-8619-f292b7902deb-istio-podinfo\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:45:25.875182 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:25.875147    6210 generic.go:356] "Generic (PLEG): container finished" podID="3021609f-3cfc-497f-8619-f292b7902deb" containerID="77defe2284698c8c0c09f53eca9030930feaf197dd1a064143446b3f9cb266a1" exitCode=0
Nov 02 08:45:25.875586 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:25.875190    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"
Nov 02 08:45:25.875586 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:25.875230    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv" event={"ID":"3021609f-3cfc-497f-8619-f292b7902deb","Type":"ContainerDied","Data":"77defe2284698c8c0c09f53eca9030930feaf197dd1a064143446b3f9cb266a1"}
Nov 02 08:45:25.875586 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:25.875285    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv" event={"ID":"3021609f-3cfc-497f-8619-f292b7902deb","Type":"ContainerDied","Data":"d4b14c164a2f2ee72ebcdeb20f762b9a749ab9c6d87af7ac7143077b642d353e"}
Nov 02 08:45:25.875586 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:25.875307    6210 scope.go:122] "RemoveContainer" containerID="77defe2284698c8c0c09f53eca9030930feaf197dd1a064143446b3f9cb266a1"
Nov 02 08:45:25.884830 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:25.884790    6210 scope.go:122] "RemoveContainer" containerID="77defe2284698c8c0c09f53eca9030930feaf197dd1a064143446b3f9cb266a1"
Nov 02 08:45:25.885106 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:45:25.885086    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77defe2284698c8c0c09f53eca9030930feaf197dd1a064143446b3f9cb266a1\": container with ID starting with 77defe2284698c8c0c09f53eca9030930feaf197dd1a064143446b3f9cb266a1 not found: ID does not exist" containerID="77defe2284698c8c0c09f53eca9030930feaf197dd1a064143446b3f9cb266a1"
Nov 02 08:45:25.885152 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:25.885115    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77defe2284698c8c0c09f53eca9030930feaf197dd1a064143446b3f9cb266a1"} err="failed to get container status \"77defe2284698c8c0c09f53eca9030930feaf197dd1a064143446b3f9cb266a1\": rpc error: code = NotFound desc = could not find container \"77defe2284698c8c0c09f53eca9030930feaf197dd1a064143446b3f9cb266a1\": container with ID starting with 77defe2284698c8c0c09f53eca9030930feaf197dd1a064143446b3f9cb266a1 not found: ID does not exist"
Nov 02 08:45:26.029364 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:26.029335    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"]
Nov 02 08:45:26.075417 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:26.075385    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv"]
Nov 02 08:45:26.352172 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:26.352142    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3021609f-3cfc-497f-8619-f292b7902deb" path="/var/lib/kubelet/pods/3021609f-3cfc-497f-8619-f292b7902deb/volumes"
Nov 02 08:45:30.823011 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:45:30.822973    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:45:55.623259 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:55.623225    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"]
Nov 02 08:45:55.623688 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:55.623435    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4" podUID="971a4292-217b-4588-bd75-09f4a5edf852" containerName="istio-proxy" containerID="cri-o://29dc33a18112904fd9f6deca68b0917e671574c0328841f0ff7abb54b0be4855" gracePeriod=30
Nov 02 08:45:58.415910 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:58.415857    6210 patch_prober.go:29] interesting pod/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 08:45:58.416372 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:45:58.415931    6210 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4" podUID="971a4292-217b-4588-bd75-09f4a5edf852" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 08:46:00.828189 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:46:00.828146    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:46:00.869635 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:00.869612    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"
Nov 02 08:46:00.964591 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:00.964557    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/971a4292-217b-4588-bd75-09f4a5edf852-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/971a4292-217b-4588-bd75-09f4a5edf852-workload-certs\") pod \"971a4292-217b-4588-bd75-09f4a5edf852\" (UID: \"971a4292-217b-4588-bd75-09f4a5edf852\") "
Nov 02 08:46:00.964779 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:00.964609    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/971a4292-217b-4588-bd75-09f4a5edf852-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/971a4292-217b-4588-bd75-09f4a5edf852-credential-socket\") pod \"971a4292-217b-4588-bd75-09f4a5edf852\" (UID: \"971a4292-217b-4588-bd75-09f4a5edf852\") "
Nov 02 08:46:00.964779 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:00.964690    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/971a4292-217b-4588-bd75-09f4a5edf852-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/971a4292-217b-4588-bd75-09f4a5edf852-istio-envoy\") pod \"971a4292-217b-4588-bd75-09f4a5edf852\" (UID: \"971a4292-217b-4588-bd75-09f4a5edf852\") "
Nov 02 08:46:00.964779 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:00.964743    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/971a4292-217b-4588-bd75-09f4a5edf852-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/971a4292-217b-4588-bd75-09f4a5edf852-istio-podinfo\") pod \"971a4292-217b-4588-bd75-09f4a5edf852\" (UID: \"971a4292-217b-4588-bd75-09f4a5edf852\") "
Nov 02 08:46:00.965020 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:00.964804    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/971a4292-217b-4588-bd75-09f4a5edf852-istio-token\" (UniqueName: \"kubernetes.io/projected/971a4292-217b-4588-bd75-09f4a5edf852-istio-token\") pod \"971a4292-217b-4588-bd75-09f4a5edf852\" (UID: \"971a4292-217b-4588-bd75-09f4a5edf852\") "
Nov 02 08:46:00.965020 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:00.964806    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/971a4292-217b-4588-bd75-09f4a5edf852-workload-certs" pod "971a4292-217b-4588-bd75-09f4a5edf852" (UID: "971a4292-217b-4588-bd75-09f4a5edf852"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:46:00.965020 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:00.964910    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/971a4292-217b-4588-bd75-09f4a5edf852-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/971a4292-217b-4588-bd75-09f4a5edf852-istio-data\") pod \"971a4292-217b-4588-bd75-09f4a5edf852\" (UID: \"971a4292-217b-4588-bd75-09f4a5edf852\") "
Nov 02 08:46:00.965020 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:00.964939    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/971a4292-217b-4588-bd75-09f4a5edf852-credential-socket" pod "971a4292-217b-4588-bd75-09f4a5edf852" (UID: "971a4292-217b-4588-bd75-09f4a5edf852"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:46:00.965020 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:00.964962    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/971a4292-217b-4588-bd75-09f4a5edf852-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/971a4292-217b-4588-bd75-09f4a5edf852-workload-socket\") pod \"971a4292-217b-4588-bd75-09f4a5edf852\" (UID: \"971a4292-217b-4588-bd75-09f4a5edf852\") "
Nov 02 08:46:00.965020 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:00.964989    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/971a4292-217b-4588-bd75-09f4a5edf852-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/971a4292-217b-4588-bd75-09f4a5edf852-istiod-ca-cert\") pod \"971a4292-217b-4588-bd75-09f4a5edf852\" (UID: \"971a4292-217b-4588-bd75-09f4a5edf852\") "
Nov 02 08:46:00.965341 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:00.965022    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/971a4292-217b-4588-bd75-09f4a5edf852-kube-api-access-dss94\" (UniqueName: \"kubernetes.io/projected/971a4292-217b-4588-bd75-09f4a5edf852-kube-api-access-dss94\") pod \"971a4292-217b-4588-bd75-09f4a5edf852\" (UID: \"971a4292-217b-4588-bd75-09f4a5edf852\") "
Nov 02 08:46:00.965341 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:00.965184    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/971a4292-217b-4588-bd75-09f4a5edf852-istio-data" pod "971a4292-217b-4588-bd75-09f4a5edf852" (UID: "971a4292-217b-4588-bd75-09f4a5edf852"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:46:00.965341 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:00.965263    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/971a4292-217b-4588-bd75-09f4a5edf852-workload-socket" pod "971a4292-217b-4588-bd75-09f4a5edf852" (UID: "971a4292-217b-4588-bd75-09f4a5edf852"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:46:00.965507 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:00.965487    6210 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/971a4292-217b-4588-bd75-09f4a5edf852-workload-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:46:00.965571 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:00.965515    6210 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/971a4292-217b-4588-bd75-09f4a5edf852-workload-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:46:00.965571 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:00.965530    6210 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/971a4292-217b-4588-bd75-09f4a5edf852-credential-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:46:00.965571 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:00.965534    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/971a4292-217b-4588-bd75-09f4a5edf852-istiod-ca-cert" pod "971a4292-217b-4588-bd75-09f4a5edf852" (UID: "971a4292-217b-4588-bd75-09f4a5edf852"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:46:00.965571 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:00.965545    6210 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/971a4292-217b-4588-bd75-09f4a5edf852-istio-data\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:46:00.991048 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:00.990641    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/971a4292-217b-4588-bd75-09f4a5edf852-istio-envoy" pod "971a4292-217b-4588-bd75-09f4a5edf852" (UID: "971a4292-217b-4588-bd75-09f4a5edf852"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:46:00.991048 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:00.990996    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/971a4292-217b-4588-bd75-09f4a5edf852-istio-token" pod "971a4292-217b-4588-bd75-09f4a5edf852" (UID: "971a4292-217b-4588-bd75-09f4a5edf852"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:46:00.991344 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:00.991318    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/971a4292-217b-4588-bd75-09f4a5edf852-istio-podinfo" pod "971a4292-217b-4588-bd75-09f4a5edf852" (UID: "971a4292-217b-4588-bd75-09f4a5edf852"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 08:46:00.991969 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:00.991938    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/971a4292-217b-4588-bd75-09f4a5edf852-kube-api-access-dss94" pod "971a4292-217b-4588-bd75-09f4a5edf852" (UID: "971a4292-217b-4588-bd75-09f4a5edf852"). InnerVolumeSpecName "kube-api-access-dss94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:46:01.066755 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:01.066715    6210 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/971a4292-217b-4588-bd75-09f4a5edf852-istiod-ca-cert\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:46:01.066755 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:01.066753    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dss94\" (UniqueName: \"kubernetes.io/projected/971a4292-217b-4588-bd75-09f4a5edf852-kube-api-access-dss94\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:46:01.067033 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:01.066771    6210 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/971a4292-217b-4588-bd75-09f4a5edf852-istio-envoy\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:46:01.067033 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:01.066786    6210 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/971a4292-217b-4588-bd75-09f4a5edf852-istio-podinfo\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:46:01.067033 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:01.066803    6210 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/971a4292-217b-4588-bd75-09f4a5edf852-istio-token\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:46:01.068928 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:01.068900    6210 generic.go:356] "Generic (PLEG): container finished" podID="971a4292-217b-4588-bd75-09f4a5edf852" containerID="29dc33a18112904fd9f6deca68b0917e671574c0328841f0ff7abb54b0be4855" exitCode=0
Nov 02 08:46:01.069058 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:01.068942    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"
Nov 02 08:46:01.069058 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:01.068951    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4" event={"ID":"971a4292-217b-4588-bd75-09f4a5edf852","Type":"ContainerDied","Data":"29dc33a18112904fd9f6deca68b0917e671574c0328841f0ff7abb54b0be4855"}
Nov 02 08:46:01.069058 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:01.068998    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4" event={"ID":"971a4292-217b-4588-bd75-09f4a5edf852","Type":"ContainerDied","Data":"cfaa71e35ad277400b4dd2148a0e004134e05b476896b4b837287d6cac2eff17"}
Nov 02 08:46:01.069058 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:01.069020    6210 scope.go:122] "RemoveContainer" containerID="29dc33a18112904fd9f6deca68b0917e671574c0328841f0ff7abb54b0be4855"
Nov 02 08:46:01.078698 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:01.078677    6210 scope.go:122] "RemoveContainer" containerID="29dc33a18112904fd9f6deca68b0917e671574c0328841f0ff7abb54b0be4855"
Nov 02 08:46:01.078958 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:46:01.078939    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29dc33a18112904fd9f6deca68b0917e671574c0328841f0ff7abb54b0be4855\": container with ID starting with 29dc33a18112904fd9f6deca68b0917e671574c0328841f0ff7abb54b0be4855 not found: ID does not exist" containerID="29dc33a18112904fd9f6deca68b0917e671574c0328841f0ff7abb54b0be4855"
Nov 02 08:46:01.079023 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:01.078966    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29dc33a18112904fd9f6deca68b0917e671574c0328841f0ff7abb54b0be4855"} err="failed to get container status \"29dc33a18112904fd9f6deca68b0917e671574c0328841f0ff7abb54b0be4855\": rpc error: code = NotFound desc = could not find container \"29dc33a18112904fd9f6deca68b0917e671574c0328841f0ff7abb54b0be4855\": container with ID starting with 29dc33a18112904fd9f6deca68b0917e671574c0328841f0ff7abb54b0be4855 not found: ID does not exist"
Nov 02 08:46:01.225994 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:01.225868    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"]
Nov 02 08:46:01.229830 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:01.229804    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4"]
Nov 02 08:46:02.354102 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:02.354059    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="971a4292-217b-4588-bd75-09f4a5edf852" path="/var/lib/kubelet/pods/971a4292-217b-4588-bd75-09f4a5edf852/volumes"
Nov 02 08:46:19.163173 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:19.163128    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h_0f96589c-cfd5-4685-b45e-f1185121c6bf/payload-processing/0.log"
Nov 02 08:46:19.382204 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:19.382171    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h_0f96589c-cfd5-4685-b45e-f1185121c6bf/payload-processing/0.log"
Nov 02 08:46:30.844122 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:46:30.844085    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:46:31.027364 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:31.027327    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht"]
Nov 02 08:46:31.027561 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:31.027524    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht" podUID="9d80320f-db3b-4f56-bafd-931d7e53fb1d" containerName="payload-processing" containerID="cri-o://eb2446ac87a068b8c246b1e5bfe5d9fbeeb34541246fd25f85d14d7f47fa7a05" gracePeriod=30
Nov 02 08:46:31.225554 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:31.225517    6210 generic.go:356] "Generic (PLEG): container finished" podID="9d80320f-db3b-4f56-bafd-931d7e53fb1d" containerID="eb2446ac87a068b8c246b1e5bfe5d9fbeeb34541246fd25f85d14d7f47fa7a05" exitCode=0
Nov 02 08:46:31.225729 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:31.225564    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht" event={"ID":"9d80320f-db3b-4f56-bafd-931d7e53fb1d","Type":"ContainerDied","Data":"eb2446ac87a068b8c246b1e5bfe5d9fbeeb34541246fd25f85d14d7f47fa7a05"}
Nov 02 08:46:31.303457 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:31.303432    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht"
Nov 02 08:46:31.398078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:31.398050    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9d80320f-db3b-4f56-bafd-931d7e53fb1d-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d80320f-db3b-4f56-bafd-931d7e53fb1d-plugins-config-volume\") pod \"9d80320f-db3b-4f56-bafd-931d7e53fb1d\" (UID: \"9d80320f-db3b-4f56-bafd-931d7e53fb1d\") "
Nov 02 08:46:31.398295 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:31.398135    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9d80320f-db3b-4f56-bafd-931d7e53fb1d-kube-api-access-5hx8z\" (UniqueName: \"kubernetes.io/projected/9d80320f-db3b-4f56-bafd-931d7e53fb1d-kube-api-access-5hx8z\") pod \"9d80320f-db3b-4f56-bafd-931d7e53fb1d\" (UID: \"9d80320f-db3b-4f56-bafd-931d7e53fb1d\") "
Nov 02 08:46:31.398508 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:31.398482    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d80320f-db3b-4f56-bafd-931d7e53fb1d-plugins-config-volume" pod "9d80320f-db3b-4f56-bafd-931d7e53fb1d" (UID: "9d80320f-db3b-4f56-bafd-931d7e53fb1d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:46:31.400276 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:31.400220    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d80320f-db3b-4f56-bafd-931d7e53fb1d-kube-api-access-5hx8z" pod "9d80320f-db3b-4f56-bafd-931d7e53fb1d" (UID: "9d80320f-db3b-4f56-bafd-931d7e53fb1d"). InnerVolumeSpecName "kube-api-access-5hx8z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:46:31.499781 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:31.499745    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hx8z\" (UniqueName: \"kubernetes.io/projected/9d80320f-db3b-4f56-bafd-931d7e53fb1d-kube-api-access-5hx8z\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:46:31.499781 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:31.499776    6210 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d80320f-db3b-4f56-bafd-931d7e53fb1d-plugins-config-volume\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:46:32.239543 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:32.239511    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht"
Nov 02 08:46:32.240058 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:32.239537    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht" event={"ID":"9d80320f-db3b-4f56-bafd-931d7e53fb1d","Type":"ContainerDied","Data":"d943a383d292b5eacfd5f70e36db92f6d969b27e108863d4e09e1d2d04e55949"}
Nov 02 08:46:32.240058 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:32.239622    6210 scope.go:122] "RemoveContainer" containerID="eb2446ac87a068b8c246b1e5bfe5d9fbeeb34541246fd25f85d14d7f47fa7a05"
Nov 02 08:46:32.411706 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:32.411674    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht"]
Nov 02 08:46:32.431184 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:32.431154    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht"]
Nov 02 08:46:34.352202 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:34.352173    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9d80320f-db3b-4f56-bafd-931d7e53fb1d" path="/var/lib/kubelet/pods/9d80320f-db3b-4f56-bafd-931d7e53fb1d/volumes"
Nov 02 08:46:39.480355 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:39.480309    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"]
Nov 02 08:46:39.482131 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:39.481237    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc" podUID="ba783530-7ca4-4b53-95c3-dcbbb6edd53a" containerName="istio-proxy" containerID="cri-o://3fed9145472723d764b044bef1d414bef1d083b82930a375bfec791702252948" gracePeriod=30
Nov 02 08:46:40.346613 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:40.346575    6210 patch_prober.go:29] interesting pod/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 08:46:40.346788 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:40.346651    6210 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc" podUID="ba783530-7ca4-4b53-95c3-dcbbb6edd53a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 08:46:44.742676 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:44.742644    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"
Nov 02 08:46:44.854324 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:44.854229    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-istio-podinfo\") pod \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\" (UID: \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\") "
Nov 02 08:46:44.854324 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:44.854308    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-kube-api-access-nvns8\" (UniqueName: \"kubernetes.io/projected/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-kube-api-access-nvns8\") pod \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\" (UID: \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\") "
Nov 02 08:46:44.854622 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:44.854345    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-istio-token\" (UniqueName: \"kubernetes.io/projected/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-istio-token\") pod \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\" (UID: \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\") "
Nov 02 08:46:44.854622 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:44.854377    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-workload-socket\") pod \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\" (UID: \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\") "
Nov 02 08:46:44.854622 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:44.854405    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-istio-data\") pod \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\" (UID: \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\") "
Nov 02 08:46:44.854622 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:44.854451    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-istiod-ca-cert\") pod \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\" (UID: \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\") "
Nov 02 08:46:44.854622 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:44.854505    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-istio-envoy\") pod \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\" (UID: \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\") "
Nov 02 08:46:44.854622 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:44.854584    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-workload-certs\") pod \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\" (UID: \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\") "
Nov 02 08:46:44.854964 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:44.854654    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-credential-socket\") pod \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\" (UID: \"ba783530-7ca4-4b53-95c3-dcbbb6edd53a\") "
Nov 02 08:46:44.854964 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:44.854835    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-istio-data" pod "ba783530-7ca4-4b53-95c3-dcbbb6edd53a" (UID: "ba783530-7ca4-4b53-95c3-dcbbb6edd53a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:46:44.854964 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:44.854871    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-istiod-ca-cert" pod "ba783530-7ca4-4b53-95c3-dcbbb6edd53a" (UID: "ba783530-7ca4-4b53-95c3-dcbbb6edd53a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:46:44.855180 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:44.855106    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-credential-socket" pod "ba783530-7ca4-4b53-95c3-dcbbb6edd53a" (UID: "ba783530-7ca4-4b53-95c3-dcbbb6edd53a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:46:44.855180 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:44.855117    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-workload-socket" pod "ba783530-7ca4-4b53-95c3-dcbbb6edd53a" (UID: "ba783530-7ca4-4b53-95c3-dcbbb6edd53a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:46:44.855260 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:44.855222    6210 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-credential-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:46:44.855260 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:44.855239    6210 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-workload-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:46:44.855260 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:44.855252    6210 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-istio-data\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:46:44.855357 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:44.855261    6210 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-istiod-ca-cert\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:46:44.855357 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:44.855300    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-workload-certs" pod "ba783530-7ca4-4b53-95c3-dcbbb6edd53a" (UID: "ba783530-7ca4-4b53-95c3-dcbbb6edd53a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:46:44.857185 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:44.857159    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-istio-podinfo" pod "ba783530-7ca4-4b53-95c3-dcbbb6edd53a" (UID: "ba783530-7ca4-4b53-95c3-dcbbb6edd53a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 08:46:44.857185 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:44.857174    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-kube-api-access-nvns8" pod "ba783530-7ca4-4b53-95c3-dcbbb6edd53a" (UID: "ba783530-7ca4-4b53-95c3-dcbbb6edd53a"). InnerVolumeSpecName "kube-api-access-nvns8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:46:44.857343 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:44.857198    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-istio-envoy" pod "ba783530-7ca4-4b53-95c3-dcbbb6edd53a" (UID: "ba783530-7ca4-4b53-95c3-dcbbb6edd53a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:46:44.857343 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:44.857204    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-istio-token" pod "ba783530-7ca4-4b53-95c3-dcbbb6edd53a" (UID: "ba783530-7ca4-4b53-95c3-dcbbb6edd53a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:46:44.956523 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:44.956426    6210 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-workload-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:46:44.956523 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:44.956462    6210 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-istio-podinfo\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:46:44.956523 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:44.956477    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvns8\" (UniqueName: \"kubernetes.io/projected/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-kube-api-access-nvns8\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:46:44.956523 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:44.956492    6210 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-istio-token\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:46:44.956523 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:44.956502    6210 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba783530-7ca4-4b53-95c3-dcbbb6edd53a-istio-envoy\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:46:45.306795 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:45.306757    6210 generic.go:356] "Generic (PLEG): container finished" podID="ba783530-7ca4-4b53-95c3-dcbbb6edd53a" containerID="3fed9145472723d764b044bef1d414bef1d083b82930a375bfec791702252948" exitCode=0
Nov 02 08:46:45.307013 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:45.306813    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"
Nov 02 08:46:45.307013 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:45.306838    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc" event={"ID":"ba783530-7ca4-4b53-95c3-dcbbb6edd53a","Type":"ContainerDied","Data":"3fed9145472723d764b044bef1d414bef1d083b82930a375bfec791702252948"}
Nov 02 08:46:45.307013 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:45.306918    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc" event={"ID":"ba783530-7ca4-4b53-95c3-dcbbb6edd53a","Type":"ContainerDied","Data":"52894317ea09618d9ab9ba987b0b39c8fa173db9f73301231989c8251502d9e4"}
Nov 02 08:46:45.307013 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:45.306943    6210 scope.go:122] "RemoveContainer" containerID="3fed9145472723d764b044bef1d414bef1d083b82930a375bfec791702252948"
Nov 02 08:46:45.317406 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:45.317387    6210 scope.go:122] "RemoveContainer" containerID="3fed9145472723d764b044bef1d414bef1d083b82930a375bfec791702252948"
Nov 02 08:46:45.317673 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:46:45.317655    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fed9145472723d764b044bef1d414bef1d083b82930a375bfec791702252948\": container with ID starting with 3fed9145472723d764b044bef1d414bef1d083b82930a375bfec791702252948 not found: ID does not exist" containerID="3fed9145472723d764b044bef1d414bef1d083b82930a375bfec791702252948"
Nov 02 08:46:45.317722 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:45.317685    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fed9145472723d764b044bef1d414bef1d083b82930a375bfec791702252948"} err="failed to get container status \"3fed9145472723d764b044bef1d414bef1d083b82930a375bfec791702252948\": rpc error: code = NotFound desc = could not find container \"3fed9145472723d764b044bef1d414bef1d083b82930a375bfec791702252948\": container with ID starting with 3fed9145472723d764b044bef1d414bef1d083b82930a375bfec791702252948 not found: ID does not exist"
Nov 02 08:46:45.463345 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:45.463314    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"]
Nov 02 08:46:45.510105 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:45.510074    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc"]
Nov 02 08:46:46.351612 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:46.351579    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ba783530-7ca4-4b53-95c3-dcbbb6edd53a" path="/var/lib/kubelet/pods/ba783530-7ca4-4b53-95c3-dcbbb6edd53a/volumes"
Nov 02 08:46:50.793863 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:50.793829    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q_f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae/extract/0.log"
Nov 02 08:46:50.794356 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:50.793999    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q_f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae/extract/0.log"
Nov 02 08:46:50.808853 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:50.808825    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb77f_3e7ae74c-fcd8-4820-a8b7-769a5fff9f15/ovn-acl-logging/0.log"
Nov 02 08:46:50.809057 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:50.809036    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb77f_3e7ae74c-fcd8-4820-a8b7-769a5fff9f15/ovn-acl-logging/0.log"
Nov 02 08:46:52.229009 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:52.228976    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"]
Nov 02 08:46:52.229464 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:52.229178    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx" podUID="2be3439c-26f2-4042-b5e8-cf0203ed9682" containerName="istio-proxy" containerID="cri-o://73156a6f791759aaf5d98b4139be16e41b8f5b3cc27b016fc3c65002c98ee665" gracePeriod=30
Nov 02 08:46:57.368238 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:57.368198    6210 generic.go:356] "Generic (PLEG): container finished" podID="2be3439c-26f2-4042-b5e8-cf0203ed9682" containerID="73156a6f791759aaf5d98b4139be16e41b8f5b3cc27b016fc3c65002c98ee665" exitCode=0
Nov 02 08:46:57.368580 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:57.368250    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx" event={"ID":"2be3439c-26f2-4042-b5e8-cf0203ed9682","Type":"ContainerDied","Data":"73156a6f791759aaf5d98b4139be16e41b8f5b3cc27b016fc3c65002c98ee665"}
Nov 02 08:46:57.485129 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:57.485103    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"
Nov 02 08:46:57.589596 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:57.589523    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2be3439c-26f2-4042-b5e8-cf0203ed9682-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2be3439c-26f2-4042-b5e8-cf0203ed9682-istio-data\") pod \"2be3439c-26f2-4042-b5e8-cf0203ed9682\" (UID: \"2be3439c-26f2-4042-b5e8-cf0203ed9682\") "
Nov 02 08:46:57.589596 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:57.589589    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2be3439c-26f2-4042-b5e8-cf0203ed9682-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2be3439c-26f2-4042-b5e8-cf0203ed9682-credential-socket\") pod \"2be3439c-26f2-4042-b5e8-cf0203ed9682\" (UID: \"2be3439c-26f2-4042-b5e8-cf0203ed9682\") "
Nov 02 08:46:57.589776 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:57.589633    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2be3439c-26f2-4042-b5e8-cf0203ed9682-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2be3439c-26f2-4042-b5e8-cf0203ed9682-workload-socket\") pod \"2be3439c-26f2-4042-b5e8-cf0203ed9682\" (UID: \"2be3439c-26f2-4042-b5e8-cf0203ed9682\") "
Nov 02 08:46:57.589776 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:57.589685    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2be3439c-26f2-4042-b5e8-cf0203ed9682-kube-api-access-29lxt\" (UniqueName: \"kubernetes.io/projected/2be3439c-26f2-4042-b5e8-cf0203ed9682-kube-api-access-29lxt\") pod \"2be3439c-26f2-4042-b5e8-cf0203ed9682\" (UID: \"2be3439c-26f2-4042-b5e8-cf0203ed9682\") "
Nov 02 08:46:57.589776 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:57.589722    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2be3439c-26f2-4042-b5e8-cf0203ed9682-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2be3439c-26f2-4042-b5e8-cf0203ed9682-istiod-ca-cert\") pod \"2be3439c-26f2-4042-b5e8-cf0203ed9682\" (UID: \"2be3439c-26f2-4042-b5e8-cf0203ed9682\") "
Nov 02 08:46:57.589776 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:57.589749    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2be3439c-26f2-4042-b5e8-cf0203ed9682-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2be3439c-26f2-4042-b5e8-cf0203ed9682-istio-podinfo\") pod \"2be3439c-26f2-4042-b5e8-cf0203ed9682\" (UID: \"2be3439c-26f2-4042-b5e8-cf0203ed9682\") "
Nov 02 08:46:57.590001 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:57.589797    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2be3439c-26f2-4042-b5e8-cf0203ed9682-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2be3439c-26f2-4042-b5e8-cf0203ed9682-workload-certs\") pod \"2be3439c-26f2-4042-b5e8-cf0203ed9682\" (UID: \"2be3439c-26f2-4042-b5e8-cf0203ed9682\") "
Nov 02 08:46:57.590001 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:57.589814    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2be3439c-26f2-4042-b5e8-cf0203ed9682-istio-data" pod "2be3439c-26f2-4042-b5e8-cf0203ed9682" (UID: "2be3439c-26f2-4042-b5e8-cf0203ed9682"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:46:57.590001 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:57.589830    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2be3439c-26f2-4042-b5e8-cf0203ed9682-credential-socket" pod "2be3439c-26f2-4042-b5e8-cf0203ed9682" (UID: "2be3439c-26f2-4042-b5e8-cf0203ed9682"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:46:57.590001 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:57.589940    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2be3439c-26f2-4042-b5e8-cf0203ed9682-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2be3439c-26f2-4042-b5e8-cf0203ed9682-istio-envoy\") pod \"2be3439c-26f2-4042-b5e8-cf0203ed9682\" (UID: \"2be3439c-26f2-4042-b5e8-cf0203ed9682\") "
Nov 02 08:46:57.590001 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:57.589976    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2be3439c-26f2-4042-b5e8-cf0203ed9682-istio-token\" (UniqueName: \"kubernetes.io/projected/2be3439c-26f2-4042-b5e8-cf0203ed9682-istio-token\") pod \"2be3439c-26f2-4042-b5e8-cf0203ed9682\" (UID: \"2be3439c-26f2-4042-b5e8-cf0203ed9682\") "
Nov 02 08:46:57.590269 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:57.589941    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2be3439c-26f2-4042-b5e8-cf0203ed9682-workload-socket" pod "2be3439c-26f2-4042-b5e8-cf0203ed9682" (UID: "2be3439c-26f2-4042-b5e8-cf0203ed9682"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:46:57.590269 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:57.590051    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2be3439c-26f2-4042-b5e8-cf0203ed9682-workload-certs" pod "2be3439c-26f2-4042-b5e8-cf0203ed9682" (UID: "2be3439c-26f2-4042-b5e8-cf0203ed9682"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:46:57.590269 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:57.590143    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2be3439c-26f2-4042-b5e8-cf0203ed9682-istiod-ca-cert" pod "2be3439c-26f2-4042-b5e8-cf0203ed9682" (UID: "2be3439c-26f2-4042-b5e8-cf0203ed9682"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:46:57.590432 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:57.590401    6210 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2be3439c-26f2-4042-b5e8-cf0203ed9682-istiod-ca-cert\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:46:57.590432 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:57.590422    6210 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2be3439c-26f2-4042-b5e8-cf0203ed9682-workload-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:46:57.590541 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:57.590439    6210 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2be3439c-26f2-4042-b5e8-cf0203ed9682-istio-data\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:46:57.590541 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:57.590454    6210 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2be3439c-26f2-4042-b5e8-cf0203ed9682-credential-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:46:57.590541 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:57.590469    6210 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2be3439c-26f2-4042-b5e8-cf0203ed9682-workload-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:46:57.592158 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:57.592131    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2be3439c-26f2-4042-b5e8-cf0203ed9682-istio-podinfo" pod "2be3439c-26f2-4042-b5e8-cf0203ed9682" (UID: "2be3439c-26f2-4042-b5e8-cf0203ed9682"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 08:46:57.592281 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:57.592198    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2be3439c-26f2-4042-b5e8-cf0203ed9682-kube-api-access-29lxt" pod "2be3439c-26f2-4042-b5e8-cf0203ed9682" (UID: "2be3439c-26f2-4042-b5e8-cf0203ed9682"). InnerVolumeSpecName "kube-api-access-29lxt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:46:57.592386 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:57.592369    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2be3439c-26f2-4042-b5e8-cf0203ed9682-istio-token" pod "2be3439c-26f2-4042-b5e8-cf0203ed9682" (UID: "2be3439c-26f2-4042-b5e8-cf0203ed9682"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:46:57.592457 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:57.592443    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2be3439c-26f2-4042-b5e8-cf0203ed9682-istio-envoy" pod "2be3439c-26f2-4042-b5e8-cf0203ed9682" (UID: "2be3439c-26f2-4042-b5e8-cf0203ed9682"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:46:57.691287 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:57.691255    6210 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2be3439c-26f2-4042-b5e8-cf0203ed9682-istio-podinfo\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:46:57.691287 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:57.691282    6210 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2be3439c-26f2-4042-b5e8-cf0203ed9682-istio-envoy\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:46:57.691287 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:57.691291    6210 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2be3439c-26f2-4042-b5e8-cf0203ed9682-istio-token\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:46:57.691520 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:57.691300    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29lxt\" (UniqueName: \"kubernetes.io/projected/2be3439c-26f2-4042-b5e8-cf0203ed9682-kube-api-access-29lxt\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:46:58.374279 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:58.374252    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx" event={"ID":"2be3439c-26f2-4042-b5e8-cf0203ed9682","Type":"ContainerDied","Data":"88a49c3498208e12af85b84d2ed97a959323a0661aaa048e792b38cdf4e67d48"}
Nov 02 08:46:58.374279 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:58.374273    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"
Nov 02 08:46:58.374683 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:58.374315    6210 scope.go:122] "RemoveContainer" containerID="73156a6f791759aaf5d98b4139be16e41b8f5b3cc27b016fc3c65002c98ee665"
Nov 02 08:46:58.573944 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:58.573907    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"]
Nov 02 08:46:58.580756 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:46:58.580732    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx"]
Nov 02 08:47:00.353645 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:47:00.353606    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2be3439c-26f2-4042-b5e8-cf0203ed9682" path="/var/lib/kubelet/pods/2be3439c-26f2-4042-b5e8-cf0203ed9682/volumes"
Nov 02 08:47:00.820369 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:47:00.820336    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:47:30.820442 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:47:30.820404    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:48:00.326366 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:00.326334    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"]
Nov 02 08:48:00.326773 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:00.326578    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w" podUID="be2cc6e9-e7dc-431f-85b1-1552a355d75c" containerName="istio-proxy" containerID="cri-o://621becfb630bf0823494199d9d4381a231d326049f4dac3f85837c24ff30a237" gracePeriod=30
Nov 02 08:48:00.821967 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:48:00.821928    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:48:05.588421 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.588363    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:48:05.648510 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.648481    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be2cc6e9-e7dc-431f-85b1-1552a355d75c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be2cc6e9-e7dc-431f-85b1-1552a355d75c-istio-envoy\") pod \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\" (UID: \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\") "
Nov 02 08:48:05.648666 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.648524    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be2cc6e9-e7dc-431f-85b1-1552a355d75c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be2cc6e9-e7dc-431f-85b1-1552a355d75c-workload-certs\") pod \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\" (UID: \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\") "
Nov 02 08:48:05.648666 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.648559    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be2cc6e9-e7dc-431f-85b1-1552a355d75c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be2cc6e9-e7dc-431f-85b1-1552a355d75c-istio-data\") pod \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\" (UID: \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\") "
Nov 02 08:48:05.648666 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.648602    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/be2cc6e9-e7dc-431f-85b1-1552a355d75c-kube-api-access-8vn9h\" (UniqueName: \"kubernetes.io/projected/be2cc6e9-e7dc-431f-85b1-1552a355d75c-kube-api-access-8vn9h\") pod \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\" (UID: \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\") "
Nov 02 08:48:05.648666 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.648622    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/be2cc6e9-e7dc-431f-85b1-1552a355d75c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be2cc6e9-e7dc-431f-85b1-1552a355d75c-istiod-ca-cert\") pod \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\" (UID: \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\") "
Nov 02 08:48:05.648666 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.648640    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/be2cc6e9-e7dc-431f-85b1-1552a355d75c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be2cc6e9-e7dc-431f-85b1-1552a355d75c-istio-podinfo\") pod \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\" (UID: \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\") "
Nov 02 08:48:05.649035 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.648685    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be2cc6e9-e7dc-431f-85b1-1552a355d75c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be2cc6e9-e7dc-431f-85b1-1552a355d75c-credential-socket\") pod \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\" (UID: \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\") "
Nov 02 08:48:05.649035 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.648728    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be2cc6e9-e7dc-431f-85b1-1552a355d75c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be2cc6e9-e7dc-431f-85b1-1552a355d75c-workload-socket\") pod \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\" (UID: \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\") "
Nov 02 08:48:05.649035 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.648816    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/be2cc6e9-e7dc-431f-85b1-1552a355d75c-istio-token\" (UniqueName: \"kubernetes.io/projected/be2cc6e9-e7dc-431f-85b1-1552a355d75c-istio-token\") pod \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\" (UID: \"be2cc6e9-e7dc-431f-85b1-1552a355d75c\") "
Nov 02 08:48:05.649035 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.648867    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be2cc6e9-e7dc-431f-85b1-1552a355d75c-istio-data" pod "be2cc6e9-e7dc-431f-85b1-1552a355d75c" (UID: "be2cc6e9-e7dc-431f-85b1-1552a355d75c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:48:05.649035 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.648951    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be2cc6e9-e7dc-431f-85b1-1552a355d75c-workload-certs" pod "be2cc6e9-e7dc-431f-85b1-1552a355d75c" (UID: "be2cc6e9-e7dc-431f-85b1-1552a355d75c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:48:05.649285 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.649042    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be2cc6e9-e7dc-431f-85b1-1552a355d75c-credential-socket" pod "be2cc6e9-e7dc-431f-85b1-1552a355d75c" (UID: "be2cc6e9-e7dc-431f-85b1-1552a355d75c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:48:05.649285 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.649109    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be2cc6e9-e7dc-431f-85b1-1552a355d75c-workload-socket" pod "be2cc6e9-e7dc-431f-85b1-1552a355d75c" (UID: "be2cc6e9-e7dc-431f-85b1-1552a355d75c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:48:05.649395 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.649301    6210 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be2cc6e9-e7dc-431f-85b1-1552a355d75c-credential-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:48:05.649395 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.649322    6210 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be2cc6e9-e7dc-431f-85b1-1552a355d75c-workload-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:48:05.649395 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.649339    6210 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be2cc6e9-e7dc-431f-85b1-1552a355d75c-workload-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:48:05.649395 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.649353    6210 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be2cc6e9-e7dc-431f-85b1-1552a355d75c-istio-data\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:48:05.649395 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.649376    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be2cc6e9-e7dc-431f-85b1-1552a355d75c-istiod-ca-cert" pod "be2cc6e9-e7dc-431f-85b1-1552a355d75c" (UID: "be2cc6e9-e7dc-431f-85b1-1552a355d75c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:48:05.650770 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.650745    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be2cc6e9-e7dc-431f-85b1-1552a355d75c-istio-envoy" pod "be2cc6e9-e7dc-431f-85b1-1552a355d75c" (UID: "be2cc6e9-e7dc-431f-85b1-1552a355d75c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:48:05.651004 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.650985    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be2cc6e9-e7dc-431f-85b1-1552a355d75c-kube-api-access-8vn9h" pod "be2cc6e9-e7dc-431f-85b1-1552a355d75c" (UID: "be2cc6e9-e7dc-431f-85b1-1552a355d75c"). InnerVolumeSpecName "kube-api-access-8vn9h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:48:05.651226 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.651201    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be2cc6e9-e7dc-431f-85b1-1552a355d75c-istio-token" pod "be2cc6e9-e7dc-431f-85b1-1552a355d75c" (UID: "be2cc6e9-e7dc-431f-85b1-1552a355d75c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:48:05.651226 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.651206    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/be2cc6e9-e7dc-431f-85b1-1552a355d75c-istio-podinfo" pod "be2cc6e9-e7dc-431f-85b1-1552a355d75c" (UID: "be2cc6e9-e7dc-431f-85b1-1552a355d75c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 08:48:05.709540 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.709501    6210 generic.go:356] "Generic (PLEG): container finished" podID="be2cc6e9-e7dc-431f-85b1-1552a355d75c" containerID="621becfb630bf0823494199d9d4381a231d326049f4dac3f85837c24ff30a237" exitCode=0
Nov 02 08:48:05.709719 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.709555    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"
Nov 02 08:48:05.709719 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.709578    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w" event={"ID":"be2cc6e9-e7dc-431f-85b1-1552a355d75c","Type":"ContainerDied","Data":"621becfb630bf0823494199d9d4381a231d326049f4dac3f85837c24ff30a237"}
Nov 02 08:48:05.709719 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.709637    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w" event={"ID":"be2cc6e9-e7dc-431f-85b1-1552a355d75c","Type":"ContainerDied","Data":"2943eb9db254db8a808ae2533361718ecbcc925bb185a0ada9143d801db4827f"}
Nov 02 08:48:05.709719 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.709661    6210 scope.go:122] "RemoveContainer" containerID="621becfb630bf0823494199d9d4381a231d326049f4dac3f85837c24ff30a237"
Nov 02 08:48:05.723530 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.723509    6210 scope.go:122] "RemoveContainer" containerID="46b8f1d6d41c8838630bc490b583c4f7e8fe94aaf3ed613bca000c6f5d75bc88"
Nov 02 08:48:05.731760 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.731740    6210 scope.go:122] "RemoveContainer" containerID="621becfb630bf0823494199d9d4381a231d326049f4dac3f85837c24ff30a237"
Nov 02 08:48:05.732099 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:48:05.732081    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"621becfb630bf0823494199d9d4381a231d326049f4dac3f85837c24ff30a237\": container with ID starting with 621becfb630bf0823494199d9d4381a231d326049f4dac3f85837c24ff30a237 not found: ID does not exist" containerID="621becfb630bf0823494199d9d4381a231d326049f4dac3f85837c24ff30a237"
Nov 02 08:48:05.732164 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.732110    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"621becfb630bf0823494199d9d4381a231d326049f4dac3f85837c24ff30a237"} err="failed to get container status \"621becfb630bf0823494199d9d4381a231d326049f4dac3f85837c24ff30a237\": rpc error: code = NotFound desc = could not find container \"621becfb630bf0823494199d9d4381a231d326049f4dac3f85837c24ff30a237\": container with ID starting with 621becfb630bf0823494199d9d4381a231d326049f4dac3f85837c24ff30a237 not found: ID does not exist"
Nov 02 08:48:05.732164 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.732130    6210 scope.go:122] "RemoveContainer" containerID="46b8f1d6d41c8838630bc490b583c4f7e8fe94aaf3ed613bca000c6f5d75bc88"
Nov 02 08:48:05.732394 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:48:05.732377    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46b8f1d6d41c8838630bc490b583c4f7e8fe94aaf3ed613bca000c6f5d75bc88\": container with ID starting with 46b8f1d6d41c8838630bc490b583c4f7e8fe94aaf3ed613bca000c6f5d75bc88 not found: ID does not exist" containerID="46b8f1d6d41c8838630bc490b583c4f7e8fe94aaf3ed613bca000c6f5d75bc88"
Nov 02 08:48:05.732445 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.732399    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46b8f1d6d41c8838630bc490b583c4f7e8fe94aaf3ed613bca000c6f5d75bc88"} err="failed to get container status \"46b8f1d6d41c8838630bc490b583c4f7e8fe94aaf3ed613bca000c6f5d75bc88\": rpc error: code = NotFound desc = could not find container \"46b8f1d6d41c8838630bc490b583c4f7e8fe94aaf3ed613bca000c6f5d75bc88\": container with ID starting with 46b8f1d6d41c8838630bc490b583c4f7e8fe94aaf3ed613bca000c6f5d75bc88 not found: ID does not exist"
Nov 02 08:48:05.750816 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.750791    6210 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be2cc6e9-e7dc-431f-85b1-1552a355d75c-istio-token\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:48:05.750945 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.750822    6210 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be2cc6e9-e7dc-431f-85b1-1552a355d75c-istio-envoy\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:48:05.750945 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.750840    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vn9h\" (UniqueName: \"kubernetes.io/projected/be2cc6e9-e7dc-431f-85b1-1552a355d75c-kube-api-access-8vn9h\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:48:05.750945 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.750853    6210 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be2cc6e9-e7dc-431f-85b1-1552a355d75c-istiod-ca-cert\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:48:05.750945 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.750867    6210 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be2cc6e9-e7dc-431f-85b1-1552a355d75c-istio-podinfo\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:48:05.848851 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.848770    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"]
Nov 02 08:48:05.854444 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:05.854417    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w"]
Nov 02 08:48:06.351199 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:06.351165    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="be2cc6e9-e7dc-431f-85b1-1552a355d75c" path="/var/lib/kubelet/pods/be2cc6e9-e7dc-431f-85b1-1552a355d75c/volumes"
Nov 02 08:48:19.566956 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:19.566920    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"]
Nov 02 08:48:19.567423 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:19.567123    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg" podUID="44308bc3-7924-4f67-9207-5e259da60774" containerName="istio-proxy" containerID="cri-o://71b54a3e0aba91f64f53acac5147c3807e16ac7a3c7b9a39103c7e4964848727" gracePeriod=30
Nov 02 08:48:24.802778 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:24.802743    6210 generic.go:356] "Generic (PLEG): container finished" podID="44308bc3-7924-4f67-9207-5e259da60774" containerID="71b54a3e0aba91f64f53acac5147c3807e16ac7a3c7b9a39103c7e4964848727" exitCode=0
Nov 02 08:48:24.803141 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:24.802812    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg" event={"ID":"44308bc3-7924-4f67-9207-5e259da60774","Type":"ContainerDied","Data":"71b54a3e0aba91f64f53acac5147c3807e16ac7a3c7b9a39103c7e4964848727"}
Nov 02 08:48:24.822750 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:24.822727    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"
Nov 02 08:48:24.846290 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:24.846227    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/44308bc3-7924-4f67-9207-5e259da60774-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44308bc3-7924-4f67-9207-5e259da60774-workload-certs\") pod \"44308bc3-7924-4f67-9207-5e259da60774\" (UID: \"44308bc3-7924-4f67-9207-5e259da60774\") "
Nov 02 08:48:24.846290 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:24.846257    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/44308bc3-7924-4f67-9207-5e259da60774-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44308bc3-7924-4f67-9207-5e259da60774-istio-podinfo\") pod \"44308bc3-7924-4f67-9207-5e259da60774\" (UID: \"44308bc3-7924-4f67-9207-5e259da60774\") "
Nov 02 08:48:24.846290 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:24.846281    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/44308bc3-7924-4f67-9207-5e259da60774-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44308bc3-7924-4f67-9207-5e259da60774-credential-socket\") pod \"44308bc3-7924-4f67-9207-5e259da60774\" (UID: \"44308bc3-7924-4f67-9207-5e259da60774\") "
Nov 02 08:48:24.846512 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:24.846329    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/44308bc3-7924-4f67-9207-5e259da60774-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44308bc3-7924-4f67-9207-5e259da60774-workload-socket\") pod \"44308bc3-7924-4f67-9207-5e259da60774\" (UID: \"44308bc3-7924-4f67-9207-5e259da60774\") "
Nov 02 08:48:24.846512 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:24.846360    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/44308bc3-7924-4f67-9207-5e259da60774-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44308bc3-7924-4f67-9207-5e259da60774-istio-envoy\") pod \"44308bc3-7924-4f67-9207-5e259da60774\" (UID: \"44308bc3-7924-4f67-9207-5e259da60774\") "
Nov 02 08:48:24.846512 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:24.846389    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/44308bc3-7924-4f67-9207-5e259da60774-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44308bc3-7924-4f67-9207-5e259da60774-istio-data\") pod \"44308bc3-7924-4f67-9207-5e259da60774\" (UID: \"44308bc3-7924-4f67-9207-5e259da60774\") "
Nov 02 08:48:24.846512 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:24.846437    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/44308bc3-7924-4f67-9207-5e259da60774-kube-api-access-4hwqt\" (UniqueName: \"kubernetes.io/projected/44308bc3-7924-4f67-9207-5e259da60774-kube-api-access-4hwqt\") pod \"44308bc3-7924-4f67-9207-5e259da60774\" (UID: \"44308bc3-7924-4f67-9207-5e259da60774\") "
Nov 02 08:48:24.846512 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:24.846506    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/44308bc3-7924-4f67-9207-5e259da60774-istio-token\" (UniqueName: \"kubernetes.io/projected/44308bc3-7924-4f67-9207-5e259da60774-istio-token\") pod \"44308bc3-7924-4f67-9207-5e259da60774\" (UID: \"44308bc3-7924-4f67-9207-5e259da60774\") "
Nov 02 08:48:24.846775 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:24.846534    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/44308bc3-7924-4f67-9207-5e259da60774-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44308bc3-7924-4f67-9207-5e259da60774-istiod-ca-cert\") pod \"44308bc3-7924-4f67-9207-5e259da60774\" (UID: \"44308bc3-7924-4f67-9207-5e259da60774\") "
Nov 02 08:48:24.846775 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:24.846647    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44308bc3-7924-4f67-9207-5e259da60774-credential-socket" pod "44308bc3-7924-4f67-9207-5e259da60774" (UID: "44308bc3-7924-4f67-9207-5e259da60774"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:48:24.846775 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:24.846673    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44308bc3-7924-4f67-9207-5e259da60774-workload-socket" pod "44308bc3-7924-4f67-9207-5e259da60774" (UID: "44308bc3-7924-4f67-9207-5e259da60774"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:48:24.846953 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:24.846848    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44308bc3-7924-4f67-9207-5e259da60774-istio-data" pod "44308bc3-7924-4f67-9207-5e259da60774" (UID: "44308bc3-7924-4f67-9207-5e259da60774"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:48:24.847006 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:24.846969    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44308bc3-7924-4f67-9207-5e259da60774-istiod-ca-cert" pod "44308bc3-7924-4f67-9207-5e259da60774" (UID: "44308bc3-7924-4f67-9207-5e259da60774"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:48:24.847157 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:24.846571    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44308bc3-7924-4f67-9207-5e259da60774-workload-certs" pod "44308bc3-7924-4f67-9207-5e259da60774" (UID: "44308bc3-7924-4f67-9207-5e259da60774"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:48:24.847367 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:24.847353    6210 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44308bc3-7924-4f67-9207-5e259da60774-credential-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:48:24.847445 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:24.847372    6210 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44308bc3-7924-4f67-9207-5e259da60774-workload-socket\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:48:24.847445 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:24.847386    6210 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44308bc3-7924-4f67-9207-5e259da60774-istio-data\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:48:24.847445 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:24.847399    6210 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44308bc3-7924-4f67-9207-5e259da60774-istiod-ca-cert\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:48:24.847445 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:24.847414    6210 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44308bc3-7924-4f67-9207-5e259da60774-workload-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:48:24.849007 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:24.848980    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44308bc3-7924-4f67-9207-5e259da60774-istio-envoy" pod "44308bc3-7924-4f67-9207-5e259da60774" (UID: "44308bc3-7924-4f67-9207-5e259da60774"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:48:24.849118 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:24.849053    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/44308bc3-7924-4f67-9207-5e259da60774-istio-podinfo" pod "44308bc3-7924-4f67-9207-5e259da60774" (UID: "44308bc3-7924-4f67-9207-5e259da60774"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 08:48:24.849174 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:24.849113    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44308bc3-7924-4f67-9207-5e259da60774-kube-api-access-4hwqt" pod "44308bc3-7924-4f67-9207-5e259da60774" (UID: "44308bc3-7924-4f67-9207-5e259da60774"). InnerVolumeSpecName "kube-api-access-4hwqt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:48:24.849174 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:24.849125    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44308bc3-7924-4f67-9207-5e259da60774-istio-token" pod "44308bc3-7924-4f67-9207-5e259da60774" (UID: "44308bc3-7924-4f67-9207-5e259da60774"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:48:24.948511 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:24.948478    6210 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44308bc3-7924-4f67-9207-5e259da60774-istio-podinfo\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:48:24.948511 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:24.948508    6210 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44308bc3-7924-4f67-9207-5e259da60774-istio-envoy\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:48:24.948701 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:24.948521    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hwqt\" (UniqueName: \"kubernetes.io/projected/44308bc3-7924-4f67-9207-5e259da60774-kube-api-access-4hwqt\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:48:24.948701 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:24.948536    6210 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44308bc3-7924-4f67-9207-5e259da60774-istio-token\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:48:25.810622 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:25.810584    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg" event={"ID":"44308bc3-7924-4f67-9207-5e259da60774","Type":"ContainerDied","Data":"db4c99bd8976894372fb013b59843635d23e4cc4fa412e4406a8f7a76430214a"}
Nov 02 08:48:25.810622 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:25.810624    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"
Nov 02 08:48:25.811153 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:25.810659    6210 scope.go:122] "RemoveContainer" containerID="71b54a3e0aba91f64f53acac5147c3807e16ac7a3c7b9a39103c7e4964848727"
Nov 02 08:48:26.009482 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:26.009446    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"]
Nov 02 08:48:26.055667 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:26.055635    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg"]
Nov 02 08:48:26.356076 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:26.353461    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="44308bc3-7924-4f67-9207-5e259da60774" path="/var/lib/kubelet/pods/44308bc3-7924-4f67-9207-5e259da60774/volumes"
Nov 02 08:48:30.820889 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:48:30.820841    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:48:32.174554 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:32.174514    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk"]
Nov 02 08:48:32.174998 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:32.174760    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk" podUID="54dd037f-2bf4-430d-b52b-2e35a551a9e6" containerName="maas-api" containerID="cri-o://85ff303aa862af8ac4fc771b5333248aa3fed5bef7f188a2029f17e3e4c5b3fa" gracePeriod=30
Nov 02 08:48:32.465316 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:32.465286    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk"
Nov 02 08:48:32.529996 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:32.529965    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/54dd037f-2bf4-430d-b52b-2e35a551a9e6-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54dd037f-2bf4-430d-b52b-2e35a551a9e6-openshift-service-ca\") pod \"54dd037f-2bf4-430d-b52b-2e35a551a9e6\" (UID: \"54dd037f-2bf4-430d-b52b-2e35a551a9e6\") "
Nov 02 08:48:32.530182 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:32.530008    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/54dd037f-2bf4-430d-b52b-2e35a551a9e6-metrics-certs\" (UniqueName: \"kubernetes.io/secret/54dd037f-2bf4-430d-b52b-2e35a551a9e6-metrics-certs\") pod \"54dd037f-2bf4-430d-b52b-2e35a551a9e6\" (UID: \"54dd037f-2bf4-430d-b52b-2e35a551a9e6\") "
Nov 02 08:48:32.530182 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:32.530061    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/54dd037f-2bf4-430d-b52b-2e35a551a9e6-kube-api-access-6h8dn\" (UniqueName: \"kubernetes.io/projected/54dd037f-2bf4-430d-b52b-2e35a551a9e6-kube-api-access-6h8dn\") pod \"54dd037f-2bf4-430d-b52b-2e35a551a9e6\" (UID: \"54dd037f-2bf4-430d-b52b-2e35a551a9e6\") "
Nov 02 08:48:32.530182 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:32.530138    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/54dd037f-2bf4-430d-b52b-2e35a551a9e6-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54dd037f-2bf4-430d-b52b-2e35a551a9e6-maas-api-tls\") pod \"54dd037f-2bf4-430d-b52b-2e35a551a9e6\" (UID: \"54dd037f-2bf4-430d-b52b-2e35a551a9e6\") "
Nov 02 08:48:32.530421 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:32.530393    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54dd037f-2bf4-430d-b52b-2e35a551a9e6-openshift-service-ca" pod "54dd037f-2bf4-430d-b52b-2e35a551a9e6" (UID: "54dd037f-2bf4-430d-b52b-2e35a551a9e6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:48:32.532364 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:32.532324    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54dd037f-2bf4-430d-b52b-2e35a551a9e6-maas-api-tls" pod "54dd037f-2bf4-430d-b52b-2e35a551a9e6" (UID: "54dd037f-2bf4-430d-b52b-2e35a551a9e6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:48:32.532706 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:32.532677    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54dd037f-2bf4-430d-b52b-2e35a551a9e6-kube-api-access-6h8dn" pod "54dd037f-2bf4-430d-b52b-2e35a551a9e6" (UID: "54dd037f-2bf4-430d-b52b-2e35a551a9e6"). InnerVolumeSpecName "kube-api-access-6h8dn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:48:32.532812 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:32.532734    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54dd037f-2bf4-430d-b52b-2e35a551a9e6-metrics-certs" pod "54dd037f-2bf4-430d-b52b-2e35a551a9e6" (UID: "54dd037f-2bf4-430d-b52b-2e35a551a9e6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:48:32.631020 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:32.630992    6210 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54dd037f-2bf4-430d-b52b-2e35a551a9e6-openshift-service-ca\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:48:32.631020 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:32.631018    6210 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54dd037f-2bf4-430d-b52b-2e35a551a9e6-metrics-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:48:32.631211 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:32.631028    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6h8dn\" (UniqueName: \"kubernetes.io/projected/54dd037f-2bf4-430d-b52b-2e35a551a9e6-kube-api-access-6h8dn\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:48:32.631211 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:32.631038    6210 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54dd037f-2bf4-430d-b52b-2e35a551a9e6-maas-api-tls\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:48:32.664802 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:32.664768    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h"]
Nov 02 08:48:32.665019 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:32.664983    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h" podUID="0f96589c-cfd5-4685-b45e-f1185121c6bf" containerName="payload-processing" containerID="cri-o://3d9dbae09d2c0a603075a1b557129099335bae286981d214373f7e079d98c187" gracePeriod=30
Nov 02 08:48:32.718287 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:32.718261    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh"]
Nov 02 08:48:32.856094 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:32.854369    6210 generic.go:356] "Generic (PLEG): container finished" podID="0f96589c-cfd5-4685-b45e-f1185121c6bf" containerID="3d9dbae09d2c0a603075a1b557129099335bae286981d214373f7e079d98c187" exitCode=0
Nov 02 08:48:32.856094 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:32.854484    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h" event={"ID":"0f96589c-cfd5-4685-b45e-f1185121c6bf","Type":"ContainerDied","Data":"3d9dbae09d2c0a603075a1b557129099335bae286981d214373f7e079d98c187"}
Nov 02 08:48:32.857190 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:32.857160    6210 generic.go:356] "Generic (PLEG): container finished" podID="54dd037f-2bf4-430d-b52b-2e35a551a9e6" containerID="85ff303aa862af8ac4fc771b5333248aa3fed5bef7f188a2029f17e3e4c5b3fa" exitCode=0
Nov 02 08:48:32.857550 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:32.857503    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh" podUID="770f6e96-6147-4a79-b71d-4f2f8898a153" containerName="payload-pre-processing" containerID="cri-o://a4696aa8451ae6372fea9bdb1ee8bf2f6025c3d95a4bf3b308769adbf1bcbaa1" gracePeriod=30
Nov 02 08:48:32.857651 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:32.857592    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk"
Nov 02 08:48:32.857706 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:32.857532    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk" event={"ID":"54dd037f-2bf4-430d-b52b-2e35a551a9e6","Type":"ContainerDied","Data":"85ff303aa862af8ac4fc771b5333248aa3fed5bef7f188a2029f17e3e4c5b3fa"}
Nov 02 08:48:32.857761 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:32.857742    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk" event={"ID":"54dd037f-2bf4-430d-b52b-2e35a551a9e6","Type":"ContainerDied","Data":"99703d73c3b2b91933d1c0dd71821198c5d0054eceb3d1b5fc37cf65373a5b27"}
Nov 02 08:48:32.857812 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:32.857779    6210 scope.go:122] "RemoveContainer" containerID="85ff303aa862af8ac4fc771b5333248aa3fed5bef7f188a2029f17e3e4c5b3fa"
Nov 02 08:48:32.872417 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:32.872311    6210 scope.go:122] "RemoveContainer" containerID="85ff303aa862af8ac4fc771b5333248aa3fed5bef7f188a2029f17e3e4c5b3fa"
Nov 02 08:48:32.872683 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:48:32.872662    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85ff303aa862af8ac4fc771b5333248aa3fed5bef7f188a2029f17e3e4c5b3fa\": container with ID starting with 85ff303aa862af8ac4fc771b5333248aa3fed5bef7f188a2029f17e3e4c5b3fa not found: ID does not exist" containerID="85ff303aa862af8ac4fc771b5333248aa3fed5bef7f188a2029f17e3e4c5b3fa"
Nov 02 08:48:32.872761 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:32.872705    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85ff303aa862af8ac4fc771b5333248aa3fed5bef7f188a2029f17e3e4c5b3fa"} err="failed to get container status \"85ff303aa862af8ac4fc771b5333248aa3fed5bef7f188a2029f17e3e4c5b3fa\": rpc error: code = NotFound desc = could not find container \"85ff303aa862af8ac4fc771b5333248aa3fed5bef7f188a2029f17e3e4c5b3fa\": container with ID starting with 85ff303aa862af8ac4fc771b5333248aa3fed5bef7f188a2029f17e3e4c5b3fa not found: ID does not exist"
Nov 02 08:48:32.979291 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:32.979222    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h"
Nov 02 08:48:33.035347 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:33.035307    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0f96589c-cfd5-4685-b45e-f1185121c6bf-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f96589c-cfd5-4685-b45e-f1185121c6bf-plugins-config-volume\") pod \"0f96589c-cfd5-4685-b45e-f1185121c6bf\" (UID: \"0f96589c-cfd5-4685-b45e-f1185121c6bf\") "
Nov 02 08:48:33.035469 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:33.035387    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0f96589c-cfd5-4685-b45e-f1185121c6bf-kube-api-access-tf2mm\" (UniqueName: \"kubernetes.io/projected/0f96589c-cfd5-4685-b45e-f1185121c6bf-kube-api-access-tf2mm\") pod \"0f96589c-cfd5-4685-b45e-f1185121c6bf\" (UID: \"0f96589c-cfd5-4685-b45e-f1185121c6bf\") "
Nov 02 08:48:33.036175 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:33.036144    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f96589c-cfd5-4685-b45e-f1185121c6bf-plugins-config-volume" pod "0f96589c-cfd5-4685-b45e-f1185121c6bf" (UID: "0f96589c-cfd5-4685-b45e-f1185121c6bf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:48:33.039424 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:33.039395    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f96589c-cfd5-4685-b45e-f1185121c6bf-kube-api-access-tf2mm" pod "0f96589c-cfd5-4685-b45e-f1185121c6bf" (UID: "0f96589c-cfd5-4685-b45e-f1185121c6bf"). InnerVolumeSpecName "kube-api-access-tf2mm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:48:33.099441 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:33.099417    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh"
Nov 02 08:48:33.118886 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:33.118858    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk"]
Nov 02 08:48:33.122900 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:33.122850    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d5a5a-7b5c544957-lt9zk"]
Nov 02 08:48:33.136070 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:33.136048    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/770f6e96-6147-4a79-b71d-4f2f8898a153-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/770f6e96-6147-4a79-b71d-4f2f8898a153-plugins-config-volume\") pod \"770f6e96-6147-4a79-b71d-4f2f8898a153\" (UID: \"770f6e96-6147-4a79-b71d-4f2f8898a153\") "
Nov 02 08:48:33.136167 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:33.136108    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/770f6e96-6147-4a79-b71d-4f2f8898a153-kube-api-access-m4h47\" (UniqueName: \"kubernetes.io/projected/770f6e96-6147-4a79-b71d-4f2f8898a153-kube-api-access-m4h47\") pod \"770f6e96-6147-4a79-b71d-4f2f8898a153\" (UID: \"770f6e96-6147-4a79-b71d-4f2f8898a153\") "
Nov 02 08:48:33.136452 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:33.136426    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/770f6e96-6147-4a79-b71d-4f2f8898a153-plugins-config-volume" pod "770f6e96-6147-4a79-b71d-4f2f8898a153" (UID: "770f6e96-6147-4a79-b71d-4f2f8898a153"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:48:33.136547 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:33.136532    6210 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f96589c-cfd5-4685-b45e-f1185121c6bf-plugins-config-volume\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:48:33.136597 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:33.136551    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tf2mm\" (UniqueName: \"kubernetes.io/projected/0f96589c-cfd5-4685-b45e-f1185121c6bf-kube-api-access-tf2mm\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:48:33.136597 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:33.136560    6210 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/770f6e96-6147-4a79-b71d-4f2f8898a153-plugins-config-volume\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:48:33.138056 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:33.138033    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/770f6e96-6147-4a79-b71d-4f2f8898a153-kube-api-access-m4h47" pod "770f6e96-6147-4a79-b71d-4f2f8898a153" (UID: "770f6e96-6147-4a79-b71d-4f2f8898a153"). InnerVolumeSpecName "kube-api-access-m4h47". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:48:33.237414 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:33.237325    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4h47\" (UniqueName: \"kubernetes.io/projected/770f6e96-6147-4a79-b71d-4f2f8898a153-kube-api-access-m4h47\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:48:33.864612 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:33.864580    6210 generic.go:356] "Generic (PLEG): container finished" podID="770f6e96-6147-4a79-b71d-4f2f8898a153" containerID="a4696aa8451ae6372fea9bdb1ee8bf2f6025c3d95a4bf3b308769adbf1bcbaa1" exitCode=0
Nov 02 08:48:33.864827 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:33.864625    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh"
Nov 02 08:48:33.864827 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:33.864670    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh" event={"ID":"770f6e96-6147-4a79-b71d-4f2f8898a153","Type":"ContainerDied","Data":"a4696aa8451ae6372fea9bdb1ee8bf2f6025c3d95a4bf3b308769adbf1bcbaa1"}
Nov 02 08:48:33.864827 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:33.864728    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh" event={"ID":"770f6e96-6147-4a79-b71d-4f2f8898a153","Type":"ContainerDied","Data":"5f2b72d0da4e35f7a8749595dcd9026e283b10845bda4befdf1f4505f0bc499b"}
Nov 02 08:48:33.864827 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:33.864768    6210 scope.go:122] "RemoveContainer" containerID="a4696aa8451ae6372fea9bdb1ee8bf2f6025c3d95a4bf3b308769adbf1bcbaa1"
Nov 02 08:48:33.866062 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:33.865906    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h" event={"ID":"0f96589c-cfd5-4685-b45e-f1185121c6bf","Type":"ContainerDied","Data":"be300fa43b932bfae52dbc32c980f2587745257f65e84f90bd2f48c02739b49e"}
Nov 02 08:48:33.866062 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:33.865935    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h"
Nov 02 08:48:33.873312 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:33.873290    6210 scope.go:122] "RemoveContainer" containerID="a4696aa8451ae6372fea9bdb1ee8bf2f6025c3d95a4bf3b308769adbf1bcbaa1"
Nov 02 08:48:33.873565 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:48:33.873545    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4696aa8451ae6372fea9bdb1ee8bf2f6025c3d95a4bf3b308769adbf1bcbaa1\": container with ID starting with a4696aa8451ae6372fea9bdb1ee8bf2f6025c3d95a4bf3b308769adbf1bcbaa1 not found: ID does not exist" containerID="a4696aa8451ae6372fea9bdb1ee8bf2f6025c3d95a4bf3b308769adbf1bcbaa1"
Nov 02 08:48:33.873647 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:33.873579    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4696aa8451ae6372fea9bdb1ee8bf2f6025c3d95a4bf3b308769adbf1bcbaa1"} err="failed to get container status \"a4696aa8451ae6372fea9bdb1ee8bf2f6025c3d95a4bf3b308769adbf1bcbaa1\": rpc error: code = NotFound desc = could not find container \"a4696aa8451ae6372fea9bdb1ee8bf2f6025c3d95a4bf3b308769adbf1bcbaa1\": container with ID starting with a4696aa8451ae6372fea9bdb1ee8bf2f6025c3d95a4bf3b308769adbf1bcbaa1 not found: ID does not exist"
Nov 02 08:48:33.873647 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:33.873600    6210 scope.go:122] "RemoveContainer" containerID="3d9dbae09d2c0a603075a1b557129099335bae286981d214373f7e079d98c187"
Nov 02 08:48:34.015562 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:34.015534    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h"]
Nov 02 08:48:34.062009 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:34.061969    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h"]
Nov 02 08:48:34.127664 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:34.126053    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh"]
Nov 02 08:48:34.127664 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:34.127211    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh"]
Nov 02 08:48:34.350729 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:34.350698    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0f96589c-cfd5-4685-b45e-f1185121c6bf" path="/var/lib/kubelet/pods/0f96589c-cfd5-4685-b45e-f1185121c6bf/volumes"
Nov 02 08:48:34.351121 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:34.351098    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="54dd037f-2bf4-430d-b52b-2e35a551a9e6" path="/var/lib/kubelet/pods/54dd037f-2bf4-430d-b52b-2e35a551a9e6/volumes"
Nov 02 08:48:34.351447 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:34.351433    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="770f6e96-6147-4a79-b71d-4f2f8898a153" path="/var/lib/kubelet/pods/770f6e96-6147-4a79-b71d-4f2f8898a153/volumes"
Nov 02 08:48:46.585421 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:48:46.585383    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb"]
Nov 02 08:49:00.820773 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:49:00.820731    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:49:01.606086 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:49:01.606036    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb" podUID="aec294ed-60a8-4af4-ba50-faf7cfc61f6e" containerName="main" containerID="cri-o://bbe1eb751a8cf0fbc2fc85961f96b42d591b0d6b0577930c1b95746db00da08c" gracePeriod=45
Nov 02 08:49:01.889695 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:49:01.889665    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb"
Nov 02 08:49:01.920752 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:49:01.920717    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-home\" (UniqueName: \"kubernetes.io/empty-dir/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-home\") pod \"aec294ed-60a8-4af4-ba50-faf7cfc61f6e\" (UID: \"aec294ed-60a8-4af4-ba50-faf7cfc61f6e\") "
Nov 02 08:49:01.920956 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:49:01.920799    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-kube-api-access-q4cqn\" (UniqueName: \"kubernetes.io/projected/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-kube-api-access-q4cqn\") pod \"aec294ed-60a8-4af4-ba50-faf7cfc61f6e\" (UID: \"aec294ed-60a8-4af4-ba50-faf7cfc61f6e\") "
Nov 02 08:49:01.920956 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:49:01.920847    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-tmp-dir\") pod \"aec294ed-60a8-4af4-ba50-faf7cfc61f6e\" (UID: \"aec294ed-60a8-4af4-ba50-faf7cfc61f6e\") "
Nov 02 08:49:01.920956 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:49:01.920904    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-dshm\" (UniqueName: \"kubernetes.io/empty-dir/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-dshm\") pod \"aec294ed-60a8-4af4-ba50-faf7cfc61f6e\" (UID: \"aec294ed-60a8-4af4-ba50-faf7cfc61f6e\") "
Nov 02 08:49:01.920956 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:49:01.920943    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-model-cache\") pod \"aec294ed-60a8-4af4-ba50-faf7cfc61f6e\" (UID: \"aec294ed-60a8-4af4-ba50-faf7cfc61f6e\") "
Nov 02 08:49:01.921187 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:49:01.920987    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-tls-certs\" (UniqueName: \"kubernetes.io/secret/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-tls-certs\") pod \"aec294ed-60a8-4af4-ba50-faf7cfc61f6e\" (UID: \"aec294ed-60a8-4af4-ba50-faf7cfc61f6e\") "
Nov 02 08:49:01.921187 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:49:01.921011    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-home" pod "aec294ed-60a8-4af4-ba50-faf7cfc61f6e" (UID: "aec294ed-60a8-4af4-ba50-faf7cfc61f6e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:49:01.921187 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:49:01.921140    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-tmp-dir" pod "aec294ed-60a8-4af4-ba50-faf7cfc61f6e" (UID: "aec294ed-60a8-4af4-ba50-faf7cfc61f6e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:49:01.921346 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:49:01.921212    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-model-cache" pod "aec294ed-60a8-4af4-ba50-faf7cfc61f6e" (UID: "aec294ed-60a8-4af4-ba50-faf7cfc61f6e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:49:01.921346 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:49:01.921313    6210 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-home\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:49:01.921346 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:49:01.921327    6210 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-tmp-dir\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:49:01.921449 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:49:01.921344    6210 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-model-cache\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:49:01.923113 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:49:01.923078    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-dshm" pod "aec294ed-60a8-4af4-ba50-faf7cfc61f6e" (UID: "aec294ed-60a8-4af4-ba50-faf7cfc61f6e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:49:01.923226 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:49:01.923141    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-tls-certs" pod "aec294ed-60a8-4af4-ba50-faf7cfc61f6e" (UID: "aec294ed-60a8-4af4-ba50-faf7cfc61f6e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:49:01.923226 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:49:01.923144    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-kube-api-access-q4cqn" pod "aec294ed-60a8-4af4-ba50-faf7cfc61f6e" (UID: "aec294ed-60a8-4af4-ba50-faf7cfc61f6e"). InnerVolumeSpecName "kube-api-access-q4cqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:49:02.006861 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:49:02.006820    6210 generic.go:356] "Generic (PLEG): container finished" podID="aec294ed-60a8-4af4-ba50-faf7cfc61f6e" containerID="bbe1eb751a8cf0fbc2fc85961f96b42d591b0d6b0577930c1b95746db00da08c" exitCode=0
Nov 02 08:49:02.007074 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:49:02.006964    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb" event={"ID":"aec294ed-60a8-4af4-ba50-faf7cfc61f6e","Type":"ContainerDied","Data":"bbe1eb751a8cf0fbc2fc85961f96b42d591b0d6b0577930c1b95746db00da08c"}
Nov 02 08:49:02.007074 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:49:02.007009    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb" event={"ID":"aec294ed-60a8-4af4-ba50-faf7cfc61f6e","Type":"ContainerDied","Data":"2ceb9686e422e17afd3bfe4b5e2ff554efdf7fbbd0c8ff92e8a60cad620a6106"}
Nov 02 08:49:02.007074 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:49:02.007031    6210 scope.go:122] "RemoveContainer" containerID="bbe1eb751a8cf0fbc2fc85961f96b42d591b0d6b0577930c1b95746db00da08c"
Nov 02 08:49:02.007242 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:49:02.007198    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb"
Nov 02 08:49:02.019159 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:49:02.019137    6210 scope.go:122] "RemoveContainer" containerID="bbe1eb751a8cf0fbc2fc85961f96b42d591b0d6b0577930c1b95746db00da08c"
Nov 02 08:49:02.019545 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:49:02.019526    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbe1eb751a8cf0fbc2fc85961f96b42d591b0d6b0577930c1b95746db00da08c\": container with ID starting with bbe1eb751a8cf0fbc2fc85961f96b42d591b0d6b0577930c1b95746db00da08c not found: ID does not exist" containerID="bbe1eb751a8cf0fbc2fc85961f96b42d591b0d6b0577930c1b95746db00da08c"
Nov 02 08:49:02.019616 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:49:02.019556    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbe1eb751a8cf0fbc2fc85961f96b42d591b0d6b0577930c1b95746db00da08c"} err="failed to get container status \"bbe1eb751a8cf0fbc2fc85961f96b42d591b0d6b0577930c1b95746db00da08c\": rpc error: code = NotFound desc = could not find container \"bbe1eb751a8cf0fbc2fc85961f96b42d591b0d6b0577930c1b95746db00da08c\": container with ID starting with bbe1eb751a8cf0fbc2fc85961f96b42d591b0d6b0577930c1b95746db00da08c not found: ID does not exist"
Nov 02 08:49:02.022078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:49:02.022058    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4cqn\" (UniqueName: \"kubernetes.io/projected/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-kube-api-access-q4cqn\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:49:02.022156 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:49:02.022079    6210 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-dshm\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:49:02.022156 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:49:02.022090    6210 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aec294ed-60a8-4af4-ba50-faf7cfc61f6e-tls-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:49:02.159405 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:49:02.159323    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb"]
Nov 02 08:49:02.165070 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:49:02.165035    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-096685/distinct-2-w6-096685-kserve-64bb8f7fd8-2lhhb"]
Nov 02 08:49:02.350694 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:49:02.350649    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="aec294ed-60a8-4af4-ba50-faf7cfc61f6e" path="/var/lib/kubelet/pods/aec294ed-60a8-4af4-ba50-faf7cfc61f6e/volumes"
Nov 02 08:49:30.819978 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:49:30.819935    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:50:00.820112 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:50:00.820071    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:50:30.831077 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:50:30.831027    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:50:36.376671 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:36.376640    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g"]
Nov 02 08:50:36.422842 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:36.422808    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264"]
Nov 02 08:50:51.396734 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.396677    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g" podUID="9a8cfb24-093e-43c0-9e72-46f31a9d003a" containerName="main" containerID="cri-o://64e6404e63f8ee109c54ab7f7acd3f4537144c83aa6a882e23fba6f7f830d5ad" gracePeriod=45
Nov 02 08:50:51.442935 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.442895    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264" podUID="5daab9ec-0229-47b7-81aa-c98cc178523b" containerName="main" containerID="cri-o://5c4b17e888edd473d46384dcc2177d125986aa55d7cb170920306c8d5f6eb928" gracePeriod=45
Nov 02 08:50:51.584860 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.584819    6210 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264" podUID="5daab9ec-0229-47b7-81aa-c98cc178523b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.38:8000/ready\": dial tcp 10.134.0.38:8000: connect: connection refused"
Nov 02 08:50:51.681521 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.681490    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g"
Nov 02 08:50:51.696188 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.696168    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9a8cfb24-093e-43c0-9e72-46f31a9d003a-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a8cfb24-093e-43c0-9e72-46f31a9d003a-tmp-dir\") pod \"9a8cfb24-093e-43c0-9e72-46f31a9d003a\" (UID: \"9a8cfb24-093e-43c0-9e72-46f31a9d003a\") "
Nov 02 08:50:51.696299 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.696252    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9a8cfb24-093e-43c0-9e72-46f31a9d003a-home\" (UniqueName: \"kubernetes.io/empty-dir/9a8cfb24-093e-43c0-9e72-46f31a9d003a-home\") pod \"9a8cfb24-093e-43c0-9e72-46f31a9d003a\" (UID: \"9a8cfb24-093e-43c0-9e72-46f31a9d003a\") "
Nov 02 08:50:51.696370 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.696301    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9a8cfb24-093e-43c0-9e72-46f31a9d003a-kube-api-access-chn6q\" (UniqueName: \"kubernetes.io/projected/9a8cfb24-093e-43c0-9e72-46f31a9d003a-kube-api-access-chn6q\") pod \"9a8cfb24-093e-43c0-9e72-46f31a9d003a\" (UID: \"9a8cfb24-093e-43c0-9e72-46f31a9d003a\") "
Nov 02 08:50:51.696370 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.696322    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9a8cfb24-093e-43c0-9e72-46f31a9d003a-dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a8cfb24-093e-43c0-9e72-46f31a9d003a-dshm\") pod \"9a8cfb24-093e-43c0-9e72-46f31a9d003a\" (UID: \"9a8cfb24-093e-43c0-9e72-46f31a9d003a\") "
Nov 02 08:50:51.696493 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.696449    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a8cfb24-093e-43c0-9e72-46f31a9d003a-tmp-dir" pod "9a8cfb24-093e-43c0-9e72-46f31a9d003a" (UID: "9a8cfb24-093e-43c0-9e72-46f31a9d003a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:50:51.696556 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.696525    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a8cfb24-093e-43c0-9e72-46f31a9d003a-home" pod "9a8cfb24-093e-43c0-9e72-46f31a9d003a" (UID: "9a8cfb24-093e-43c0-9e72-46f31a9d003a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:50:51.696613 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.696596    6210 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a8cfb24-093e-43c0-9e72-46f31a9d003a-tmp-dir\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:50:51.698446 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.698416    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a8cfb24-093e-43c0-9e72-46f31a9d003a-kube-api-access-chn6q" pod "9a8cfb24-093e-43c0-9e72-46f31a9d003a" (UID: "9a8cfb24-093e-43c0-9e72-46f31a9d003a"). InnerVolumeSpecName "kube-api-access-chn6q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:50:51.698446 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.698424    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a8cfb24-093e-43c0-9e72-46f31a9d003a-dshm" pod "9a8cfb24-093e-43c0-9e72-46f31a9d003a" (UID: "9a8cfb24-093e-43c0-9e72-46f31a9d003a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:50:51.707811 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.707790    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264"
Nov 02 08:50:51.797056 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.797010    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5daab9ec-0229-47b7-81aa-c98cc178523b-home\" (UniqueName: \"kubernetes.io/empty-dir/5daab9ec-0229-47b7-81aa-c98cc178523b-home\") pod \"5daab9ec-0229-47b7-81aa-c98cc178523b\" (UID: \"5daab9ec-0229-47b7-81aa-c98cc178523b\") "
Nov 02 08:50:51.797257 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.797098    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9a8cfb24-093e-43c0-9e72-46f31a9d003a-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a8cfb24-093e-43c0-9e72-46f31a9d003a-model-cache\") pod \"9a8cfb24-093e-43c0-9e72-46f31a9d003a\" (UID: \"9a8cfb24-093e-43c0-9e72-46f31a9d003a\") "
Nov 02 08:50:51.797257 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.797152    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9a8cfb24-093e-43c0-9e72-46f31a9d003a-tls-certs\" (UniqueName: \"kubernetes.io/secret/9a8cfb24-093e-43c0-9e72-46f31a9d003a-tls-certs\") pod \"9a8cfb24-093e-43c0-9e72-46f31a9d003a\" (UID: \"9a8cfb24-093e-43c0-9e72-46f31a9d003a\") "
Nov 02 08:50:51.797257 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.797194    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5daab9ec-0229-47b7-81aa-c98cc178523b-kube-api-access-ht97z\" (UniqueName: \"kubernetes.io/projected/5daab9ec-0229-47b7-81aa-c98cc178523b-kube-api-access-ht97z\") pod \"5daab9ec-0229-47b7-81aa-c98cc178523b\" (UID: \"5daab9ec-0229-47b7-81aa-c98cc178523b\") "
Nov 02 08:50:51.797415 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.797306    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5daab9ec-0229-47b7-81aa-c98cc178523b-home" pod "5daab9ec-0229-47b7-81aa-c98cc178523b" (UID: "5daab9ec-0229-47b7-81aa-c98cc178523b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:50:51.797698 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.797661    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a8cfb24-093e-43c0-9e72-46f31a9d003a-model-cache" pod "9a8cfb24-093e-43c0-9e72-46f31a9d003a" (UID: "9a8cfb24-093e-43c0-9e72-46f31a9d003a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:50:51.797837 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.797808    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5daab9ec-0229-47b7-81aa-c98cc178523b-model-cache" pod "5daab9ec-0229-47b7-81aa-c98cc178523b" (UID: "5daab9ec-0229-47b7-81aa-c98cc178523b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:50:51.797925 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.797811    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5daab9ec-0229-47b7-81aa-c98cc178523b-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5daab9ec-0229-47b7-81aa-c98cc178523b-model-cache\") pod \"5daab9ec-0229-47b7-81aa-c98cc178523b\" (UID: \"5daab9ec-0229-47b7-81aa-c98cc178523b\") "
Nov 02 08:50:51.797991 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.797970    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5daab9ec-0229-47b7-81aa-c98cc178523b-dshm\" (UniqueName: \"kubernetes.io/empty-dir/5daab9ec-0229-47b7-81aa-c98cc178523b-dshm\") pod \"5daab9ec-0229-47b7-81aa-c98cc178523b\" (UID: \"5daab9ec-0229-47b7-81aa-c98cc178523b\") "
Nov 02 08:50:51.798048 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.798005    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5daab9ec-0229-47b7-81aa-c98cc178523b-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5daab9ec-0229-47b7-81aa-c98cc178523b-tmp-dir\") pod \"5daab9ec-0229-47b7-81aa-c98cc178523b\" (UID: \"5daab9ec-0229-47b7-81aa-c98cc178523b\") "
Nov 02 08:50:51.798100 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.798056    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5daab9ec-0229-47b7-81aa-c98cc178523b-tls-certs\" (UniqueName: \"kubernetes.io/secret/5daab9ec-0229-47b7-81aa-c98cc178523b-tls-certs\") pod \"5daab9ec-0229-47b7-81aa-c98cc178523b\" (UID: \"5daab9ec-0229-47b7-81aa-c98cc178523b\") "
Nov 02 08:50:51.798365 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.798345    6210 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a8cfb24-093e-43c0-9e72-46f31a9d003a-home\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:50:51.799411 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.799392    6210 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5daab9ec-0229-47b7-81aa-c98cc178523b-home\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:50:51.799555 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.799538    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chn6q\" (UniqueName: \"kubernetes.io/projected/9a8cfb24-093e-43c0-9e72-46f31a9d003a-kube-api-access-chn6q\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:50:51.799802 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.799784    6210 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a8cfb24-093e-43c0-9e72-46f31a9d003a-dshm\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:50:51.799953 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.799931    6210 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a8cfb24-093e-43c0-9e72-46f31a9d003a-model-cache\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:50:51.799953 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.799956    6210 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5daab9ec-0229-47b7-81aa-c98cc178523b-model-cache\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:50:51.800138 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.799143    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5daab9ec-0229-47b7-81aa-c98cc178523b-tmp-dir" pod "5daab9ec-0229-47b7-81aa-c98cc178523b" (UID: "5daab9ec-0229-47b7-81aa-c98cc178523b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:50:51.800138 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.799750    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a8cfb24-093e-43c0-9e72-46f31a9d003a-tls-certs" pod "9a8cfb24-093e-43c0-9e72-46f31a9d003a" (UID: "9a8cfb24-093e-43c0-9e72-46f31a9d003a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:50:51.800610 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.800589    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5daab9ec-0229-47b7-81aa-c98cc178523b-tls-certs" pod "5daab9ec-0229-47b7-81aa-c98cc178523b" (UID: "5daab9ec-0229-47b7-81aa-c98cc178523b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:50:51.801282 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.801243    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5daab9ec-0229-47b7-81aa-c98cc178523b-kube-api-access-ht97z" pod "5daab9ec-0229-47b7-81aa-c98cc178523b" (UID: "5daab9ec-0229-47b7-81aa-c98cc178523b"). InnerVolumeSpecName "kube-api-access-ht97z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:50:51.802385 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.802364    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5daab9ec-0229-47b7-81aa-c98cc178523b-dshm" pod "5daab9ec-0229-47b7-81aa-c98cc178523b" (UID: "5daab9ec-0229-47b7-81aa-c98cc178523b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 08:50:51.900643 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.900615    6210 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5daab9ec-0229-47b7-81aa-c98cc178523b-dshm\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:50:51.900643 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.900640    6210 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5daab9ec-0229-47b7-81aa-c98cc178523b-tmp-dir\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:50:51.900643 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.900650    6210 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5daab9ec-0229-47b7-81aa-c98cc178523b-tls-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:50:51.900908 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.900658    6210 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a8cfb24-093e-43c0-9e72-46f31a9d003a-tls-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:50:51.900908 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:51.900668    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ht97z\" (UniqueName: \"kubernetes.io/projected/5daab9ec-0229-47b7-81aa-c98cc178523b-kube-api-access-ht97z\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:50:52.501428 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:52.501393    6210 generic.go:356] "Generic (PLEG): container finished" podID="9a8cfb24-093e-43c0-9e72-46f31a9d003a" containerID="64e6404e63f8ee109c54ab7f7acd3f4537144c83aa6a882e23fba6f7f830d5ad" exitCode=0
Nov 02 08:50:52.501802 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:52.501441    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g"
Nov 02 08:50:52.501802 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:52.501470    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g" event={"ID":"9a8cfb24-093e-43c0-9e72-46f31a9d003a","Type":"ContainerDied","Data":"64e6404e63f8ee109c54ab7f7acd3f4537144c83aa6a882e23fba6f7f830d5ad"}
Nov 02 08:50:52.501802 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:52.501511    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g" event={"ID":"9a8cfb24-093e-43c0-9e72-46f31a9d003a","Type":"ContainerDied","Data":"979b69f0508f9b4dc2173f6bf82401cca2abef03ff28b2e665d1b7ef6ee88221"}
Nov 02 08:50:52.501802 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:52.501527    6210 scope.go:122] "RemoveContainer" containerID="64e6404e63f8ee109c54ab7f7acd3f4537144c83aa6a882e23fba6f7f830d5ad"
Nov 02 08:50:52.503072 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:52.502957    6210 generic.go:356] "Generic (PLEG): container finished" podID="5daab9ec-0229-47b7-81aa-c98cc178523b" containerID="5c4b17e888edd473d46384dcc2177d125986aa55d7cb170920306c8d5f6eb928" exitCode=0
Nov 02 08:50:52.503072 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:52.503000    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264"
Nov 02 08:50:52.503072 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:52.503005    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264" event={"ID":"5daab9ec-0229-47b7-81aa-c98cc178523b","Type":"ContainerDied","Data":"5c4b17e888edd473d46384dcc2177d125986aa55d7cb170920306c8d5f6eb928"}
Nov 02 08:50:52.503072 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:52.503049    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264" event={"ID":"5daab9ec-0229-47b7-81aa-c98cc178523b","Type":"ContainerDied","Data":"f3682afd361b3de93abcbc20ad85a08e2de151fefada621038fe6cf6155456b2"}
Nov 02 08:50:52.510044 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:52.510026    6210 scope.go:122] "RemoveContainer" containerID="64e6404e63f8ee109c54ab7f7acd3f4537144c83aa6a882e23fba6f7f830d5ad"
Nov 02 08:50:52.510282 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:50:52.510264    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64e6404e63f8ee109c54ab7f7acd3f4537144c83aa6a882e23fba6f7f830d5ad\": container with ID starting with 64e6404e63f8ee109c54ab7f7acd3f4537144c83aa6a882e23fba6f7f830d5ad not found: ID does not exist" containerID="64e6404e63f8ee109c54ab7f7acd3f4537144c83aa6a882e23fba6f7f830d5ad"
Nov 02 08:50:52.510337 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:52.510293    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64e6404e63f8ee109c54ab7f7acd3f4537144c83aa6a882e23fba6f7f830d5ad"} err="failed to get container status \"64e6404e63f8ee109c54ab7f7acd3f4537144c83aa6a882e23fba6f7f830d5ad\": rpc error: code = NotFound desc = could not find container \"64e6404e63f8ee109c54ab7f7acd3f4537144c83aa6a882e23fba6f7f830d5ad\": container with ID starting with 64e6404e63f8ee109c54ab7f7acd3f4537144c83aa6a882e23fba6f7f830d5ad not found: ID does not exist"
Nov 02 08:50:52.510337 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:52.510310    6210 scope.go:122] "RemoveContainer" containerID="5c4b17e888edd473d46384dcc2177d125986aa55d7cb170920306c8d5f6eb928"
Nov 02 08:50:52.517607 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:52.517588    6210 scope.go:122] "RemoveContainer" containerID="5c4b17e888edd473d46384dcc2177d125986aa55d7cb170920306c8d5f6eb928"
Nov 02 08:50:52.517850 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:50:52.517833    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c4b17e888edd473d46384dcc2177d125986aa55d7cb170920306c8d5f6eb928\": container with ID starting with 5c4b17e888edd473d46384dcc2177d125986aa55d7cb170920306c8d5f6eb928 not found: ID does not exist" containerID="5c4b17e888edd473d46384dcc2177d125986aa55d7cb170920306c8d5f6eb928"
Nov 02 08:50:52.517973 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:52.517856    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c4b17e888edd473d46384dcc2177d125986aa55d7cb170920306c8d5f6eb928"} err="failed to get container status \"5c4b17e888edd473d46384dcc2177d125986aa55d7cb170920306c8d5f6eb928\": rpc error: code = NotFound desc = could not find container \"5c4b17e888edd473d46384dcc2177d125986aa55d7cb170920306c8d5f6eb928\": container with ID starting with 5c4b17e888edd473d46384dcc2177d125986aa55d7cb170920306c8d5f6eb928 not found: ID does not exist"
Nov 02 08:50:52.654133 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:52.654054    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g"]
Nov 02 08:50:52.700002 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:52.699971    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-d0628e/distinct-w1-d0628e-kserve-6bd8bd95f9-zxk9g"]
Nov 02 08:50:52.801570 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:52.801536    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264"]
Nov 02 08:50:52.807207 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:52.807183    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-d0628e/premium-w1-d0628e-kserve-6cc9594468-2z264"]
Nov 02 08:50:54.350720 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:54.350683    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5daab9ec-0229-47b7-81aa-c98cc178523b" path="/var/lib/kubelet/pods/5daab9ec-0229-47b7-81aa-c98cc178523b/volumes"
Nov 02 08:50:54.351268 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:50:54.351252    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9a8cfb24-093e-43c0-9e72-46f31a9d003a" path="/var/lib/kubelet/pods/9a8cfb24-093e-43c0-9e72-46f31a9d003a/volumes"
Nov 02 08:51:00.820565 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:51:00.820528    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:51:05.910614 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:51:05.910581    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5"]
Nov 02 08:51:05.911080 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:51:05.910795    6210 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5" podUID="e6c2bace-5413-4a8d-84da-34790415a48d" containerName="maas-api" containerID="cri-o://fd581d1687f19a1e4b7400c289690a5fcfb90b622c9ed79bc8e28121ed075362" gracePeriod=30
Nov 02 08:51:06.158575 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:51:06.158545    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5"
Nov 02 08:51:06.242060 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:51:06.242030    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e6c2bace-5413-4a8d-84da-34790415a48d-kube-api-access-ndvzj\" (UniqueName: \"kubernetes.io/projected/e6c2bace-5413-4a8d-84da-34790415a48d-kube-api-access-ndvzj\") pod \"e6c2bace-5413-4a8d-84da-34790415a48d\" (UID: \"e6c2bace-5413-4a8d-84da-34790415a48d\") "
Nov 02 08:51:06.242264 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:51:06.242177    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e6c2bace-5413-4a8d-84da-34790415a48d-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6c2bace-5413-4a8d-84da-34790415a48d-maas-api-tls\") pod \"e6c2bace-5413-4a8d-84da-34790415a48d\" (UID: \"e6c2bace-5413-4a8d-84da-34790415a48d\") "
Nov 02 08:51:06.242264 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:51:06.242202    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e6c2bace-5413-4a8d-84da-34790415a48d-metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6c2bace-5413-4a8d-84da-34790415a48d-metrics-certs\") pod \"e6c2bace-5413-4a8d-84da-34790415a48d\" (UID: \"e6c2bace-5413-4a8d-84da-34790415a48d\") "
Nov 02 08:51:06.242264 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:51:06.242227    6210 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e6c2bace-5413-4a8d-84da-34790415a48d-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6c2bace-5413-4a8d-84da-34790415a48d-openshift-service-ca\") pod \"e6c2bace-5413-4a8d-84da-34790415a48d\" (UID: \"e6c2bace-5413-4a8d-84da-34790415a48d\") "
Nov 02 08:51:06.242623 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:51:06.242596    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6c2bace-5413-4a8d-84da-34790415a48d-openshift-service-ca" pod "e6c2bace-5413-4a8d-84da-34790415a48d" (UID: "e6c2bace-5413-4a8d-84da-34790415a48d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 08:51:06.244283 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:51:06.244249    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6c2bace-5413-4a8d-84da-34790415a48d-maas-api-tls" pod "e6c2bace-5413-4a8d-84da-34790415a48d" (UID: "e6c2bace-5413-4a8d-84da-34790415a48d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:51:06.244378 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:51:06.244282    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6c2bace-5413-4a8d-84da-34790415a48d-metrics-certs" pod "e6c2bace-5413-4a8d-84da-34790415a48d" (UID: "e6c2bace-5413-4a8d-84da-34790415a48d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 08:51:06.244378 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:51:06.244305    6210 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6c2bace-5413-4a8d-84da-34790415a48d-kube-api-access-ndvzj" pod "e6c2bace-5413-4a8d-84da-34790415a48d" (UID: "e6c2bace-5413-4a8d-84da-34790415a48d"). InnerVolumeSpecName "kube-api-access-ndvzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 08:51:06.343118 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:51:06.343085    6210 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6c2bace-5413-4a8d-84da-34790415a48d-maas-api-tls\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:51:06.343118 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:51:06.343112    6210 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6c2bace-5413-4a8d-84da-34790415a48d-metrics-certs\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:51:06.343118 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:51:06.343122    6210 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6c2bace-5413-4a8d-84da-34790415a48d-openshift-service-ca\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:51:06.343347 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:51:06.343133    6210 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndvzj\" (UniqueName: \"kubernetes.io/projected/e6c2bace-5413-4a8d-84da-34790415a48d-kube-api-access-ndvzj\") on node \"ip-10-0-135-235.us-west-2.compute.internal\" DevicePath \"\""
Nov 02 08:51:06.573290 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:51:06.573207    6210 generic.go:356] "Generic (PLEG): container finished" podID="e6c2bace-5413-4a8d-84da-34790415a48d" containerID="fd581d1687f19a1e4b7400c289690a5fcfb90b622c9ed79bc8e28121ed075362" exitCode=0
Nov 02 08:51:06.573290 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:51:06.573254    6210 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5"
Nov 02 08:51:06.573290 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:51:06.573268    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5" event={"ID":"e6c2bace-5413-4a8d-84da-34790415a48d","Type":"ContainerDied","Data":"fd581d1687f19a1e4b7400c289690a5fcfb90b622c9ed79bc8e28121ed075362"}
Nov 02 08:51:06.573550 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:51:06.573313    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5" event={"ID":"e6c2bace-5413-4a8d-84da-34790415a48d","Type":"ContainerDied","Data":"ff087ef29999012d88d07be9a554b2b21f1498c7199b63e5dc548d873a0e0a60"}
Nov 02 08:51:06.573550 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:51:06.573334    6210 scope.go:122] "RemoveContainer" containerID="fd581d1687f19a1e4b7400c289690a5fcfb90b622c9ed79bc8e28121ed075362"
Nov 02 08:51:06.581655 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:51:06.581634    6210 scope.go:122] "RemoveContainer" containerID="fd581d1687f19a1e4b7400c289690a5fcfb90b622c9ed79bc8e28121ed075362"
Nov 02 08:51:06.581935 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:51:06.581916    6210 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd581d1687f19a1e4b7400c289690a5fcfb90b622c9ed79bc8e28121ed075362\": container with ID starting with fd581d1687f19a1e4b7400c289690a5fcfb90b622c9ed79bc8e28121ed075362 not found: ID does not exist" containerID="fd581d1687f19a1e4b7400c289690a5fcfb90b622c9ed79bc8e28121ed075362"
Nov 02 08:51:06.581987 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:51:06.581946    6210 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd581d1687f19a1e4b7400c289690a5fcfb90b622c9ed79bc8e28121ed075362"} err="failed to get container status \"fd581d1687f19a1e4b7400c289690a5fcfb90b622c9ed79bc8e28121ed075362\": rpc error: code = NotFound desc = could not find container \"fd581d1687f19a1e4b7400c289690a5fcfb90b622c9ed79bc8e28121ed075362\": container with ID starting with fd581d1687f19a1e4b7400c289690a5fcfb90b622c9ed79bc8e28121ed075362 not found: ID does not exist"
Nov 02 08:51:06.725652 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:51:06.725617    6210 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5"]
Nov 02 08:51:06.771910 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:51:06.771861    6210 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-d0628e-5f47469975-pddd5"]
Nov 02 08:51:08.350782 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:51:08.350749    6210 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e6c2bace-5413-4a8d-84da-34790415a48d" path="/var/lib/kubelet/pods/e6c2bace-5413-4a8d-84da-34790415a48d/volumes"
Nov 02 08:51:20.774669 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:51:20.774641    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-kwv2h_f2ca511f-24cb-4e9c-9452-0859666a8430/manager/0.log"
Nov 02 08:51:21.015953 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:51:21.015915    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-ndgmq_9336d0b3-ec43-4f01-a843-416f689bcc26/manager/0.log"
Nov 02 08:51:21.301253 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:51:21.301226    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-t4whx_34a9f3d0-66b8-4ee2-af43-6933dfcb20b8/manager/0.log"
Nov 02 08:51:21.751164 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:51:21.751133    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7bb9976d7-w6btv_40c94a5f-3012-4420-806e-3d3fb13fe06f/manager/0.log"
Nov 02 08:51:30.820369 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:51:30.820334    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:51:50.824265 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:51:50.824237    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q_f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae/extract/0.log"
Nov 02 08:51:50.825163 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:51:50.825143    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71rhj8q_f3cb8c6f-b7b8-48c0-ae4c-d8d3123bf2ae/extract/0.log"
Nov 02 08:51:50.837780 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:51:50.837753    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb77f_3e7ae74c-fcd8-4820-a8b7-769a5fff9f15/ovn-acl-logging/0.log"
Nov 02 08:51:50.838437 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:51:50.838418    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb77f_3e7ae74c-fcd8-4820-a8b7-769a5fff9f15/ovn-acl-logging/0.log"
Nov 02 08:52:00.819873 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:52:00.819833    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:52:04.122387 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:04.122352    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-kwv2h_f2ca511f-24cb-4e9c-9452-0859666a8430/manager/0.log"
Nov 02 08:52:04.329234 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:04.329206    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-ndgmq_9336d0b3-ec43-4f01-a843-416f689bcc26/manager/0.log"
Nov 02 08:52:04.589083 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:04.589053    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-t4whx_34a9f3d0-66b8-4ee2-af43-6933dfcb20b8/manager/0.log"
Nov 02 08:52:04.954418 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:04.954303    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7bb9976d7-w6btv_40c94a5f-3012-4420-806e-3d3fb13fe06f/manager/0.log"
Nov 02 08:52:06.615315 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:06.615285    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6c8b96766-xr5jk_9672af25-ccbe-4e4b-9092-36bb77bbc976/maas-api/0.log"
Nov 02 08:52:07.753663 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:07.753622    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-rg4nq_4c1a7e60-dd04-4fd7-a3bf-f7fc7caa3217/postgres/0.log"
Nov 02 08:52:12.403735 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:12.403702    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-hkbfq_7af3db74-1298-45d8-a2bb-d86dd2132610/discovery/0.log"
Nov 02 08:52:12.980714 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:12.980688    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7ddcd68ff8-rjfdr_e6dfdfa3-d7b8-4a15-b2d8-2563c3361756/kube-auth-proxy/0.log"
Nov 02 08:52:13.434239 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:13.434134    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-769df7846c-mjrfr_8ac56a56-b745-46f0-8095-fcf3636a41a0/istio-proxy/0.log"
Nov 02 08:52:13.647781 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:13.647733    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-769df7846c-rs4mw_6cfb49c1-db8b-4764-b8c5-fbdb57d0a5db/istio-proxy/0.log"
Nov 02 08:52:30.819976 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:52:30.819932    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:52:37.235942 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:37.235897    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-w2swh_9a77497b-33c1-4ac2-bfba-58b6edcf871e/global-pull-secret-syncer/0.log"
Nov 02 08:52:40.673754 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:40.673722    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zdsw7_0027996b-31d7-474a-88e9-efc0b6032300/konnectivity-agent/0.log"
Nov 02 08:52:41.065518 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:41.065457    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-235.us-west-2.compute.internal_5efd6818a2d6de09c2e33ba0444837d8/haproxy/0.log"
Nov 02 08:52:47.175760 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.175722    6210 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hgtvq/perf-node-gather-daemonset-2tcht"]
Nov 02 08:52:47.177178 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.177148    6210 cpu_manager.go:414] "containerMap: removing container" podUID="9b59ca11-8aba-4352-9974-50ed7cf4ec0c" containerName="cleanup"
Nov 02 08:52:47.177349 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.177333    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9b59ca11-8aba-4352-9974-50ed7cf4ec0c" containerName="cleanup"
Nov 02 08:52:47.177485 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.177471    6210 cpu_manager.go:414] "containerMap: removing container" podUID="770f6e96-6147-4a79-b71d-4f2f8898a153" containerName="payload-pre-processing"
Nov 02 08:52:47.177594 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.177578    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="770f6e96-6147-4a79-b71d-4f2f8898a153" containerName="payload-pre-processing"
Nov 02 08:52:47.177725 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.177714    6210 cpu_manager.go:414] "containerMap: removing container" podUID="a4bd30ea-148b-415c-8317-3e10bf064ce6" containerName="cleanup"
Nov 02 08:52:47.177807 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.177796    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a4bd30ea-148b-415c-8317-3e10bf064ce6" containerName="cleanup"
Nov 02 08:52:47.177928 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.177915    6210 cpu_manager.go:414] "containerMap: removing container" podUID="e6c2bace-5413-4a8d-84da-34790415a48d" containerName="maas-api"
Nov 02 08:52:47.178027 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.178015    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e6c2bace-5413-4a8d-84da-34790415a48d" containerName="maas-api"
Nov 02 08:52:47.178102 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.178093    6210 cpu_manager.go:414] "containerMap: removing container" podUID="54dd037f-2bf4-430d-b52b-2e35a551a9e6" containerName="maas-api"
Nov 02 08:52:47.178182 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.178172    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="54dd037f-2bf4-430d-b52b-2e35a551a9e6" containerName="maas-api"
Nov 02 08:52:47.178273 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.178264    6210 cpu_manager.go:414] "containerMap: removing container" podUID="a4bd30ea-148b-415c-8317-3e10bf064ce6" containerName="cleanup"
Nov 02 08:52:47.178474 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.178460    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a4bd30ea-148b-415c-8317-3e10bf064ce6" containerName="cleanup"
Nov 02 08:52:47.178580 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.178570    6210 cpu_manager.go:414] "containerMap: removing container" podUID="3d02b15e-21f7-4862-9d45-b83285121f60" containerName="cleanup"
Nov 02 08:52:47.178700 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.178671    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3d02b15e-21f7-4862-9d45-b83285121f60" containerName="cleanup"
Nov 02 08:52:47.178833 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.178820    6210 cpu_manager.go:414] "containerMap: removing container" podUID="ba783530-7ca4-4b53-95c3-dcbbb6edd53a" containerName="istio-proxy"
Nov 02 08:52:47.178961 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.178949    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ba783530-7ca4-4b53-95c3-dcbbb6edd53a" containerName="istio-proxy"
Nov 02 08:52:47.179076 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.179065    6210 cpu_manager.go:414] "containerMap: removing container" podUID="0f96589c-cfd5-4685-b45e-f1185121c6bf" containerName="payload-processing"
Nov 02 08:52:47.179149 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.179139    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0f96589c-cfd5-4685-b45e-f1185121c6bf" containerName="payload-processing"
Nov 02 08:52:47.179229 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.179220    6210 cpu_manager.go:414] "containerMap: removing container" podUID="3021609f-3cfc-497f-8619-f292b7902deb" containerName="istio-proxy"
Nov 02 08:52:47.179302 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.179292    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3021609f-3cfc-497f-8619-f292b7902deb" containerName="istio-proxy"
Nov 02 08:52:47.179383 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.179375    6210 cpu_manager.go:414] "containerMap: removing container" podUID="aec294ed-60a8-4af4-ba50-faf7cfc61f6e" containerName="main"
Nov 02 08:52:47.179457 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.179448    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aec294ed-60a8-4af4-ba50-faf7cfc61f6e" containerName="main"
Nov 02 08:52:47.179540 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.179532    6210 cpu_manager.go:414] "containerMap: removing container" podUID="5daab9ec-0229-47b7-81aa-c98cc178523b" containerName="main"
Nov 02 08:52:47.179609 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.179600    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5daab9ec-0229-47b7-81aa-c98cc178523b" containerName="main"
Nov 02 08:52:47.179692 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.179681    6210 cpu_manager.go:414] "containerMap: removing container" podUID="be2cc6e9-e7dc-431f-85b1-1552a355d75c" containerName="istio-proxy"
Nov 02 08:52:47.179761 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.179751    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="be2cc6e9-e7dc-431f-85b1-1552a355d75c" containerName="istio-proxy"
Nov 02 08:52:47.179827 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.179819    6210 cpu_manager.go:414] "containerMap: removing container" podUID="be2cc6e9-e7dc-431f-85b1-1552a355d75c" containerName="istio-proxy"
Nov 02 08:52:47.179926 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.179913    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="be2cc6e9-e7dc-431f-85b1-1552a355d75c" containerName="istio-proxy"
Nov 02 08:52:47.180339 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.180323    6210 cpu_manager.go:414] "containerMap: removing container" podUID="2be3439c-26f2-4042-b5e8-cf0203ed9682" containerName="istio-proxy"
Nov 02 08:52:47.180441 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.180430    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2be3439c-26f2-4042-b5e8-cf0203ed9682" containerName="istio-proxy"
Nov 02 08:52:47.180534 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.180524    6210 cpu_manager.go:414] "containerMap: removing container" podUID="971a4292-217b-4588-bd75-09f4a5edf852" containerName="istio-proxy"
Nov 02 08:52:47.180603 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.180594    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="971a4292-217b-4588-bd75-09f4a5edf852" containerName="istio-proxy"
Nov 02 08:52:47.180682 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.180673    6210 cpu_manager.go:414] "containerMap: removing container" podUID="9d80320f-db3b-4f56-bafd-931d7e53fb1d" containerName="payload-processing"
Nov 02 08:52:47.180762 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.180752    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9d80320f-db3b-4f56-bafd-931d7e53fb1d" containerName="payload-processing"
Nov 02 08:52:47.180838 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.180829    6210 cpu_manager.go:414] "containerMap: removing container" podUID="9a8cfb24-093e-43c0-9e72-46f31a9d003a" containerName="main"
Nov 02 08:52:47.181027 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.181011    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9a8cfb24-093e-43c0-9e72-46f31a9d003a" containerName="main"
Nov 02 08:52:47.181176 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.181162    6210 cpu_manager.go:414] "containerMap: removing container" podUID="9b59ca11-8aba-4352-9974-50ed7cf4ec0c" containerName="cleanup"
Nov 02 08:52:47.181300 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.181273    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9b59ca11-8aba-4352-9974-50ed7cf4ec0c" containerName="cleanup"
Nov 02 08:52:47.181421 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.181409    6210 cpu_manager.go:414] "containerMap: removing container" podUID="44308bc3-7924-4f67-9207-5e259da60774" containerName="istio-proxy"
Nov 02 08:52:47.181515 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.181504    6210 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="44308bc3-7924-4f67-9207-5e259da60774" containerName="istio-proxy"
Nov 02 08:52:47.181768 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.181754    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="3d02b15e-21f7-4862-9d45-b83285121f60" containerName="cleanup"
Nov 02 08:52:47.181867 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.181857    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="9b59ca11-8aba-4352-9974-50ed7cf4ec0c" containerName="cleanup"
Nov 02 08:52:47.181967 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.181957    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="ba783530-7ca4-4b53-95c3-dcbbb6edd53a" containerName="istio-proxy"
Nov 02 08:52:47.182039 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.182029    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="0f96589c-cfd5-4685-b45e-f1185121c6bf" containerName="payload-processing"
Nov 02 08:52:47.182114 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.182105    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="3021609f-3cfc-497f-8619-f292b7902deb" containerName="istio-proxy"
Nov 02 08:52:47.182185 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.182175    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="aec294ed-60a8-4af4-ba50-faf7cfc61f6e" containerName="main"
Nov 02 08:52:47.182258 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.182249    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="5daab9ec-0229-47b7-81aa-c98cc178523b" containerName="main"
Nov 02 08:52:47.182335 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.182327    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="be2cc6e9-e7dc-431f-85b1-1552a355d75c" containerName="istio-proxy"
Nov 02 08:52:47.182405 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.182395    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="be2cc6e9-e7dc-431f-85b1-1552a355d75c" containerName="istio-proxy"
Nov 02 08:52:47.182475 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.182466    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="a4bd30ea-148b-415c-8317-3e10bf064ce6" containerName="cleanup"
Nov 02 08:52:47.182556 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.182548    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="2be3439c-26f2-4042-b5e8-cf0203ed9682" containerName="istio-proxy"
Nov 02 08:52:47.182623 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.182614    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="971a4292-217b-4588-bd75-09f4a5edf852" containerName="istio-proxy"
Nov 02 08:52:47.182694 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.182685    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="9d80320f-db3b-4f56-bafd-931d7e53fb1d" containerName="payload-processing"
Nov 02 08:52:47.182770 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.182762    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="9a8cfb24-093e-43c0-9e72-46f31a9d003a" containerName="main"
Nov 02 08:52:47.182836 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.182827    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="9b59ca11-8aba-4352-9974-50ed7cf4ec0c" containerName="cleanup"
Nov 02 08:52:47.182927 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.182918    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="44308bc3-7924-4f67-9207-5e259da60774" containerName="istio-proxy"
Nov 02 08:52:47.183010 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.183001    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="3d02b15e-21f7-4862-9d45-b83285121f60" containerName="cleanup"
Nov 02 08:52:47.183078 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.183069    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="770f6e96-6147-4a79-b71d-4f2f8898a153" containerName="payload-pre-processing"
Nov 02 08:52:47.183156 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.183148    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="e6c2bace-5413-4a8d-84da-34790415a48d" containerName="maas-api"
Nov 02 08:52:47.183225 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.183217    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="54dd037f-2bf4-430d-b52b-2e35a551a9e6" containerName="maas-api"
Nov 02 08:52:47.183299 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.183291    6210 memory_manager.go:365] "RemoveStaleState removing state" podUID="a4bd30ea-148b-415c-8317-3e10bf064ce6" containerName="cleanup"
Nov 02 08:52:47.187581 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.187535    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hgtvq/perf-node-gather-daemonset-2tcht"
Nov 02 08:52:47.275867 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.275836    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hgtvq/perf-node-gather-daemonset-2tcht"]
Nov 02 08:52:47.285416 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.285374    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9c4f1fbb-eb8c-4d15-ab0d-3920b9721455-podres\") pod \"perf-node-gather-daemonset-2tcht\" (UID: \"9c4f1fbb-eb8c-4d15-ab0d-3920b9721455\") " pod="openshift-must-gather-hgtvq/perf-node-gather-daemonset-2tcht"
Nov 02 08:52:47.285584 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.285491    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c4f1fbb-eb8c-4d15-ab0d-3920b9721455-lib-modules\") pod \"perf-node-gather-daemonset-2tcht\" (UID: \"9c4f1fbb-eb8c-4d15-ab0d-3920b9721455\") " pod="openshift-must-gather-hgtvq/perf-node-gather-daemonset-2tcht"
Nov 02 08:52:47.285584 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.285526    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bhsz\" (UniqueName: \"kubernetes.io/projected/9c4f1fbb-eb8c-4d15-ab0d-3920b9721455-kube-api-access-5bhsz\") pod \"perf-node-gather-daemonset-2tcht\" (UID: \"9c4f1fbb-eb8c-4d15-ab0d-3920b9721455\") " pod="openshift-must-gather-hgtvq/perf-node-gather-daemonset-2tcht"
Nov 02 08:52:47.285741 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.285719    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c4f1fbb-eb8c-4d15-ab0d-3920b9721455-sys\") pod \"perf-node-gather-daemonset-2tcht\" (UID: \"9c4f1fbb-eb8c-4d15-ab0d-3920b9721455\") " pod="openshift-must-gather-hgtvq/perf-node-gather-daemonset-2tcht"
Nov 02 08:52:47.285778 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.285756    6210 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9c4f1fbb-eb8c-4d15-ab0d-3920b9721455-proc\") pod \"perf-node-gather-daemonset-2tcht\" (UID: \"9c4f1fbb-eb8c-4d15-ab0d-3920b9721455\") " pod="openshift-must-gather-hgtvq/perf-node-gather-daemonset-2tcht"
Nov 02 08:52:47.321145 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.321113    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hgtvq\"/\"kube-root-ca.crt\""
Nov 02 08:52:47.330093 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.330070    6210 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hgtvq\"/\"openshift-service-ca.crt\""
Nov 02 08:52:47.330093 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.330077    6210 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hgtvq\"/\"default-dockercfg-p95c4\""
Nov 02 08:52:47.386684 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.386650    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c4f1fbb-eb8c-4d15-ab0d-3920b9721455-sys\") pod \"perf-node-gather-daemonset-2tcht\" (UID: \"9c4f1fbb-eb8c-4d15-ab0d-3920b9721455\") " pod="openshift-must-gather-hgtvq/perf-node-gather-daemonset-2tcht"
Nov 02 08:52:47.386823 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.386690    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9c4f1fbb-eb8c-4d15-ab0d-3920b9721455-proc\") pod \"perf-node-gather-daemonset-2tcht\" (UID: \"9c4f1fbb-eb8c-4d15-ab0d-3920b9721455\") " pod="openshift-must-gather-hgtvq/perf-node-gather-daemonset-2tcht"
Nov 02 08:52:47.386823 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.386711    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9c4f1fbb-eb8c-4d15-ab0d-3920b9721455-podres\") pod \"perf-node-gather-daemonset-2tcht\" (UID: \"9c4f1fbb-eb8c-4d15-ab0d-3920b9721455\") " pod="openshift-must-gather-hgtvq/perf-node-gather-daemonset-2tcht"
Nov 02 08:52:47.386823 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.386749    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c4f1fbb-eb8c-4d15-ab0d-3920b9721455-lib-modules\") pod \"perf-node-gather-daemonset-2tcht\" (UID: \"9c4f1fbb-eb8c-4d15-ab0d-3920b9721455\") " pod="openshift-must-gather-hgtvq/perf-node-gather-daemonset-2tcht"
Nov 02 08:52:47.386823 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.386777    6210 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bhsz\" (UniqueName: \"kubernetes.io/projected/9c4f1fbb-eb8c-4d15-ab0d-3920b9721455-kube-api-access-5bhsz\") pod \"perf-node-gather-daemonset-2tcht\" (UID: \"9c4f1fbb-eb8c-4d15-ab0d-3920b9721455\") " pod="openshift-must-gather-hgtvq/perf-node-gather-daemonset-2tcht"
Nov 02 08:52:47.386823 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.386796    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c4f1fbb-eb8c-4d15-ab0d-3920b9721455-sys\") pod \"perf-node-gather-daemonset-2tcht\" (UID: \"9c4f1fbb-eb8c-4d15-ab0d-3920b9721455\") " pod="openshift-must-gather-hgtvq/perf-node-gather-daemonset-2tcht"
Nov 02 08:52:47.387028 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.386818    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9c4f1fbb-eb8c-4d15-ab0d-3920b9721455-podres\") pod \"perf-node-gather-daemonset-2tcht\" (UID: \"9c4f1fbb-eb8c-4d15-ab0d-3920b9721455\") " pod="openshift-must-gather-hgtvq/perf-node-gather-daemonset-2tcht"
Nov 02 08:52:47.387028 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.386796    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9c4f1fbb-eb8c-4d15-ab0d-3920b9721455-proc\") pod \"perf-node-gather-daemonset-2tcht\" (UID: \"9c4f1fbb-eb8c-4d15-ab0d-3920b9721455\") " pod="openshift-must-gather-hgtvq/perf-node-gather-daemonset-2tcht"
Nov 02 08:52:47.387028 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.386855    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c4f1fbb-eb8c-4d15-ab0d-3920b9721455-lib-modules\") pod \"perf-node-gather-daemonset-2tcht\" (UID: \"9c4f1fbb-eb8c-4d15-ab0d-3920b9721455\") " pod="openshift-must-gather-hgtvq/perf-node-gather-daemonset-2tcht"
Nov 02 08:52:47.440605 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.440542    6210 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bhsz\" (UniqueName: \"kubernetes.io/projected/9c4f1fbb-eb8c-4d15-ab0d-3920b9721455-kube-api-access-5bhsz\") pod \"perf-node-gather-daemonset-2tcht\" (UID: \"9c4f1fbb-eb8c-4d15-ab0d-3920b9721455\") " pod="openshift-must-gather-hgtvq/perf-node-gather-daemonset-2tcht"
Nov 02 08:52:47.501010 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.500983    6210 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hgtvq/perf-node-gather-daemonset-2tcht"
Nov 02 08:52:47.865640 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:47.865099    6210 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hgtvq/perf-node-gather-daemonset-2tcht"]
Nov 02 08:52:47.869703 ip-10-0-135-235 kubenswrapper[6210]: W1102 08:52:47.869673    6210 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9c4f1fbb_eb8c_4d15_ab0d_3920b9721455.slice/crio-984c640d928672b5d7041f36700d10344caffddb669add320be074f428597ddf WatchSource:0}: Error finding container 984c640d928672b5d7041f36700d10344caffddb669add320be074f428597ddf: Status 404 returned error can't find the container with id 984c640d928672b5d7041f36700d10344caffddb669add320be074f428597ddf
Nov 02 08:52:48.036635 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:48.036606    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hgtvq/perf-node-gather-daemonset-2tcht" event={"ID":"9c4f1fbb-eb8c-4d15-ab0d-3920b9721455","Type":"ContainerStarted","Data":"1da07944fe759fcb8bba3dd6cd8dc60ff4f42095dda87b05012e024d9a5cd56e"}
Nov 02 08:52:48.036768 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:48.036656    6210 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hgtvq/perf-node-gather-daemonset-2tcht" event={"ID":"9c4f1fbb-eb8c-4d15-ab0d-3920b9721455","Type":"ContainerStarted","Data":"984c640d928672b5d7041f36700d10344caffddb669add320be074f428597ddf"}
Nov 02 08:52:48.036768 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:48.036688    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hgtvq/perf-node-gather-daemonset-2tcht"
Nov 02 08:52:48.144498 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:48.144411    6210 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-hgtvq/perf-node-gather-daemonset-2tcht" podStartSLOduration=1.144397453 podStartE2EDuration="1.144397453s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 08:52:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 08:52:48.14337135 +0000 UTC m=+2757.901800082" watchObservedRunningTime="2026-11-02 08:52:48.144397453 +0000 UTC m=+2757.902826185"
Nov 02 08:52:52.105544 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:52.105511    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f29973c2-deb1-457e-b560-2f104b000888/alertmanager/0.log"
Nov 02 08:52:52.519025 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:52.519002    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f29973c2-deb1-457e-b560-2f104b000888/config-reloader/0.log"
Nov 02 08:52:52.929835 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:52.929755    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f29973c2-deb1-457e-b560-2f104b000888/kube-rbac-proxy-web/0.log"
Nov 02 08:52:53.339765 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:53.339738    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f29973c2-deb1-457e-b560-2f104b000888/kube-rbac-proxy/0.log"
Nov 02 08:52:53.752860 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:53.752820    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f29973c2-deb1-457e-b560-2f104b000888/kube-rbac-proxy-metric/0.log"
Nov 02 08:52:54.050987 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:54.050918    6210 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hgtvq/perf-node-gather-daemonset-2tcht"
Nov 02 08:52:54.164685 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:54.164660    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f29973c2-deb1-457e-b560-2f104b000888/prom-label-proxy/0.log"
Nov 02 08:52:54.574981 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:54.574953    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f29973c2-deb1-457e-b560-2f104b000888/init-config-reloader/0.log"
Nov 02 08:52:55.510965 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:55.510931    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-w7d6c_437fc0dd-7f5a-4e18-8252-810aab07ff3c/kube-state-metrics/0.log"
Nov 02 08:52:55.916953 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:55.916869    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-w7d6c_437fc0dd-7f5a-4e18-8252-810aab07ff3c/kube-rbac-proxy-main/0.log"
Nov 02 08:52:56.331486 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:56.331457    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-w7d6c_437fc0dd-7f5a-4e18-8252-810aab07ff3c/kube-rbac-proxy-self/0.log"
Nov 02 08:52:56.746067 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:56.746037    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-669ff9f66c-ch5df_2ed28bb0-f551-4b15-8d8e-04da752a23ec/metrics-server/0.log"
Nov 02 08:52:57.161472 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:57.161403    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-77f4f76594-tnr2r_bff203a8-2155-4ef1-9efd-b1a6d7e1eabe/monitoring-plugin/0.log"
Nov 02 08:52:58.242720 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:58.242689    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-kwv2h_f2ca511f-24cb-4e9c-9452-0859666a8430/manager/0.log"
Nov 02 08:52:58.474807 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:58.474780    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-ndgmq_9336d0b3-ec43-4f01-a843-416f689bcc26/manager/0.log"
Nov 02 08:52:58.851472 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:58.851442    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-t4whx_34a9f3d0-66b8-4ee2-af43-6933dfcb20b8/manager/0.log"
Nov 02 08:52:59.070597 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:52:59.070571    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7bb9976d7-w6btv_40c94a5f-3012-4420-806e-3d3fb13fe06f/manager/0.log"
Nov 02 08:53:00.231910 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:53:00.231859    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z4kx5_f8e6a0b5-f8b9-4d1b-848b-d3517004d495/node-exporter/0.log"
Nov 02 08:53:00.640845 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:53:00.640768    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z4kx5_f8e6a0b5-f8b9-4d1b-848b-d3517004d495/kube-rbac-proxy/0.log"
Nov 02 08:53:00.822263 ip-10-0-135-235 kubenswrapper[6210]: E1102 08:53:00.822224    6210 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9b8f9" containerName="extractor"
Nov 02 08:53:01.049450 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:53:01.049424    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z4kx5_f8e6a0b5-f8b9-4d1b-848b-d3517004d495/init-textfile/0.log"
Nov 02 08:53:01.463310 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:53:01.463286    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-sz4kk_8b58f599-6735-4461-8657-ef5abab78403/kube-rbac-proxy-main/0.log"
Nov 02 08:53:01.873462 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:53:01.873388    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-sz4kk_8b58f599-6735-4461-8657-ef5abab78403/kube-rbac-proxy-self/0.log"
Nov 02 08:53:02.283644 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:53:02.283612    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-sz4kk_8b58f599-6735-4461-8657-ef5abab78403/openshift-state-metrics/0.log"
Nov 02 08:53:04.048601 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:53:04.048561    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-kwv2h_f2ca511f-24cb-4e9c-9452-0859666a8430/manager/0.log"
Nov 02 08:53:04.280336 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:53:04.280302    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-ndgmq_9336d0b3-ec43-4f01-a843-416f689bcc26/manager/0.log"
Nov 02 08:53:04.647564 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:53:04.647533    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-t4whx_34a9f3d0-66b8-4ee2-af43-6933dfcb20b8/manager/0.log"
Nov 02 08:53:04.887055 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:53:04.887023    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7bb9976d7-w6btv_40c94a5f-3012-4420-806e-3d3fb13fe06f/manager/0.log"
Nov 02 08:53:06.818988 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:53:06.818963    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-745f5fc9c7-7z6h5_1aff1f9f-94a9-486f-a807-76b15fb88cfa/telemeter-client/0.log"
Nov 02 08:53:07.229784 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:53:07.229754    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-745f5fc9c7-7z6h5_1aff1f9f-94a9-486f-a807-76b15fb88cfa/reload/0.log"
Nov 02 08:53:07.640239 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:53:07.640178    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-745f5fc9c7-7z6h5_1aff1f9f-94a9-486f-a807-76b15fb88cfa/kube-rbac-proxy/0.log"
Nov 02 08:53:08.060327 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:53:08.060300    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66fd4b7df4-7h5pn_d276266f-fed6-4266-89b3-c57743cc7179/thanos-query/0.log"
Nov 02 08:53:08.469687 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:53:08.469658    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66fd4b7df4-7h5pn_d276266f-fed6-4266-89b3-c57743cc7179/kube-rbac-proxy-web/0.log"
Nov 02 08:53:08.878408 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:53:08.878335    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66fd4b7df4-7h5pn_d276266f-fed6-4266-89b3-c57743cc7179/kube-rbac-proxy/0.log"
Nov 02 08:53:09.288066 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:53:09.288038    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66fd4b7df4-7h5pn_d276266f-fed6-4266-89b3-c57743cc7179/prom-label-proxy/0.log"
Nov 02 08:53:09.697548 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:53:09.697475    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66fd4b7df4-7h5pn_d276266f-fed6-4266-89b3-c57743cc7179/kube-rbac-proxy-rules/0.log"
Nov 02 08:53:10.106918 ip-10-0-135-235 kubenswrapper[6210]: I1102 08:53:10.106865    6210 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66fd4b7df4-7h5pn_d276266f-fed6-4266-89b3-c57743cc7179/kube-rbac-proxy-metrics/0.log"