Aug 04 17:44:36.165404 ip-10-0-141-220 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Aug 04 17:44:36.165419 ip-10-0-141-220 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Aug 04 17:44:36.165429 ip-10-0-141-220 systemd[1]: kubelet.service: Failed with result 'resources'.
Aug 04 17:44:36.165846 ip-10-0-141-220 systemd[1]: Failed to start Kubernetes Kubelet.
Aug 04 17:44:47.566301 ip-10-0-141-220 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Aug 04 17:44:47.566319 ip-10-0-141-220 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 56358a888b354e55a067d46cf68d92ab --
Aug 04 17:46:23.073805 ip-10-0-141-220 systemd[1]: Starting Kubernetes Kubelet...
Aug 04 17:46:23.520186 ip-10-0-141-220 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 17:46:23.520186 ip-10-0-141-220 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Aug 04 17:46:23.520186 ip-10-0-141-220 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 17:46:23.520186 ip-10-0-141-220 kubenswrapper[2571]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Aug 04 17:46:23.520774 ip-10-0-141-220 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 17:46:23.521295 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.521226    2571 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Aug 04 17:46:23.526034 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526017    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 17:46:23.526034 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526032    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 17:46:23.526034 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526037    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 17:46:23.526216 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526042    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 17:46:23.526216 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526046    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 17:46:23.526216 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526050    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 17:46:23.526216 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526057    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 17:46:23.526216 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526063    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 17:46:23.526216 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526067    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 17:46:23.526216 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526071    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 17:46:23.526216 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526076    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 17:46:23.526216 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526080    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 17:46:23.526216 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526084    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 17:46:23.526216 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526088    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 17:46:23.526216 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526092    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 17:46:23.526216 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526095    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 17:46:23.526216 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526104    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 17:46:23.526216 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526109    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 17:46:23.526216 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526113    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 17:46:23.526216 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526117    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 17:46:23.526216 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526120    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 17:46:23.526216 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526124    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 17:46:23.526989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526128    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 17:46:23.526989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526132    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 17:46:23.526989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526137    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 17:46:23.526989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526141    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 17:46:23.526989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526145    2571 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 17:46:23.526989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526150    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 17:46:23.526989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526154    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 17:46:23.526989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526158    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 17:46:23.526989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526162    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 17:46:23.526989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526166    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 17:46:23.526989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526171    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 17:46:23.526989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526175    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 17:46:23.526989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526179    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 17:46:23.526989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526184    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 17:46:23.526989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526189    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 17:46:23.526989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526194    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 17:46:23.526989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526198    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 17:46:23.526989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526202    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 17:46:23.526989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526207    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 17:46:23.526989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526211    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 17:46:23.527488 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526215    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 17:46:23.527488 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526219    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 17:46:23.527488 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526223    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 17:46:23.527488 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526228    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 17:46:23.527488 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526232    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 17:46:23.527488 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526236    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 17:46:23.527488 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526240    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 17:46:23.527488 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526244    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 17:46:23.527488 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526249    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 17:46:23.527488 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526253    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 17:46:23.527488 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526257    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 17:46:23.527488 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526261    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 17:46:23.527488 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526266    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 17:46:23.527488 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526271    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 17:46:23.527488 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526276    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 17:46:23.527488 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526279    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 17:46:23.527488 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526284    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 17:46:23.527488 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526288    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 17:46:23.527488 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526292    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 17:46:23.527488 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526297    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 17:46:23.527989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526301    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 17:46:23.527989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526305    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 17:46:23.527989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526309    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 17:46:23.527989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526313    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 17:46:23.527989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526317    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 17:46:23.527989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526321    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 17:46:23.527989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526326    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 17:46:23.527989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526331    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 17:46:23.527989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526335    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 17:46:23.527989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526341    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 17:46:23.527989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526345    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 17:46:23.527989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526349    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 17:46:23.527989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526354    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 17:46:23.527989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526358    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 17:46:23.527989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526365    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 17:46:23.527989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526371    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 17:46:23.527989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526376    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 17:46:23.527989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526380    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 17:46:23.527989 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526384    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 17:46:23.528456 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526388    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 17:46:23.528456 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526395    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 17:46:23.528456 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526401    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 17:46:23.528456 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526406    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 17:46:23.528456 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526411    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 17:46:23.528456 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526416    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 17:46:23.528456 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526420    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 17:46:23.528456 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526425    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 17:46:23.528456 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526430    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 17:46:23.528456 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526435    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 17:46:23.528456 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526439    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 17:46:23.528456 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526445    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 17:46:23.528456 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526450    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 17:46:23.528456 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526454    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 17:46:23.528456 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526459    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 17:46:23.528456 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526463    2571 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 17:46:23.528456 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526468    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 17:46:23.528456 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.526472    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 17:46:23.528456 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527410    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 17:46:23.528939 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527420    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 17:46:23.528939 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527424    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 17:46:23.528939 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527427    2571 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 17:46:23.528939 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527430    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 17:46:23.528939 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527434    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 17:46:23.528939 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527438    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 17:46:23.528939 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527442    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 17:46:23.528939 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527445    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 17:46:23.528939 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527448    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 17:46:23.528939 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527451    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 17:46:23.528939 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527454    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 17:46:23.528939 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527456    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 17:46:23.528939 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527459    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 17:46:23.528939 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527462    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 17:46:23.528939 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527464    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 17:46:23.528939 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527467    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 17:46:23.528939 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527470    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 17:46:23.528939 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527472    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 17:46:23.528939 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527475    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 17:46:23.529434 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527477    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 17:46:23.529434 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527480    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 17:46:23.529434 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527483    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 17:46:23.529434 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527485    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 17:46:23.529434 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527488    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 17:46:23.529434 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527491    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 17:46:23.529434 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527493    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 17:46:23.529434 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527496    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 17:46:23.529434 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527498    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 17:46:23.529434 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527501    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 17:46:23.529434 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527504    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 17:46:23.529434 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527506    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 17:46:23.529434 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527509    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 17:46:23.529434 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527535    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 17:46:23.529434 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527539    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 17:46:23.529434 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527541    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 17:46:23.529434 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527544    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 17:46:23.529434 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527546    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 17:46:23.529434 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527549    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 17:46:23.529434 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527552    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 17:46:23.529951 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527555    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 17:46:23.529951 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527558    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 17:46:23.529951 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527560    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 17:46:23.529951 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527563    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 17:46:23.529951 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527565    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 17:46:23.529951 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527568    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 17:46:23.529951 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527571    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 17:46:23.529951 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527574    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 17:46:23.529951 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527576    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 17:46:23.529951 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527579    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 17:46:23.529951 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527581    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 17:46:23.529951 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527584    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 17:46:23.529951 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527586    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 17:46:23.529951 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527589    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 17:46:23.529951 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527593    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 17:46:23.529951 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527596    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 17:46:23.529951 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527599    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 17:46:23.529951 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527602    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 17:46:23.529951 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527605    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 17:46:23.529951 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527608    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 17:46:23.530441 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527611    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 17:46:23.530441 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527613    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 17:46:23.530441 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527617    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 17:46:23.530441 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527621    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 17:46:23.530441 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527623    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 17:46:23.530441 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527626    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 17:46:23.530441 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527634    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 17:46:23.530441 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527637    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 17:46:23.530441 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527639    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 17:46:23.530441 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527642    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 17:46:23.530441 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527645    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 17:46:23.530441 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527647    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 17:46:23.530441 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527650    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 17:46:23.530441 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527652    2571 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 17:46:23.530441 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527654    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 17:46:23.530441 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527657    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 17:46:23.530441 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527659    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 17:46:23.530441 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527662    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 17:46:23.530441 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527664    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 17:46:23.530441 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527667    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 17:46:23.530977 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527669    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 17:46:23.530977 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527672    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 17:46:23.530977 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527674    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 17:46:23.530977 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527677    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 17:46:23.530977 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527679    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 17:46:23.530977 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527682    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 17:46:23.530977 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527684    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 17:46:23.530977 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527687    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 17:46:23.530977 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527689    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 17:46:23.530977 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527692    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 17:46:23.530977 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527695    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 17:46:23.530977 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527698    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 17:46:23.530977 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527700    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 17:46:23.530977 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527703    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 17:46:23.530977 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527706    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 17:46:23.530977 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527710    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 17:46:23.530977 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527715    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 17:46:23.530977 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527718    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 17:46:23.530977 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.527721    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 17:46:23.531442 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528080    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 17:46:23.531442 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528085    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 17:46:23.531442 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528087    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 17:46:23.531442 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528090    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 17:46:23.531442 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528093    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 17:46:23.531442 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528096    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 17:46:23.531442 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528099    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 17:46:23.531442 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528101    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 17:46:23.531442 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528104    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 17:46:23.531442 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528107    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 17:46:23.531442 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528109    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 17:46:23.531442 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528112    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 17:46:23.531442 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528115    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 17:46:23.531442 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528117    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 17:46:23.531442 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528122    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 17:46:23.531442 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528125    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 17:46:23.531442 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528128    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 17:46:23.531442 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528130    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 17:46:23.531442 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528133    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 17:46:23.531442 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528135    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 17:46:23.531950 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528138    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 17:46:23.531950 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528141    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 17:46:23.531950 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528143    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 17:46:23.531950 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528145    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 17:46:23.531950 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528148    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 17:46:23.531950 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528151    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 17:46:23.531950 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528154    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 17:46:23.531950 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528157    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 17:46:23.531950 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528160    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 17:46:23.531950 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528163    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 17:46:23.531950 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528165    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 17:46:23.531950 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528168    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 17:46:23.531950 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528171    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 17:46:23.531950 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528173    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 17:46:23.531950 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528176    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 17:46:23.531950 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528179    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 17:46:23.531950 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528181    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 17:46:23.531950 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528183    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 17:46:23.531950 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528186    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 17:46:23.531950 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528188    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 17:46:23.532487 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528191    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 17:46:23.532487 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528193    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 17:46:23.532487 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528196    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 17:46:23.532487 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528198    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 17:46:23.532487 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528202    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 17:46:23.532487 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528205    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 17:46:23.532487 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528208    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 17:46:23.532487 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528210    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 17:46:23.532487 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528213    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 17:46:23.532487 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528215    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 17:46:23.532487 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528218    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 17:46:23.532487 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528220    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 17:46:23.532487 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528223    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 17:46:23.532487 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528226    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 17:46:23.532487 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528228    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 17:46:23.532487 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528231    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 17:46:23.532487 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528233    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 17:46:23.532487 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528236    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 17:46:23.532487 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528238    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 17:46:23.532487 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528241    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 17:46:23.533009 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528244    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 17:46:23.533009 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528247    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 17:46:23.533009 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528249    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 17:46:23.533009 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528252    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 17:46:23.533009 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528254    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 17:46:23.533009 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528264    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 17:46:23.533009 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528267    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 17:46:23.533009 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528270    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 17:46:23.533009 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528272    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 17:46:23.533009 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528275    2571 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 17:46:23.533009 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528278    2571 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 17:46:23.533009 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528280    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 17:46:23.533009 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528283    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 17:46:23.533009 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528285    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 17:46:23.533009 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528287    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 17:46:23.533009 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528290    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 17:46:23.533009 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528293    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 17:46:23.533009 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528295    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 17:46:23.533009 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528298    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 17:46:23.533489 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528300    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 17:46:23.533489 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528303    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 17:46:23.533489 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528305    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 17:46:23.533489 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528308    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 17:46:23.533489 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528311    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 17:46:23.533489 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528314    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 17:46:23.533489 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528317    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 17:46:23.533489 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528319    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 17:46:23.533489 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528322    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 17:46:23.533489 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528324    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 17:46:23.533489 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528327    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 17:46:23.533489 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528330    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 17:46:23.533489 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528332    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 17:46:23.533489 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528335    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 17:46:23.533489 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528338    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 17:46:23.533489 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528341    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 17:46:23.533489 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528345    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 17:46:23.533489 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528348    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 17:46:23.533489 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528351    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 17:46:23.534046 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.528354    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 17:46:23.534046 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528418    2571 flags.go:64] FLAG: --address="0.0.0.0"
Aug 04 17:46:23.534046 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528425    2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Aug 04 17:46:23.534046 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528431    2571 flags.go:64] FLAG: --anonymous-auth="true"
Aug 04 17:46:23.534046 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528435    2571 flags.go:64] FLAG: --application-metrics-count-limit="100"
Aug 04 17:46:23.534046 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528439    2571 flags.go:64] FLAG: --authentication-token-webhook="false"
Aug 04 17:46:23.534046 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528442    2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Aug 04 17:46:23.534046 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528446    2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Aug 04 17:46:23.534046 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528449    2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Aug 04 17:46:23.534046 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528452    2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Aug 04 17:46:23.534046 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528455    2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Aug 04 17:46:23.534046 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528459    2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Aug 04 17:46:23.534046 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528462    2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Aug 04 17:46:23.534046 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528465    2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Aug 04 17:46:23.534046 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528468    2571 flags.go:64] FLAG: --cgroup-root=""
Aug 04 17:46:23.534046 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528471    2571 flags.go:64] FLAG: --cgroups-per-qos="true"
Aug 04 17:46:23.534046 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528474    2571 flags.go:64] FLAG: --client-ca-file=""
Aug 04 17:46:23.534046 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528477    2571 flags.go:64] FLAG: --cloud-provider="external"
Aug 04 17:46:23.534046 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528479    2571 flags.go:64] FLAG: --cluster-dns="[]"
Aug 04 17:46:23.534046 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528483    2571 flags.go:64] FLAG: --cluster-domain=""
Aug 04 17:46:23.534046 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528486    2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Aug 04 17:46:23.534046 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528489    2571 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Aug 04 17:46:23.534046 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528492    2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Aug 04 17:46:23.534046 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528495    2571 flags.go:64] FLAG: --container-log-max-files="5"
Aug 04 17:46:23.534634 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528501    2571 flags.go:64] FLAG: --container-log-max-size="10Mi"
Aug 04 17:46:23.534634 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528504    2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Aug 04 17:46:23.534634 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528510    2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Aug 04 17:46:23.534634 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528513    2571 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Aug 04 17:46:23.534634 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528516    2571 flags.go:64] FLAG: --contention-profiling="false"
Aug 04 17:46:23.534634 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528533    2571 flags.go:64] FLAG: --cpu-cfs-quota="true"
Aug 04 17:46:23.534634 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528536    2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Aug 04 17:46:23.534634 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528539    2571 flags.go:64] FLAG: --cpu-manager-policy="none"
Aug 04 17:46:23.534634 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528542    2571 flags.go:64] FLAG: --cpu-manager-policy-options=""
Aug 04 17:46:23.534634 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528546    2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Aug 04 17:46:23.534634 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528550    2571 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Aug 04 17:46:23.534634 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528553    2571 flags.go:64] FLAG: --enable-debugging-handlers="true"
Aug 04 17:46:23.534634 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528555    2571 flags.go:64] FLAG: --enable-load-reader="false"
Aug 04 17:46:23.534634 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528558    2571 flags.go:64] FLAG: --enable-server="true"
Aug 04 17:46:23.534634 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528561    2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Aug 04 17:46:23.534634 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528566    2571 flags.go:64] FLAG: --event-burst="100"
Aug 04 17:46:23.534634 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528569    2571 flags.go:64] FLAG: --event-qps="50"
Aug 04 17:46:23.534634 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528572    2571 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Aug 04 17:46:23.534634 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528574    2571 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Aug 04 17:46:23.534634 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528577    2571 flags.go:64] FLAG: --eviction-hard=""
Aug 04 17:46:23.534634 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528581    2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Aug 04 17:46:23.534634 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528584    2571 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Aug 04 17:46:23.534634 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528587    2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Aug 04 17:46:23.534634 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528590    2571 flags.go:64] FLAG: --eviction-soft=""
Aug 04 17:46:23.534634 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528593    2571 flags.go:64] FLAG: --eviction-soft-grace-period=""
Aug 04 17:46:23.535247 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528596    2571 flags.go:64] FLAG: --exit-on-lock-contention="false"
Aug 04 17:46:23.535247 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528599    2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Aug 04 17:46:23.535247 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528602    2571 flags.go:64] FLAG: --experimental-mounter-path=""
Aug 04 17:46:23.535247 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528605    2571 flags.go:64] FLAG: --fail-cgroupv1="false"
Aug 04 17:46:23.535247 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528607    2571 flags.go:64] FLAG: --fail-swap-on="true"
Aug 04 17:46:23.535247 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528610    2571 flags.go:64] FLAG: --feature-gates=""
Aug 04 17:46:23.535247 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528614    2571 flags.go:64] FLAG: --file-check-frequency="20s"
Aug 04 17:46:23.535247 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528618    2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Aug 04 17:46:23.535247 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528621    2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Aug 04 17:46:23.535247 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528625    2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Aug 04 17:46:23.535247 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528628    2571 flags.go:64] FLAG: --healthz-port="10248"
Aug 04 17:46:23.535247 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528631    2571 flags.go:64] FLAG: --help="false"
Aug 04 17:46:23.535247 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528634    2571 flags.go:64] FLAG: --hostname-override="ip-10-0-141-220.ec2.internal"
Aug 04 17:46:23.535247 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528637    2571 flags.go:64] FLAG: --housekeeping-interval="10s"
Aug 04 17:46:23.535247 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528640    2571 flags.go:64] FLAG: --http-check-frequency="20s"
Aug 04 17:46:23.535247 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528643    2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Aug 04 17:46:23.535247 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528646    2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Aug 04 17:46:23.535247 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528650    2571 flags.go:64] FLAG: --image-gc-high-threshold="85"
Aug 04 17:46:23.535247 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528653    2571 flags.go:64] FLAG: --image-gc-low-threshold="80"
Aug 04 17:46:23.535247 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528656    2571 flags.go:64] FLAG: --image-service-endpoint=""
Aug 04 17:46:23.535247 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528659    2571 flags.go:64] FLAG: --kernel-memcg-notification="false"
Aug 04 17:46:23.535247 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528662    2571 flags.go:64] FLAG: --kube-api-burst="100"
Aug 04 17:46:23.535247 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528665    2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Aug 04 17:46:23.535865 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528668    2571 flags.go:64] FLAG: --kube-api-qps="50"
Aug 04 17:46:23.535865 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528670    2571 flags.go:64] FLAG: --kube-reserved=""
Aug 04 17:46:23.535865 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528673    2571 flags.go:64] FLAG: --kube-reserved-cgroup=""
Aug 04 17:46:23.535865 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528676    2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Aug 04 17:46:23.535865 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528679    2571 flags.go:64] FLAG: --kubelet-cgroups=""
Aug 04 17:46:23.535865 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528681    2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Aug 04 17:46:23.535865 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528685    2571 flags.go:64] FLAG: --lock-file=""
Aug 04 17:46:23.535865 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528687    2571 flags.go:64] FLAG: --log-cadvisor-usage="false"
Aug 04 17:46:23.535865 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528690    2571 flags.go:64] FLAG: --log-flush-frequency="5s"
Aug 04 17:46:23.535865 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528693    2571 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Aug 04 17:46:23.535865 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528698    2571 flags.go:64] FLAG: --log-json-split-stream="false"
Aug 04 17:46:23.535865 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528701    2571 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Aug 04 17:46:23.535865 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528704    2571 flags.go:64] FLAG: --log-text-split-stream="false"
Aug 04 17:46:23.535865 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528707    2571 flags.go:64] FLAG: --logging-format="text"
Aug 04 17:46:23.535865 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528709    2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Aug 04 17:46:23.535865 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528712    2571 flags.go:64] FLAG: --make-iptables-util-chains="true"
Aug 04 17:46:23.535865 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528717    2571 flags.go:64] FLAG: --manifest-url=""
Aug 04 17:46:23.535865 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528719    2571 flags.go:64] FLAG: --manifest-url-header=""
Aug 04 17:46:23.535865 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528724    2571 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Aug 04 17:46:23.535865 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528727    2571 flags.go:64] FLAG: --max-open-files="1000000"
Aug 04 17:46:23.535865 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528731    2571 flags.go:64] FLAG: --max-pods="110"
Aug 04 17:46:23.535865 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528734    2571 flags.go:64] FLAG: --maximum-dead-containers="-1"
Aug 04 17:46:23.535865 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528737    2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Aug 04 17:46:23.535865 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528740    2571 flags.go:64] FLAG: --memory-manager-policy="None"
Aug 04 17:46:23.535865 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528743    2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Aug 04 17:46:23.536480 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528746    2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Aug 04 17:46:23.536480 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528749    2571 flags.go:64] FLAG: --node-ip="0.0.0.0"
Aug 04 17:46:23.536480 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528753    2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Aug 04 17:46:23.536480 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528759    2571 flags.go:64] FLAG: --node-status-max-images="50"
Aug 04 17:46:23.536480 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528762    2571 flags.go:64] FLAG: --node-status-update-frequency="10s"
Aug 04 17:46:23.536480 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528765    2571 flags.go:64] FLAG: --oom-score-adj="-999"
Aug 04 17:46:23.536480 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528768    2571 flags.go:64] FLAG: --pod-cidr=""
Aug 04 17:46:23.536480 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528771    2571 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Aug 04 17:46:23.536480 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528775    2571 flags.go:64] FLAG: --pod-manifest-path=""
Aug 04 17:46:23.536480 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528778    2571 flags.go:64] FLAG: --pod-max-pids="-1"
Aug 04 17:46:23.536480 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528781    2571 flags.go:64] FLAG: --pods-per-core="0"
Aug 04 17:46:23.536480 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528784    2571 flags.go:64] FLAG: --port="10250"
Aug 04 17:46:23.536480 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528787    2571 flags.go:64] FLAG: --protect-kernel-defaults="false"
Aug 04 17:46:23.536480 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528791    2571 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ac8ccbec5abe8585"
Aug 04 17:46:23.536480 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528794    2571 flags.go:64] FLAG: --qos-reserved=""
Aug 04 17:46:23.536480 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528797    2571 flags.go:64] FLAG: --read-only-port="10255"
Aug 04 17:46:23.536480 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528800    2571 flags.go:64] FLAG: --register-node="true"
Aug 04 17:46:23.536480 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528803    2571 flags.go:64] FLAG: --register-with-taints=""
Aug 04 17:46:23.536480 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528806    2571 flags.go:64] FLAG: --registry-burst="10"
Aug 04 17:46:23.536480 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528809    2571 flags.go:64] FLAG: --registry-qps="5"
Aug 04 17:46:23.536480 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528811    2571 flags.go:64] FLAG: --reserved-cpus=""
Aug 04 17:46:23.536480 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528814    2571 flags.go:64] FLAG: --reserved-memory=""
Aug 04 17:46:23.536480 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528818    2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Aug 04 17:46:23.536480 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528822    2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Aug 04 17:46:23.536480 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528825    2571 flags.go:64] FLAG: --rotate-certificates="false"
Aug 04 17:46:23.537144 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528828    2571 flags.go:64] FLAG: --rotate-server-certificates="false"
Aug 04 17:46:23.537144 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528832    2571 flags.go:64] FLAG: --runonce="false"
Aug 04 17:46:23.537144 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528835    2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Aug 04 17:46:23.537144 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528838    2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Aug 04 17:46:23.537144 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528841    2571 flags.go:64] FLAG: --seccomp-default="false"
Aug 04 17:46:23.537144 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528844    2571 flags.go:64] FLAG: --serialize-image-pulls="true"
Aug 04 17:46:23.537144 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528846    2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Aug 04 17:46:23.537144 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528849    2571 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Aug 04 17:46:23.537144 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528852    2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Aug 04 17:46:23.537144 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528855    2571 flags.go:64] FLAG: --storage-driver-password="root"
Aug 04 17:46:23.537144 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528859    2571 flags.go:64] FLAG: --storage-driver-secure="false"
Aug 04 17:46:23.537144 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528861    2571 flags.go:64] FLAG: --storage-driver-table="stats"
Aug 04 17:46:23.537144 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528864    2571 flags.go:64] FLAG: --storage-driver-user="root"
Aug 04 17:46:23.537144 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528867    2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Aug 04 17:46:23.537144 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528870    2571 flags.go:64] FLAG: --sync-frequency="1m0s"
Aug 04 17:46:23.537144 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528873    2571 flags.go:64] FLAG: --system-cgroups=""
Aug 04 17:46:23.537144 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528876    2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Aug 04 17:46:23.537144 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528881    2571 flags.go:64] FLAG: --system-reserved-cgroup=""
Aug 04 17:46:23.537144 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528883    2571 flags.go:64] FLAG: --tls-cert-file=""
Aug 04 17:46:23.537144 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528886    2571 flags.go:64] FLAG: --tls-cipher-suites="[]"
Aug 04 17:46:23.537144 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528890    2571 flags.go:64] FLAG: --tls-min-version=""
Aug 04 17:46:23.537144 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528893    2571 flags.go:64] FLAG: --tls-private-key-file=""
Aug 04 17:46:23.537144 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528895    2571 flags.go:64] FLAG: --topology-manager-policy="none"
Aug 04 17:46:23.537144 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528898    2571 flags.go:64] FLAG: --topology-manager-policy-options=""
Aug 04 17:46:23.537144 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528901    2571 flags.go:64] FLAG: --topology-manager-scope="container"
Aug 04 17:46:23.537919 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528904    2571 flags.go:64] FLAG: --v="2"
Aug 04 17:46:23.537919 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528908    2571 flags.go:64] FLAG: --version="false"
Aug 04 17:46:23.537919 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528912    2571 flags.go:64] FLAG: --vmodule=""
Aug 04 17:46:23.537919 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528915    2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Aug 04 17:46:23.537919 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.528918    2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Aug 04 17:46:23.537919 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529040    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 17:46:23.537919 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529044    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 17:46:23.537919 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529047    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 17:46:23.537919 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529052    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 17:46:23.537919 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529055    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 17:46:23.537919 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529057    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 17:46:23.537919 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529060    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 17:46:23.537919 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529063    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 17:46:23.537919 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529065    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 17:46:23.537919 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529068    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 17:46:23.537919 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529072    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 17:46:23.537919 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529076    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 17:46:23.537919 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529079    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 17:46:23.537919 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529082    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 17:46:23.537919 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529085    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 17:46:23.538593 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529088    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 17:46:23.538593 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529091    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 17:46:23.538593 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529094    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 17:46:23.538593 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529096    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 17:46:23.538593 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529099    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 17:46:23.538593 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529101    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 17:46:23.538593 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529104    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 17:46:23.538593 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529107    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 17:46:23.538593 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529109    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 17:46:23.538593 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529112    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 17:46:23.538593 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529115    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 17:46:23.538593 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529118    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 17:46:23.538593 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529120    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 17:46:23.538593 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529123    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 17:46:23.538593 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529125    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 17:46:23.538593 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529128    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 17:46:23.538593 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529130    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 17:46:23.538593 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529134    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 17:46:23.538593 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529137    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 17:46:23.538593 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529139    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 17:46:23.539083 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529143    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 17:46:23.539083 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529146    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 17:46:23.539083 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529148    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 17:46:23.539083 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529151    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 17:46:23.539083 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529154    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 17:46:23.539083 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529156    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 17:46:23.539083 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529159    2571 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 17:46:23.539083 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529161    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 17:46:23.539083 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529164    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 17:46:23.539083 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529167    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 17:46:23.539083 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529169    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 17:46:23.539083 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529172    2571 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 17:46:23.539083 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529175    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 17:46:23.539083 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529178    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 17:46:23.539083 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529180    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 17:46:23.539083 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529184    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 17:46:23.539083 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529188    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 17:46:23.539083 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529191    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 17:46:23.539083 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529193    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 17:46:23.539570 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529196    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 17:46:23.539570 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529198    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 17:46:23.539570 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529201    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 17:46:23.539570 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529203    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 17:46:23.539570 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529206    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 17:46:23.539570 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529208    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 17:46:23.539570 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529211    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 17:46:23.539570 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529213    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 17:46:23.539570 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529216    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 17:46:23.539570 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529218    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 17:46:23.539570 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529223    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 17:46:23.539570 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529226    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 17:46:23.539570 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529228    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 17:46:23.539570 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529232    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 17:46:23.539570 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529234    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 17:46:23.539570 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529237    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 17:46:23.539570 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529239    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 17:46:23.539570 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529242    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 17:46:23.539570 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529245    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 17:46:23.539570 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529247    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 17:46:23.540054 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529250    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 17:46:23.540054 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529252    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 17:46:23.540054 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529255    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 17:46:23.540054 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529259    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 17:46:23.540054 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529262    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 17:46:23.540054 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529266    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 17:46:23.540054 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529268    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 17:46:23.540054 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529271    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 17:46:23.540054 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529274    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 17:46:23.540054 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529277    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 17:46:23.540054 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529280    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 17:46:23.540054 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529283    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 17:46:23.540054 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529285    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 17:46:23.540054 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529288    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 17:46:23.540054 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529291    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 17:46:23.540054 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529294    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 17:46:23.540054 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529296    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 17:46:23.540054 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529299    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 17:46:23.540054 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529301    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 17:46:23.540531 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529304    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 17:46:23.540531 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529307    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 17:46:23.540531 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529309    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 17:46:23.540531 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529313    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 17:46:23.540531 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529316    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 17:46:23.540531 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.529319    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 17:46:23.540531 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.529957    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 17:46:23.540531 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.536509    2571 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Aug 04 17:46:23.540531 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.536538    2571 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Aug 04 17:46:23.540531 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.536557    2571 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Aug 04 17:46:23.540531 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.536562    2571 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Aug 04 17:46:23.540531 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536617    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 17:46:23.540531 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536621    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 17:46:23.540531 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536624    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 17:46:23.540531 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536628    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 17:46:23.540923 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536630    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 17:46:23.540923 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536633    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 17:46:23.540923 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536636    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 17:46:23.540923 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536639    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 17:46:23.540923 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536642    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 17:46:23.540923 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536644    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 17:46:23.540923 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536647    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 17:46:23.540923 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536650    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 17:46:23.540923 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536654    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 17:46:23.540923 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536658    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 17:46:23.540923 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536661    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 17:46:23.540923 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536664    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 17:46:23.540923 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536666    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 17:46:23.540923 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536670    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 17:46:23.540923 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536673    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 17:46:23.540923 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536675    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 17:46:23.540923 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536679    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 17:46:23.540923 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536682    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 17:46:23.540923 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536685    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 17:46:23.540923 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536688    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 17:46:23.541417 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536691    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 17:46:23.541417 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536693    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 17:46:23.541417 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536696    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 17:46:23.541417 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536699    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 17:46:23.541417 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536701    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 17:46:23.541417 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536705    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 17:46:23.541417 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536708    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 17:46:23.541417 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536711    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 17:46:23.541417 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536714    2571 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 17:46:23.541417 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536717    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 17:46:23.541417 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536719    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 17:46:23.541417 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536722    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 17:46:23.541417 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536724    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 17:46:23.541417 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536727    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 17:46:23.541417 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536730    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 17:46:23.541417 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536732    2571 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 17:46:23.541417 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536735    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 17:46:23.541417 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536738    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 17:46:23.541417 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536741    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 17:46:23.541417 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536743    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 17:46:23.541953 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536746    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 17:46:23.541953 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536748    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 17:46:23.541953 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536751    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 17:46:23.541953 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536753    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 17:46:23.541953 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536756    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 17:46:23.541953 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536760    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 17:46:23.541953 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536763    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 17:46:23.541953 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536766    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 17:46:23.541953 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536769    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 17:46:23.541953 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536772    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 17:46:23.541953 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536774    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 17:46:23.541953 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536777    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 17:46:23.541953 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536780    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 17:46:23.541953 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536783    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 17:46:23.541953 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536785    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 17:46:23.541953 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536788    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 17:46:23.541953 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536791    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 17:46:23.541953 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536794    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 17:46:23.541953 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536798    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 17:46:23.542413 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536802    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 17:46:23.542413 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536804    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 17:46:23.542413 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536807    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 17:46:23.542413 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536810    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 17:46:23.542413 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536812    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 17:46:23.542413 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536815    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 17:46:23.542413 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536818    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 17:46:23.542413 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536821    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 17:46:23.542413 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536823    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 17:46:23.542413 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536826    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 17:46:23.542413 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536829    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 17:46:23.542413 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536832    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 17:46:23.542413 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536834    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 17:46:23.542413 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536837    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 17:46:23.542413 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536839    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 17:46:23.542413 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536842    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 17:46:23.542413 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536845    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 17:46:23.542413 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536847    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 17:46:23.542413 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536850    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 17:46:23.542897 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536853    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 17:46:23.542897 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536855    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 17:46:23.542897 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536857    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 17:46:23.542897 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536860    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 17:46:23.542897 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536863    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 17:46:23.542897 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536866    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 17:46:23.542897 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536869    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 17:46:23.542897 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536871    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 17:46:23.542897 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536874    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 17:46:23.542897 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536877    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 17:46:23.542897 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536879    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 17:46:23.542897 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536883    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 17:46:23.542897 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536885    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 17:46:23.542897 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536888    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 17:46:23.542897 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536891    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 17:46:23.542897 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536894    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 17:46:23.542897 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.536896    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 17:46:23.543317 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.536901    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 17:46:23.543317 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537010    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 17:46:23.543317 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537015    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 17:46:23.543317 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537018    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 17:46:23.543317 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537021    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 17:46:23.543317 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537023    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 17:46:23.543317 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537026    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 17:46:23.543317 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537029    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 17:46:23.543317 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537032    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 17:46:23.543317 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537035    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 17:46:23.543317 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537038    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 17:46:23.543317 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537040    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 17:46:23.543317 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537043    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 17:46:23.543317 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537045    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 17:46:23.543317 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537048    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 17:46:23.543702 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537051    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 17:46:23.543702 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537053    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 17:46:23.543702 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537056    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 17:46:23.543702 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537058    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 17:46:23.543702 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537061    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 17:46:23.543702 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537063    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 17:46:23.543702 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537066    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 17:46:23.543702 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537068    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 17:46:23.543702 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537071    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 17:46:23.543702 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537073    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 17:46:23.543702 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537076    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 17:46:23.543702 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537079    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 17:46:23.543702 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537082    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 17:46:23.543702 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537084    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 17:46:23.543702 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537087    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 17:46:23.543702 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537089    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 17:46:23.543702 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537092    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 17:46:23.543702 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537095    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 17:46:23.543702 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537097    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 17:46:23.543702 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537100    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 17:46:23.544186 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537102    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 17:46:23.544186 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537105    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 17:46:23.544186 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537107    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 17:46:23.544186 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537110    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 17:46:23.544186 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537112    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 17:46:23.544186 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537115    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 17:46:23.544186 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537118    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 17:46:23.544186 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537120    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 17:46:23.544186 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537124    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 17:46:23.544186 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537126    2571 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 17:46:23.544186 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537129    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 17:46:23.544186 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537131    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 17:46:23.544186 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537134    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 17:46:23.544186 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537136    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 17:46:23.544186 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537139    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 17:46:23.544186 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537141    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 17:46:23.544186 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537144    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 17:46:23.544186 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537146    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 17:46:23.544186 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537149    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 17:46:23.544186 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537151    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 17:46:23.544687 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537154    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 17:46:23.544687 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537157    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 17:46:23.544687 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537160    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 17:46:23.544687 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537162    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 17:46:23.544687 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537166    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 17:46:23.544687 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537169    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 17:46:23.544687 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537173    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 17:46:23.544687 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537177    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 17:46:23.544687 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537180    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 17:46:23.544687 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537182    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 17:46:23.544687 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537186    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 17:46:23.544687 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537188    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 17:46:23.544687 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537191    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 17:46:23.544687 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537193    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 17:46:23.544687 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537196    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 17:46:23.544687 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537199    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 17:46:23.544687 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537201    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 17:46:23.544687 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537204    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 17:46:23.544687 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537207    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 17:46:23.545144 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537210    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 17:46:23.545144 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537212    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 17:46:23.545144 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537215    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 17:46:23.545144 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537217    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 17:46:23.545144 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537219    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 17:46:23.545144 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537222    2571 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 17:46:23.545144 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537224    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 17:46:23.545144 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537227    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 17:46:23.545144 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537230    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 17:46:23.545144 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537232    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 17:46:23.545144 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537234    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 17:46:23.545144 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537237    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 17:46:23.545144 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537239    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 17:46:23.545144 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537242    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 17:46:23.545144 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537244    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 17:46:23.545144 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537247    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 17:46:23.545144 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537249    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 17:46:23.545144 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537252    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 17:46:23.545144 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537255    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 17:46:23.545144 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537257    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 17:46:23.545638 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537260    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 17:46:23.545638 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537262    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 17:46:23.545638 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537265    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 17:46:23.545638 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537267    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 17:46:23.545638 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537271    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 17:46:23.545638 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:23.537274    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 17:46:23.545638 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.537279    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 17:46:23.545638 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.537365    2571 server.go:962] "Client rotation is on, will bootstrap in background"
Aug 04 17:46:23.545638 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.540110    2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Aug 04 17:46:23.545638 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.541820    2571 server.go:1019] "Starting client certificate rotation"
Aug 04 17:46:23.545638 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.541923    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 04 17:46:23.545638 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.541962    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 04 17:46:23.545638 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.544638    2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 04 17:46:23.548469 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.548453    2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 04 17:46:23.561018 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.560995    2571 log.go:25] "Validated CRI v1 runtime API"
Aug 04 17:46:23.564242 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.564229    2571 log.go:25] "Validated CRI v1 image API"
Aug 04 17:46:23.564990 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.564962    2571 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Aug 04 17:46:23.567611 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.567594    2571 fs.go:135] Filesystem UUIDs: map[0a9b3b3a-a8ab-49b0-8211-3e8753b9848e:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d8786525-65cf-4cb8-8e18-ed2795fc379e:/dev/nvme0n1p3]
Aug 04 17:46:23.567656 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.567611    2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Aug 04 17:46:23.571290 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.571272    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 04 17:46:23.572552 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.572434    2571 manager.go:216] Machine: {Timestamp:2026-08-04 17:46:23.571082182 +0000 UTC m=+0.372218500 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102102 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2328ba53dd439edd5a98e798297175 SystemUUID:ec2328ba-53dd-439e-dd5a-98e798297175 BootID:56358a88-8b35-4e55-a067-d46cf68d92ab Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:7c:89:cb:52:9f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:7c:89:cb:52:9f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e6:ae:3f:d2:76:7a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Aug 04 17:46:23.572552 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.572546    2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Aug 04 17:46:23.572665 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.572610    2571 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Aug 04 17:46:23.576101 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.576081    2571 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Aug 04 17:46:23.576220 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.576105    2571 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-220.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Aug 04 17:46:23.577676 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.577666    2571 topology_manager.go:138] "Creating topology manager with none policy"
Aug 04 17:46:23.577716 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.577679    2571 container_manager_linux.go:309] "Creating device plugin manager"
Aug 04 17:46:23.577716 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.577687    2571 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 04 17:46:23.578651 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.578641    2571 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 04 17:46:23.579855 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.579845    2571 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Aug 04 17:46:23.585015 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.585004    2571 state_mem.go:36] "Initialized new in-memory state store"
Aug 04 17:46:23.585115 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.585105    2571 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Aug 04 17:46:23.585151 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.585133    2571 kubelet.go:486] "Attempting to sync node with API server"
Aug 04 17:46:23.585151 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.585147    2571 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Aug 04 17:46:23.585201 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.585160    2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Aug 04 17:46:23.585201 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.585170    2571 kubelet.go:398] "Adding apiserver pod source"
Aug 04 17:46:23.585201 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.585179    2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Aug 04 17:46:23.585467 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.585457    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 04 17:46:23.585508 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.585473    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 04 17:46:23.589150 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.588937    2571 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Aug 04 17:46:23.590830 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.590817    2571 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Aug 04 17:46:23.590880 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.590846    2571 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Aug 04 17:46:23.592190 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.592178    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Aug 04 17:46:23.592245 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.592194    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Aug 04 17:46:23.592245 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.592200    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Aug 04 17:46:23.592245 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.592205    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Aug 04 17:46:23.592245 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.592213    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Aug 04 17:46:23.592245 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.592219    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Aug 04 17:46:23.592245 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.592226    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Aug 04 17:46:23.592245 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.592232    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Aug 04 17:46:23.592245 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.592239    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Aug 04 17:46:23.592245 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.592244    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Aug 04 17:46:23.592486 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.592252    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Aug 04 17:46:23.592486 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.592257    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Aug 04 17:46:23.593199 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.593189    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Aug 04 17:46:23.593199 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.593198    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Aug 04 17:46:23.595955 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.595940    2571 server.go:1268] "Started kubelet"
Aug 04 17:46:23.596085 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.596038    2571 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Aug 04 17:46:23.596167 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.596023    2571 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Aug 04 17:46:23.596226 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.596177    2571 server_v1.go:49] "podresources" method="list" useActivePods=true
Aug 04 17:46:23.596591 ip-10-0-141-220 systemd[1]: Started Kubernetes Kubelet.
Aug 04 17:46:23.597687 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.597640    2571 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Aug 04 17:46:23.598113 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.598097    2571 server.go:310] "Adding debug handlers to kubelet server"
Aug 04 17:46:23.598874 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:23.598852    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Aug 04 17:46:23.599071 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:23.599052    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-220.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Aug 04 17:46:23.599145 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.599111    2571 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-220.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Aug 04 17:46:23.602376 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:23.601291    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-220.ec2.internal.18c8ab494ed48184  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-220.ec2.internal,UID:ip-10-0-141-220.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-220.ec2.internal,},FirstTimestamp:2026-08-04 17:46:23.595913604 +0000 UTC m=+0.397049921,LastTimestamp:2026-08-04 17:46:23.595913604 +0000 UTC m=+0.397049921,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-220.ec2.internal,}"
Aug 04 17:46:23.602455 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:23.602359    2571 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Aug 04 17:46:23.605136 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.605120    2571 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Aug 04 17:46:23.605253 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:23.605232    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found"
Aug 04 17:46:23.605253 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.605244    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Aug 04 17:46:23.605943 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.605928    2571 volume_manager.go:311] "The desired_state_of_world populator starts"
Aug 04 17:46:23.605996 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.605945    2571 volume_manager.go:313] "Starting Kubelet Volume Manager"
Aug 04 17:46:23.606329 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.606103    2571 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Aug 04 17:46:23.606329 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.606149    2571 reconstruct.go:97] "Volume reconstruction finished"
Aug 04 17:46:23.606329 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.606201    2571 reconciler.go:29] "Reconciler: start to sync state"
Aug 04 17:46:23.606803 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.606783    2571 factory.go:55] Registering systemd factory
Aug 04 17:46:23.606803 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.606807    2571 factory.go:223] Registration of the systemd container factory successfully
Aug 04 17:46:23.607086 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.607070    2571 factory.go:153] Registering CRI-O factory
Aug 04 17:46:23.607086 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.607088    2571 factory.go:223] Registration of the crio container factory successfully
Aug 04 17:46:23.607208 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.607148    2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Aug 04 17:46:23.607208 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.607170    2571 factory.go:103] Registering Raw factory
Aug 04 17:46:23.607208 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.607183    2571 manager.go:1196] Started watching for new ooms in manager
Aug 04 17:46:23.607680 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.607667    2571 manager.go:349] Starting recovery of all containers
Aug 04 17:46:23.608915 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:23.608883    2571 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-220.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Aug 04 17:46:23.609369 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:23.609347    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Aug 04 17:46:23.617947 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.617825    2571 manager.go:354] Recovery completed
Aug 04 17:46:23.620288 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.620262    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9f8s2"
Aug 04 17:46:23.624584 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.624567    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 17:46:23.626306 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.626293    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 17:46:23.626363 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.626322    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 17:46:23.626363 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.626334    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientPID"
Aug 04 17:46:23.626708 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.626672    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9f8s2"
Aug 04 17:46:23.626832 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.626819    2571 cpu_manager.go:222] "Starting CPU manager" policy="none"
Aug 04 17:46:23.626880 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.626833    2571 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Aug 04 17:46:23.626880 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.626850    2571 state_mem.go:36] "Initialized new in-memory state store"
Aug 04 17:46:23.626880 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.626826    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 17:46:23.628262 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.628242    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 17:46:23.628335 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.628271    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 17:46:23.628335 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.628285    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientPID"
Aug 04 17:46:23.628436 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:23.628368    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-220.ec2.internal.18c8ab4950a44687  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-220.ec2.internal,UID:ip-10-0-141-220.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-220.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-220.ec2.internal,},FirstTimestamp:2026-08-04 17:46:23.626307207 +0000 UTC m=+0.427443529,LastTimestamp:2026-08-04 17:46:23.626307207 +0000 UTC m=+0.427443529,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-220.ec2.internal,}"
Aug 04 17:46:23.630462 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.630449    2571 policy_none.go:49] "None policy: Start"
Aug 04 17:46:23.630462 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.630464    2571 memory_manager.go:187] "Starting memorymanager" policy="None"
Aug 04 17:46:23.630571 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.630474    2571 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Aug 04 17:46:23.632693 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.632682    2571 policy_none.go:47] "Start"
Aug 04 17:46:23.661111 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.661097    2571 manager.go:337] "Starting Device Plugin manager"
Aug 04 17:46:23.791401 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:23.661123    2571 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Aug 04 17:46:23.791401 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.661133    2571 server.go:87] "Starting device plugin registration server"
Aug 04 17:46:23.791401 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.661336    2571 eviction_manager.go:189] "Eviction manager: starting control loop"
Aug 04 17:46:23.791401 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.661348    2571 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Aug 04 17:46:23.791401 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.661490    2571 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Aug 04 17:46:23.791401 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.661581    2571 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Aug 04 17:46:23.791401 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.661589    2571 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Aug 04 17:46:23.791401 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:23.663495    2571 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Aug 04 17:46:23.791401 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:23.663556    2571 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-220.ec2.internal\" not found"
Aug 04 17:46:23.791401 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.675889    2571 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2605 into the system container \"/system.slice\": <nil>"
Aug 04 17:46:23.791401 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.761787    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 17:46:23.791401 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.762451    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 17:46:23.791401 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.762473    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 17:46:23.791401 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.762484    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientPID"
Aug 04 17:46:23.791401 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.762503    2571 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-220.ec2.internal"
Aug 04 17:46:23.791401 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.770410    2571 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-220.ec2.internal"
Aug 04 17:46:23.791401 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:23.770425    2571 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-220.ec2.internal\": node \"ip-10-0-141-220.ec2.internal\" not found"
Aug 04 17:46:23.791401 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:23.791199    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found"
Aug 04 17:46:23.872644 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.872533    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Aug 04 17:46:23.873713 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.873699    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Aug 04 17:46:23.873770 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.873734    2571 status_manager.go:244] "Starting to sync pod status with apiserver"
Aug 04 17:46:23.873770 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.873753    2571 kubelet.go:2448] "Starting kubelet main sync loop"
Aug 04 17:46:23.873863 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:23.873787    2571 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Aug 04 17:46:23.876342 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.876329    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 17:46:23.891583 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:23.891568    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found"
Aug 04 17:46:23.973911 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.973885    2571 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal"]
Aug 04 17:46:23.973978 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.973941    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 17:46:23.974662 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.974650    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 17:46:23.974735 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.974675    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 17:46:23.974735 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.974689    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientPID"
Aug 04 17:46:23.976915 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.976904    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 17:46:23.977025 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.977012    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal"
Aug 04 17:46:23.977062 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.977041    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 17:46:23.977534 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.977506    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 17:46:23.977534 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.977514    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 17:46:23.977637 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.977545    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 17:46:23.977637 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.977560    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientPID"
Aug 04 17:46:23.977637 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.977547    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 17:46:23.977637 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.977623    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientPID"
Aug 04 17:46:23.979838 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.979821    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal"
Aug 04 17:46:23.979897 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.979854    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 17:46:23.980490 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.980474    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 17:46:23.980581 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.980500    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 17:46:23.980581 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:23.980514    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientPID"
Aug 04 17:46:23.992617 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:23.992605    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found"
Aug 04 17:46:24.004018 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:24.004000    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-220.ec2.internal\" not found" node="ip-10-0-141-220.ec2.internal"
Aug 04 17:46:24.008039 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.008022    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d50d574671ac25d0c57a314e2746b629-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal\" (UID: \"d50d574671ac25d0c57a314e2746b629\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal"
Aug 04 17:46:24.008098 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.008047    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d50d574671ac25d0c57a314e2746b629-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal\" (UID: \"d50d574671ac25d0c57a314e2746b629\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal"
Aug 04 17:46:24.008098 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.008062    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/38e66965b8a5bfd304ca9eefbb3544fa-config\") pod \"kube-apiserver-proxy-ip-10-0-141-220.ec2.internal\" (UID: \"38e66965b8a5bfd304ca9eefbb3544fa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal"
Aug 04 17:46:24.008098 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:24.008065    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-220.ec2.internal\" not found" node="ip-10-0-141-220.ec2.internal"
Aug 04 17:46:24.093591 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:24.093555    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found"
Aug 04 17:46:24.108878 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.108859    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d50d574671ac25d0c57a314e2746b629-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal\" (UID: \"d50d574671ac25d0c57a314e2746b629\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal"
Aug 04 17:46:24.108938 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.108883    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d50d574671ac25d0c57a314e2746b629-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal\" (UID: \"d50d574671ac25d0c57a314e2746b629\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal"
Aug 04 17:46:24.108938 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.108899    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/38e66965b8a5bfd304ca9eefbb3544fa-config\") pod \"kube-apiserver-proxy-ip-10-0-141-220.ec2.internal\" (UID: \"38e66965b8a5bfd304ca9eefbb3544fa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal"
Aug 04 17:46:24.108938 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.108924    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/38e66965b8a5bfd304ca9eefbb3544fa-config\") pod \"kube-apiserver-proxy-ip-10-0-141-220.ec2.internal\" (UID: \"38e66965b8a5bfd304ca9eefbb3544fa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal"
Aug 04 17:46:24.109039 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.108939    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d50d574671ac25d0c57a314e2746b629-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal\" (UID: \"d50d574671ac25d0c57a314e2746b629\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal"
Aug 04 17:46:24.109039 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.108962    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d50d574671ac25d0c57a314e2746b629-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal\" (UID: \"d50d574671ac25d0c57a314e2746b629\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal"
Aug 04 17:46:24.194028 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:24.194002    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found"
Aug 04 17:46:24.294467 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:24.294445    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found"
Aug 04 17:46:24.306628 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.306614    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal"
Aug 04 17:46:24.310540 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.310514    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal"
Aug 04 17:46:24.395285 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:24.395263    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found"
Aug 04 17:46:24.430169 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.430150    2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 17:46:24.506805 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.506783    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal"
Aug 04 17:46:24.515883 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.515866    2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 17:46:24.519773 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.519761    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 04 17:46:24.521589 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.521576    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal"
Aug 04 17:46:24.532164 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.532149    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 04 17:46:24.540907 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.540889    2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Aug 04 17:46:24.540999 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.540977    2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 04 17:46:24.541057 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.541021    2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 04 17:46:24.586907 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.586888    2571 apiserver.go:52] "Watching apiserver"
Aug 04 17:46:24.594034 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.594014    2571 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Aug 04 17:46:24.596265 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.596116    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-48dc2","openshift-multus/multus-additional-cni-plugins-6lrlf","openshift-multus/network-metrics-daemon-bqph9","kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4tcn","openshift-dns/node-resolver-qgjr8","openshift-image-registry/node-ca-64wn5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal","openshift-network-diagnostics/network-check-target-qqhjm","openshift-network-operator/iptables-alerter-mvqbx","openshift-ovn-kubernetes/ovnkube-node-lwmwl","kube-system/global-pull-secret-syncer-pm47l","kube-system/konnectivity-agent-xq7xp","openshift-cluster-node-tuning-operator/tuned-tr759"]
Aug 04 17:46:24.599323 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.599303    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.601650 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.601628    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6lrlf"
Aug 04 17:46:24.602026 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.602008    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Aug 04 17:46:24.602109 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.602069    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-49hhh\""
Aug 04 17:46:24.602109 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.602080    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Aug 04 17:46:24.602231 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.602198    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Aug 04 17:46:24.602275 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.602264    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Aug 04 17:46:24.603524 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.603507    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bnhrq\""
Aug 04 17:46:24.603888 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.603858    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:46:24.603990 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.603887    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Aug 04 17:46:24.603990 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.603859    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Aug 04 17:46:24.603990 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:24.603932    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqph9" podUID="cec46231-ba14-4b07-b2b1-df119f58db12"
Aug 04 17:46:24.606203 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.606187    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4tcn"
Aug 04 17:46:24.606281 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.606266    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Aug 04 17:46:24.608309 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.608292    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Aug 04 17:46:24.608420 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.608338    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bjc57\""
Aug 04 17:46:24.608420 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.608370    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Aug 04 17:46:24.608420 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.608375    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Aug 04 17:46:24.608615 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.608584    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qgjr8"
Aug 04 17:46:24.610624 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.610607    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6thpr\""
Aug 04 17:46:24.610693 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.610640    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Aug 04 17:46:24.610834 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.610812    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Aug 04 17:46:24.610879 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.610813    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9800c9e0-bedf-4d65-a981-0cb8b0726c61-system-cni-dir\") pod \"multus-additional-cni-plugins-6lrlf\" (UID: \"9800c9e0-bedf-4d65-a981-0cb8b0726c61\") " pod="openshift-multus/multus-additional-cni-plugins-6lrlf"
Aug 04 17:46:24.610936 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.610873    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9800c9e0-bedf-4d65-a981-0cb8b0726c61-cnibin\") pod \"multus-additional-cni-plugins-6lrlf\" (UID: \"9800c9e0-bedf-4d65-a981-0cb8b0726c61\") " pod="openshift-multus/multus-additional-cni-plugins-6lrlf"
Aug 04 17:46:24.610936 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.610901    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9800c9e0-bedf-4d65-a981-0cb8b0726c61-cni-binary-copy\") pod \"multus-additional-cni-plugins-6lrlf\" (UID: \"9800c9e0-bedf-4d65-a981-0cb8b0726c61\") " pod="openshift-multus/multus-additional-cni-plugins-6lrlf"
Aug 04 17:46:24.610936 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.610928    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rmx4\" (UniqueName: \"kubernetes.io/projected/9800c9e0-bedf-4d65-a981-0cb8b0726c61-kube-api-access-7rmx4\") pod \"multus-additional-cni-plugins-6lrlf\" (UID: \"9800c9e0-bedf-4d65-a981-0cb8b0726c61\") " pod="openshift-multus/multus-additional-cni-plugins-6lrlf"
Aug 04 17:46:24.611065 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.610982    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh9sz\" (UniqueName: \"kubernetes.io/projected/4ff78307-0cd9-4551-9b67-95943e190bfe-kube-api-access-jh9sz\") pod \"node-resolver-qgjr8\" (UID: \"4ff78307-0cd9-4551-9b67-95943e190bfe\") " pod="openshift-dns/node-resolver-qgjr8"
Aug 04 17:46:24.611065 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.611012    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-multus-cni-dir\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.611065 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.611030    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9800c9e0-bedf-4d65-a981-0cb8b0726c61-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6lrlf\" (UID: \"9800c9e0-bedf-4d65-a981-0cb8b0726c61\") " pod="openshift-multus/multus-additional-cni-plugins-6lrlf"
Aug 04 17:46:24.611162 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.611071    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcjj5\" (UniqueName: \"kubernetes.io/projected/cec46231-ba14-4b07-b2b1-df119f58db12-kube-api-access-dcjj5\") pod \"network-metrics-daemon-bqph9\" (UID: \"cec46231-ba14-4b07-b2b1-df119f58db12\") " pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:46:24.611162 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.611084    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-64wn5"
Aug 04 17:46:24.611162 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.611103    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ff78307-0cd9-4551-9b67-95943e190bfe-tmp-dir\") pod \"node-resolver-qgjr8\" (UID: \"4ff78307-0cd9-4551-9b67-95943e190bfe\") " pod="openshift-dns/node-resolver-qgjr8"
Aug 04 17:46:24.611162 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.611136    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-os-release\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.611306 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.611166    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/466aca21-890a-48c7-ba36-047a46e4bf38-registration-dir\") pod \"aws-ebs-csi-driver-node-q4tcn\" (UID: \"466aca21-890a-48c7-ba36-047a46e4bf38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4tcn"
Aug 04 17:46:24.611306 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.611191    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4ff78307-0cd9-4551-9b67-95943e190bfe-hosts-file\") pod \"node-resolver-qgjr8\" (UID: \"4ff78307-0cd9-4551-9b67-95943e190bfe\") " pod="openshift-dns/node-resolver-qgjr8"
Aug 04 17:46:24.611306 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.611216    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-host-var-lib-cni-multus\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.611306 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.611241    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-host-var-lib-kubelet\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.611306 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.611281    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cec46231-ba14-4b07-b2b1-df119f58db12-metrics-certs\") pod \"network-metrics-daemon-bqph9\" (UID: \"cec46231-ba14-4b07-b2b1-df119f58db12\") " pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:46:24.611487 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.611305    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-etc-kubernetes\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.611487 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.611329    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpcrc\" (UniqueName: \"kubernetes.io/projected/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-kube-api-access-cpcrc\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.611487 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.611352    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9800c9e0-bedf-4d65-a981-0cb8b0726c61-os-release\") pod \"multus-additional-cni-plugins-6lrlf\" (UID: \"9800c9e0-bedf-4d65-a981-0cb8b0726c61\") " pod="openshift-multus/multus-additional-cni-plugins-6lrlf"
Aug 04 17:46:24.611487 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.611375    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/466aca21-890a-48c7-ba36-047a46e4bf38-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q4tcn\" (UID: \"466aca21-890a-48c7-ba36-047a46e4bf38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4tcn"
Aug 04 17:46:24.611487 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.611389    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/466aca21-890a-48c7-ba36-047a46e4bf38-socket-dir\") pod \"aws-ebs-csi-driver-node-q4tcn\" (UID: \"466aca21-890a-48c7-ba36-047a46e4bf38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4tcn"
Aug 04 17:46:24.611487 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.611409    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-cnibin\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.611487 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.611428    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-multus-socket-dir-parent\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.611487 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.611443    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-multus-conf-dir\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.611487 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.611457    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-system-cni-dir\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.611487 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.611476    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-host-run-k8s-cni-cncf-io\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.611800 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.611501    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-hostroot\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.611800 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.611537    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-host-run-multus-certs\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.611800 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.611557    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/466aca21-890a-48c7-ba36-047a46e4bf38-device-dir\") pod \"aws-ebs-csi-driver-node-q4tcn\" (UID: \"466aca21-890a-48c7-ba36-047a46e4bf38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4tcn"
Aug 04 17:46:24.611800 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.611599    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/466aca21-890a-48c7-ba36-047a46e4bf38-etc-selinux\") pod \"aws-ebs-csi-driver-node-q4tcn\" (UID: \"466aca21-890a-48c7-ba36-047a46e4bf38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4tcn"
Aug 04 17:46:24.611800 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.611626    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/466aca21-890a-48c7-ba36-047a46e4bf38-sys-fs\") pod \"aws-ebs-csi-driver-node-q4tcn\" (UID: \"466aca21-890a-48c7-ba36-047a46e4bf38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4tcn"
Aug 04 17:46:24.611800 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.611643    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lnvb\" (UniqueName: \"kubernetes.io/projected/466aca21-890a-48c7-ba36-047a46e4bf38-kube-api-access-8lnvb\") pod \"aws-ebs-csi-driver-node-q4tcn\" (UID: \"466aca21-890a-48c7-ba36-047a46e4bf38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4tcn"
Aug 04 17:46:24.611800 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.611662    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-host-var-lib-cni-bin\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.611800 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.611677    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-multus-daemon-config\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.611800 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.611693    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9800c9e0-bedf-4d65-a981-0cb8b0726c61-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6lrlf\" (UID: \"9800c9e0-bedf-4d65-a981-0cb8b0726c61\") " pod="openshift-multus/multus-additional-cni-plugins-6lrlf"
Aug 04 17:46:24.611800 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.611717    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9800c9e0-bedf-4d65-a981-0cb8b0726c61-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6lrlf\" (UID: \"9800c9e0-bedf-4d65-a981-0cb8b0726c61\") " pod="openshift-multus/multus-additional-cni-plugins-6lrlf"
Aug 04 17:46:24.611800 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.611744    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-cni-binary-copy\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.611800 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.611764    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-host-run-netns\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.613196 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.613178    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Aug 04 17:46:24.613371 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.613354    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Aug 04 17:46:24.613371 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.613363    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Aug 04 17:46:24.613459 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.613417    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqhjm"
Aug 04 17:46:24.613495 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.613414    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-g25ld\""
Aug 04 17:46:24.613495 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:24.613474    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqhjm" podUID="a63fe4d6-9f64-4faa-bef7-93be6cde4970"
Aug 04 17:46:24.615867 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.615850    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 04 17:46:24.615908 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.615866    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mvqbx"
Aug 04 17:46:24.617862 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.617848    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Aug 04 17:46:24.618012 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.618000    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-67nsf\""
Aug 04 17:46:24.618054 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.618039    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Aug 04 17:46:24.618142 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.618128    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Aug 04 17:46:24.618334 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.618317    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.620645 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.620623    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Aug 04 17:46:24.620645 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.620640    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Aug 04 17:46:24.620857 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.620654    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qjgcm\""
Aug 04 17:46:24.620857 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.620676    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Aug 04 17:46:24.620857 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.620703    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Aug 04 17:46:24.620857 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.620639    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Aug 04 17:46:24.620857 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.620642    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Aug 04 17:46:24.621026 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.620936    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm47l"
Aug 04 17:46:24.621026 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:24.621000    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pm47l" podUID="175017d4-1fb6-4129-b96f-4990959c3a8b"
Aug 04 17:46:24.623371 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.623354    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xq7xp"
Aug 04 17:46:24.625367 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.625350    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Aug 04 17:46:24.625496 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.625409    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Aug 04 17:46:24.625496 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.625473    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-j4jj8\""
Aug 04 17:46:24.625806 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.625786    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.627746 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.627726    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Aug 04 17:46:24.627835 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.627760    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tt9dx\""
Aug 04 17:46:24.627835 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.627765    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Aug 04 17:46:24.632678 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.632634    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-03 17:41:24 +0000 UTC" deadline="2028-02-13 23:24:43.159045957 +0000 UTC"
Aug 04 17:46:24.632678 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.632655    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13397h38m18.526393431s"
Aug 04 17:46:24.641184 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.641165    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8mn29"
Aug 04 17:46:24.650319 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.650303    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8mn29"
Aug 04 17:46:24.707248 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.707227    2571 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Aug 04 17:46:24.712396 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.712377    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9800c9e0-bedf-4d65-a981-0cb8b0726c61-cni-binary-copy\") pod \"multus-additional-cni-plugins-6lrlf\" (UID: \"9800c9e0-bedf-4d65-a981-0cb8b0726c61\") " pod="openshift-multus/multus-additional-cni-plugins-6lrlf"
Aug 04 17:46:24.712484 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.712404    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rmx4\" (UniqueName: \"kubernetes.io/projected/9800c9e0-bedf-4d65-a981-0cb8b0726c61-kube-api-access-7rmx4\") pod \"multus-additional-cni-plugins-6lrlf\" (UID: \"9800c9e0-bedf-4d65-a981-0cb8b0726c61\") " pod="openshift-multus/multus-additional-cni-plugins-6lrlf"
Aug 04 17:46:24.712484 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.712422    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-multus-cni-dir\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.712484 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.712449    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqmr8\" (UniqueName: \"kubernetes.io/projected/7f50c49e-31bc-4d7f-bfe0-24f72a99c129-kube-api-access-fqmr8\") pod \"iptables-alerter-mvqbx\" (UID: \"7f50c49e-31bc-4d7f-bfe0-24f72a99c129\") " pod="openshift-network-operator/iptables-alerter-mvqbx"
Aug 04 17:46:24.712609 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.712580    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-node-log\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.712609 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.712605    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-etc-tuned\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.712702 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.712624    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ff78307-0cd9-4551-9b67-95943e190bfe-tmp-dir\") pod \"node-resolver-qgjr8\" (UID: \"4ff78307-0cd9-4551-9b67-95943e190bfe\") " pod="openshift-dns/node-resolver-qgjr8"
Aug 04 17:46:24.712753 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.712738    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-etc-sysctl-d\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.712807 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.712767    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/466aca21-890a-48c7-ba36-047a46e4bf38-registration-dir\") pod \"aws-ebs-csi-driver-node-q4tcn\" (UID: \"466aca21-890a-48c7-ba36-047a46e4bf38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4tcn"
Aug 04 17:46:24.712807 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.712785    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f50c49e-31bc-4d7f-bfe0-24f72a99c129-host-slash\") pod \"iptables-alerter-mvqbx\" (UID: \"7f50c49e-31bc-4d7f-bfe0-24f72a99c129\") " pod="openshift-network-operator/iptables-alerter-mvqbx"
Aug 04 17:46:24.712890 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.712802    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-multus-cni-dir\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.712890 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.712817    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-log-socket\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.712890 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.712842    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.712890 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.712859    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/69dd0780-85db-48ac-adc9-eef4e735e68d-ovn-node-metrics-cert\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.712890 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.712866    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/466aca21-890a-48c7-ba36-047a46e4bf38-registration-dir\") pod \"aws-ebs-csi-driver-node-q4tcn\" (UID: \"466aca21-890a-48c7-ba36-047a46e4bf38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4tcn"
Aug 04 17:46:24.712890 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.712877    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-systemd-units\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.713164 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.712907    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-etc-openvswitch\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.713164 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.712950    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-var-lib-kubelet\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.713164 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.712973    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/59068cff-9e8e-4aa6-af07-d08f484171e9-konnectivity-ca\") pod \"konnectivity-agent-xq7xp\" (UID: \"59068cff-9e8e-4aa6-af07-d08f484171e9\") " pod="kube-system/konnectivity-agent-xq7xp"
Aug 04 17:46:24.713164 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.712993    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-multus-conf-dir\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.713164 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713009    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8lxr\" (UniqueName: \"kubernetes.io/projected/fbf8aa50-191e-49a4-8a78-c03a83900d95-kube-api-access-p8lxr\") pod \"node-ca-64wn5\" (UID: \"fbf8aa50-191e-49a4-8a78-c03a83900d95\") " pod="openshift-image-registry/node-ca-64wn5"
Aug 04 17:46:24.713164 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713025    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-hostroot\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.713164 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713049    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-host-kubelet\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.713164 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713052    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-multus-conf-dir\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.713164 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713064    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-run-openvswitch\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.713164 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713067    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-hostroot\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.713164 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713080    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/69dd0780-85db-48ac-adc9-eef4e735e68d-env-overrides\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.713164 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713113    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-run\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.713164 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713142    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjgxv\" (UniqueName: \"kubernetes.io/projected/a63fe4d6-9f64-4faa-bef7-93be6cde4970-kube-api-access-sjgxv\") pod \"network-check-target-qqhjm\" (UID: \"a63fe4d6-9f64-4faa-bef7-93be6cde4970\") " pod="openshift-network-diagnostics/network-check-target-qqhjm"
Aug 04 17:46:24.713164 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713163    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/175017d4-1fb6-4129-b96f-4990959c3a8b-kubelet-config\") pod \"global-pull-secret-syncer-pm47l\" (UID: \"175017d4-1fb6-4129-b96f-4990959c3a8b\") " pod="kube-system/global-pull-secret-syncer-pm47l"
Aug 04 17:46:24.713706 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713183    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/466aca21-890a-48c7-ba36-047a46e4bf38-device-dir\") pod \"aws-ebs-csi-driver-node-q4tcn\" (UID: \"466aca21-890a-48c7-ba36-047a46e4bf38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4tcn"
Aug 04 17:46:24.713706 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713219    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/466aca21-890a-48c7-ba36-047a46e4bf38-device-dir\") pod \"aws-ebs-csi-driver-node-q4tcn\" (UID: \"466aca21-890a-48c7-ba36-047a46e4bf38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4tcn"
Aug 04 17:46:24.713706 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713243    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/466aca21-890a-48c7-ba36-047a46e4bf38-sys-fs\") pod \"aws-ebs-csi-driver-node-q4tcn\" (UID: \"466aca21-890a-48c7-ba36-047a46e4bf38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4tcn"
Aug 04 17:46:24.713706 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713298    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/466aca21-890a-48c7-ba36-047a46e4bf38-sys-fs\") pod \"aws-ebs-csi-driver-node-q4tcn\" (UID: \"466aca21-890a-48c7-ba36-047a46e4bf38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4tcn"
Aug 04 17:46:24.713706 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713321    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lnvb\" (UniqueName: \"kubernetes.io/projected/466aca21-890a-48c7-ba36-047a46e4bf38-kube-api-access-8lnvb\") pod \"aws-ebs-csi-driver-node-q4tcn\" (UID: \"466aca21-890a-48c7-ba36-047a46e4bf38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4tcn"
Aug 04 17:46:24.713706 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713387    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-multus-daemon-config\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.713706 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713424    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-run-systemd\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.713706 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713441    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj4dk\" (UniqueName: \"kubernetes.io/projected/69dd0780-85db-48ac-adc9-eef4e735e68d-kube-api-access-rj4dk\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.713706 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713457    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-sys\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.713706 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713474    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-host\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.713706 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713506    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-cni-binary-copy\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.713706 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713549    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-host-slash\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.713706 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713566    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-host-run-netns\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.713706 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713672    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ff78307-0cd9-4551-9b67-95943e190bfe-tmp-dir\") pod \"node-resolver-qgjr8\" (UID: \"4ff78307-0cd9-4551-9b67-95943e190bfe\") " pod="openshift-dns/node-resolver-qgjr8"
Aug 04 17:46:24.713706 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713692    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-var-lib-openvswitch\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.713706 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713713    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/69dd0780-85db-48ac-adc9-eef4e735e68d-ovnkube-config\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.714347 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713743    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-etc-kubernetes\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.714347 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713773    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-tmp\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.714347 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713775    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9800c9e0-bedf-4d65-a981-0cb8b0726c61-cni-binary-copy\") pod \"multus-additional-cni-plugins-6lrlf\" (UID: \"9800c9e0-bedf-4d65-a981-0cb8b0726c61\") " pod="openshift-multus/multus-additional-cni-plugins-6lrlf"
Aug 04 17:46:24.714347 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713803    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9800c9e0-bedf-4d65-a981-0cb8b0726c61-system-cni-dir\") pod \"multus-additional-cni-plugins-6lrlf\" (UID: \"9800c9e0-bedf-4d65-a981-0cb8b0726c61\") " pod="openshift-multus/multus-additional-cni-plugins-6lrlf"
Aug 04 17:46:24.714347 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713832    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9800c9e0-bedf-4d65-a981-0cb8b0726c61-cnibin\") pod \"multus-additional-cni-plugins-6lrlf\" (UID: \"9800c9e0-bedf-4d65-a981-0cb8b0726c61\") " pod="openshift-multus/multus-additional-cni-plugins-6lrlf"
Aug 04 17:46:24.714347 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713857    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh9sz\" (UniqueName: \"kubernetes.io/projected/4ff78307-0cd9-4551-9b67-95943e190bfe-kube-api-access-jh9sz\") pod \"node-resolver-qgjr8\" (UID: \"4ff78307-0cd9-4551-9b67-95943e190bfe\") " pod="openshift-dns/node-resolver-qgjr8"
Aug 04 17:46:24.714347 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713867    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9800c9e0-bedf-4d65-a981-0cb8b0726c61-system-cni-dir\") pod \"multus-additional-cni-plugins-6lrlf\" (UID: \"9800c9e0-bedf-4d65-a981-0cb8b0726c61\") " pod="openshift-multus/multus-additional-cni-plugins-6lrlf"
Aug 04 17:46:24.714347 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713880    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbf8aa50-191e-49a4-8a78-c03a83900d95-host\") pod \"node-ca-64wn5\" (UID: \"fbf8aa50-191e-49a4-8a78-c03a83900d95\") " pod="openshift-image-registry/node-ca-64wn5"
Aug 04 17:46:24.714347 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713909    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9800c9e0-bedf-4d65-a981-0cb8b0726c61-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6lrlf\" (UID: \"9800c9e0-bedf-4d65-a981-0cb8b0726c61\") " pod="openshift-multus/multus-additional-cni-plugins-6lrlf"
Aug 04 17:46:24.714347 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713916    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9800c9e0-bedf-4d65-a981-0cb8b0726c61-cnibin\") pod \"multus-additional-cni-plugins-6lrlf\" (UID: \"9800c9e0-bedf-4d65-a981-0cb8b0726c61\") " pod="openshift-multus/multus-additional-cni-plugins-6lrlf"
Aug 04 17:46:24.714347 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713940    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcjj5\" (UniqueName: \"kubernetes.io/projected/cec46231-ba14-4b07-b2b1-df119f58db12-kube-api-access-dcjj5\") pod \"network-metrics-daemon-bqph9\" (UID: \"cec46231-ba14-4b07-b2b1-df119f58db12\") " pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:46:24.714347 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713967    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-os-release\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.714347 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713990    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hkmq\" (UniqueName: \"kubernetes.io/projected/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-kube-api-access-2hkmq\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.714347 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.713993    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-multus-daemon-config\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.714347 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714015    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4ff78307-0cd9-4551-9b67-95943e190bfe-hosts-file\") pod \"node-resolver-qgjr8\" (UID: \"4ff78307-0cd9-4551-9b67-95943e190bfe\") " pod="openshift-dns/node-resolver-qgjr8"
Aug 04 17:46:24.714347 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714041    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-host-var-lib-cni-multus\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.714347 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714057    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-os-release\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.715165 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714066    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-host-var-lib-kubelet\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.715165 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714078    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-cni-binary-copy\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.715165 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714091    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-host-run-ovn-kubernetes\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.715165 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714111    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4ff78307-0cd9-4551-9b67-95943e190bfe-hosts-file\") pod \"node-resolver-qgjr8\" (UID: \"4ff78307-0cd9-4551-9b67-95943e190bfe\") " pod="openshift-dns/node-resolver-qgjr8"
Aug 04 17:46:24.715165 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714117    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cec46231-ba14-4b07-b2b1-df119f58db12-metrics-certs\") pod \"network-metrics-daemon-bqph9\" (UID: \"cec46231-ba14-4b07-b2b1-df119f58db12\") " pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:46:24.715165 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714133    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-etc-kubernetes\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.715165 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714137    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-host-var-lib-kubelet\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.715165 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714141    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-host-var-lib-cni-multus\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.715165 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714149    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpcrc\" (UniqueName: \"kubernetes.io/projected/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-kube-api-access-cpcrc\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.715165 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714183    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-etc-kubernetes\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.715165 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714196    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-lib-modules\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.715165 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:24.714208    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:46:24.715165 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714226    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9800c9e0-bedf-4d65-a981-0cb8b0726c61-os-release\") pod \"multus-additional-cni-plugins-6lrlf\" (UID: \"9800c9e0-bedf-4d65-a981-0cb8b0726c61\") " pod="openshift-multus/multus-additional-cni-plugins-6lrlf"
Aug 04 17:46:24.715165 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:24.714271    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cec46231-ba14-4b07-b2b1-df119f58db12-metrics-certs podName:cec46231-ba14-4b07-b2b1-df119f58db12 nodeName:}" failed. No retries permitted until 2026-08-04 17:46:25.214238022 +0000 UTC m=+2.015374369 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cec46231-ba14-4b07-b2b1-df119f58db12-metrics-certs") pod "network-metrics-daemon-bqph9" (UID: "cec46231-ba14-4b07-b2b1-df119f58db12") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:46:24.715165 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714288    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/466aca21-890a-48c7-ba36-047a46e4bf38-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q4tcn\" (UID: \"466aca21-890a-48c7-ba36-047a46e4bf38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4tcn"
Aug 04 17:46:24.715165 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714293    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9800c9e0-bedf-4d65-a981-0cb8b0726c61-os-release\") pod \"multus-additional-cni-plugins-6lrlf\" (UID: \"9800c9e0-bedf-4d65-a981-0cb8b0726c61\") " pod="openshift-multus/multus-additional-cni-plugins-6lrlf"
Aug 04 17:46:24.715165 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714306    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/466aca21-890a-48c7-ba36-047a46e4bf38-socket-dir\") pod \"aws-ebs-csi-driver-node-q4tcn\" (UID: \"466aca21-890a-48c7-ba36-047a46e4bf38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4tcn"
Aug 04 17:46:24.715880 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714322    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-cnibin\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.715880 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714343    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-multus-socket-dir-parent\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.715880 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714346    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/466aca21-890a-48c7-ba36-047a46e4bf38-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q4tcn\" (UID: \"466aca21-890a-48c7-ba36-047a46e4bf38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4tcn"
Aug 04 17:46:24.715880 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714359    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-etc-modprobe-d\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.715880 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714376    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-etc-systemd\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.715880 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714383    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-cnibin\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.715880 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714394    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/175017d4-1fb6-4129-b96f-4990959c3a8b-dbus\") pod \"global-pull-secret-syncer-pm47l\" (UID: \"175017d4-1fb6-4129-b96f-4990959c3a8b\") " pod="kube-system/global-pull-secret-syncer-pm47l"
Aug 04 17:46:24.715880 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714399    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/466aca21-890a-48c7-ba36-047a46e4bf38-socket-dir\") pod \"aws-ebs-csi-driver-node-q4tcn\" (UID: \"466aca21-890a-48c7-ba36-047a46e4bf38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4tcn"
Aug 04 17:46:24.715880 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714427    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-system-cni-dir\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.715880 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714445    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-multus-socket-dir-parent\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.715880 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714456    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9800c9e0-bedf-4d65-a981-0cb8b0726c61-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6lrlf\" (UID: \"9800c9e0-bedf-4d65-a981-0cb8b0726c61\") " pod="openshift-multus/multus-additional-cni-plugins-6lrlf"
Aug 04 17:46:24.715880 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714458    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-host-run-k8s-cni-cncf-io\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.715880 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714483    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-host-run-k8s-cni-cncf-io\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.715880 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714496    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-host-run-multus-certs\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.715880 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714527    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7f50c49e-31bc-4d7f-bfe0-24f72a99c129-iptables-alerter-script\") pod \"iptables-alerter-mvqbx\" (UID: \"7f50c49e-31bc-4d7f-bfe0-24f72a99c129\") " pod="openshift-network-operator/iptables-alerter-mvqbx"
Aug 04 17:46:24.715880 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714515    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-system-cni-dir\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.715880 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714548    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-run-ovn\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.716381 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714568    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-host-run-multus-certs\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.716381 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714566    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-host-cni-bin\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.716381 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714607    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fbf8aa50-191e-49a4-8a78-c03a83900d95-serviceca\") pod \"node-ca-64wn5\" (UID: \"fbf8aa50-191e-49a4-8a78-c03a83900d95\") " pod="openshift-image-registry/node-ca-64wn5"
Aug 04 17:46:24.716381 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714624    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/466aca21-890a-48c7-ba36-047a46e4bf38-etc-selinux\") pod \"aws-ebs-csi-driver-node-q4tcn\" (UID: \"466aca21-890a-48c7-ba36-047a46e4bf38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4tcn"
Aug 04 17:46:24.716381 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714641    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-host-var-lib-cni-bin\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.716381 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714658    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-host-cni-netd\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.716381 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714682    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/69dd0780-85db-48ac-adc9-eef4e735e68d-ovnkube-script-lib\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.716381 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714703    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-etc-sysctl-conf\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.716381 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714724    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/59068cff-9e8e-4aa6-af07-d08f484171e9-agent-certs\") pod \"konnectivity-agent-xq7xp\" (UID: \"59068cff-9e8e-4aa6-af07-d08f484171e9\") " pod="kube-system/konnectivity-agent-xq7xp"
Aug 04 17:46:24.716381 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714726    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-host-var-lib-cni-bin\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.716381 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714752    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9800c9e0-bedf-4d65-a981-0cb8b0726c61-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6lrlf\" (UID: \"9800c9e0-bedf-4d65-a981-0cb8b0726c61\") " pod="openshift-multus/multus-additional-cni-plugins-6lrlf"
Aug 04 17:46:24.716381 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714752    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/466aca21-890a-48c7-ba36-047a46e4bf38-etc-selinux\") pod \"aws-ebs-csi-driver-node-q4tcn\" (UID: \"466aca21-890a-48c7-ba36-047a46e4bf38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4tcn"
Aug 04 17:46:24.716381 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714786    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9800c9e0-bedf-4d65-a981-0cb8b0726c61-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6lrlf\" (UID: \"9800c9e0-bedf-4d65-a981-0cb8b0726c61\") " pod="openshift-multus/multus-additional-cni-plugins-6lrlf"
Aug 04 17:46:24.716381 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714812    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-host-run-netns\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.716381 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714856    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-host-run-netns\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.716381 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714855    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-etc-sysconfig\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.716381 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714885    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/175017d4-1fb6-4129-b96f-4990959c3a8b-original-pull-secret\") pod \"global-pull-secret-syncer-pm47l\" (UID: \"175017d4-1fb6-4129-b96f-4990959c3a8b\") " pod="kube-system/global-pull-secret-syncer-pm47l"
Aug 04 17:46:24.716958 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.714898    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9800c9e0-bedf-4d65-a981-0cb8b0726c61-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6lrlf\" (UID: \"9800c9e0-bedf-4d65-a981-0cb8b0726c61\") " pod="openshift-multus/multus-additional-cni-plugins-6lrlf"
Aug 04 17:46:24.716958 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.715306    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9800c9e0-bedf-4d65-a981-0cb8b0726c61-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6lrlf\" (UID: \"9800c9e0-bedf-4d65-a981-0cb8b0726c61\") " pod="openshift-multus/multus-additional-cni-plugins-6lrlf"
Aug 04 17:46:24.718954 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.718936    2571 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Aug 04 17:46:24.722831 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.722745    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh9sz\" (UniqueName: \"kubernetes.io/projected/4ff78307-0cd9-4551-9b67-95943e190bfe-kube-api-access-jh9sz\") pod \"node-resolver-qgjr8\" (UID: \"4ff78307-0cd9-4551-9b67-95943e190bfe\") " pod="openshift-dns/node-resolver-qgjr8"
Aug 04 17:46:24.722831 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.722782    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcjj5\" (UniqueName: \"kubernetes.io/projected/cec46231-ba14-4b07-b2b1-df119f58db12-kube-api-access-dcjj5\") pod \"network-metrics-daemon-bqph9\" (UID: \"cec46231-ba14-4b07-b2b1-df119f58db12\") " pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:46:24.723021 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.722998    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rmx4\" (UniqueName: \"kubernetes.io/projected/9800c9e0-bedf-4d65-a981-0cb8b0726c61-kube-api-access-7rmx4\") pod \"multus-additional-cni-plugins-6lrlf\" (UID: \"9800c9e0-bedf-4d65-a981-0cb8b0726c61\") " pod="openshift-multus/multus-additional-cni-plugins-6lrlf"
Aug 04 17:46:24.723161 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.723141    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lnvb\" (UniqueName: \"kubernetes.io/projected/466aca21-890a-48c7-ba36-047a46e4bf38-kube-api-access-8lnvb\") pod \"aws-ebs-csi-driver-node-q4tcn\" (UID: \"466aca21-890a-48c7-ba36-047a46e4bf38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4tcn"
Aug 04 17:46:24.723463 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.723446    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpcrc\" (UniqueName: \"kubernetes.io/projected/72c8d5dc-4be4-4f9a-9cc3-51444e78301a-kube-api-access-cpcrc\") pod \"multus-48dc2\" (UID: \"72c8d5dc-4be4-4f9a-9cc3-51444e78301a\") " pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.815994 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.815968    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqmr8\" (UniqueName: \"kubernetes.io/projected/7f50c49e-31bc-4d7f-bfe0-24f72a99c129-kube-api-access-fqmr8\") pod \"iptables-alerter-mvqbx\" (UID: \"7f50c49e-31bc-4d7f-bfe0-24f72a99c129\") " pod="openshift-network-operator/iptables-alerter-mvqbx"
Aug 04 17:46:24.816096 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.816000    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-node-log\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.816096 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.816023    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-etc-tuned\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.816231 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.816102    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-node-log\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.816231 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.816154    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-etc-sysctl-d\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.816231 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.816195    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f50c49e-31bc-4d7f-bfe0-24f72a99c129-host-slash\") pod \"iptables-alerter-mvqbx\" (UID: \"7f50c49e-31bc-4d7f-bfe0-24f72a99c129\") " pod="openshift-network-operator/iptables-alerter-mvqbx"
Aug 04 17:46:24.816231 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.816225    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-log-socket\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.816457 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.816251    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.816457 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.816280    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/69dd0780-85db-48ac-adc9-eef4e735e68d-ovn-node-metrics-cert\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.816457 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.816289    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-log-socket\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.816457 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.816238    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f50c49e-31bc-4d7f-bfe0-24f72a99c129-host-slash\") pod \"iptables-alerter-mvqbx\" (UID: \"7f50c49e-31bc-4d7f-bfe0-24f72a99c129\") " pod="openshift-network-operator/iptables-alerter-mvqbx"
Aug 04 17:46:24.816457 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.816314    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-systemd-units\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.816457 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.816281    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-etc-sysctl-d\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.816457 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.816334    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-etc-openvswitch\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.816457 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.816349    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-var-lib-kubelet\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.816457 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.816346    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.816457 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.816366    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/59068cff-9e8e-4aa6-af07-d08f484171e9-konnectivity-ca\") pod \"konnectivity-agent-xq7xp\" (UID: \"59068cff-9e8e-4aa6-af07-d08f484171e9\") " pod="kube-system/konnectivity-agent-xq7xp"
Aug 04 17:46:24.816457 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.816373    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-systemd-units\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.816457 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.816392    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8lxr\" (UniqueName: \"kubernetes.io/projected/fbf8aa50-191e-49a4-8a78-c03a83900d95-kube-api-access-p8lxr\") pod \"node-ca-64wn5\" (UID: \"fbf8aa50-191e-49a4-8a78-c03a83900d95\") " pod="openshift-image-registry/node-ca-64wn5"
Aug 04 17:46:24.816457 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.816395    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-etc-openvswitch\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.816457 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.816412    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-var-lib-kubelet\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.816457 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.816447    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-host-kubelet\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.817325 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.816475    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-run-openvswitch\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.817325 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.816500    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/69dd0780-85db-48ac-adc9-eef4e735e68d-env-overrides\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.817325 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.816512    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-host-kubelet\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.817325 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.816524    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-run\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.817325 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.816581    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjgxv\" (UniqueName: \"kubernetes.io/projected/a63fe4d6-9f64-4faa-bef7-93be6cde4970-kube-api-access-sjgxv\") pod \"network-check-target-qqhjm\" (UID: \"a63fe4d6-9f64-4faa-bef7-93be6cde4970\") " pod="openshift-network-diagnostics/network-check-target-qqhjm"
Aug 04 17:46:24.817325 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.816606    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-run\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.817325 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.816609    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/175017d4-1fb6-4129-b96f-4990959c3a8b-kubelet-config\") pod \"global-pull-secret-syncer-pm47l\" (UID: \"175017d4-1fb6-4129-b96f-4990959c3a8b\") " pod="kube-system/global-pull-secret-syncer-pm47l"
Aug 04 17:46:24.817325 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.816657    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-run-systemd\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.817325 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.816623    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-run-openvswitch\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.817325 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.816806    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/175017d4-1fb6-4129-b96f-4990959c3a8b-kubelet-config\") pod \"global-pull-secret-syncer-pm47l\" (UID: \"175017d4-1fb6-4129-b96f-4990959c3a8b\") " pod="kube-system/global-pull-secret-syncer-pm47l"
Aug 04 17:46:24.817325 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.816860    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-run-systemd\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.817325 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.816890    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj4dk\" (UniqueName: \"kubernetes.io/projected/69dd0780-85db-48ac-adc9-eef4e735e68d-kube-api-access-rj4dk\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.817325 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.816917    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-sys\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.817325 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.816935    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/59068cff-9e8e-4aa6-af07-d08f484171e9-konnectivity-ca\") pod \"konnectivity-agent-xq7xp\" (UID: \"59068cff-9e8e-4aa6-af07-d08f484171e9\") " pod="kube-system/konnectivity-agent-xq7xp"
Aug 04 17:46:24.817325 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.816966    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-sys\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.817325 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817048    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-host\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.817325 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817073    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-host-slash\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.817325 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817098    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-host-run-netns\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.818293 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817133    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-host-run-netns\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.818293 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817140    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-host-slash\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.818293 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817152    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-host\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.818293 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817178    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-var-lib-openvswitch\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.818293 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817177    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/69dd0780-85db-48ac-adc9-eef4e735e68d-env-overrides\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.818293 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817197    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/69dd0780-85db-48ac-adc9-eef4e735e68d-ovnkube-config\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.818293 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817213    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-etc-kubernetes\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.818293 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817241    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-tmp\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.818293 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817261    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-var-lib-openvswitch\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.818293 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817274    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbf8aa50-191e-49a4-8a78-c03a83900d95-host\") pod \"node-ca-64wn5\" (UID: \"fbf8aa50-191e-49a4-8a78-c03a83900d95\") " pod="openshift-image-registry/node-ca-64wn5"
Aug 04 17:46:24.818293 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817305    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-etc-kubernetes\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.818293 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817306    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hkmq\" (UniqueName: \"kubernetes.io/projected/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-kube-api-access-2hkmq\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.818293 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817332    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbf8aa50-191e-49a4-8a78-c03a83900d95-host\") pod \"node-ca-64wn5\" (UID: \"fbf8aa50-191e-49a4-8a78-c03a83900d95\") " pod="openshift-image-registry/node-ca-64wn5"
Aug 04 17:46:24.818293 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817336    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-host-run-ovn-kubernetes\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.818293 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817376    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-lib-modules\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.818293 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817404    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-etc-modprobe-d\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.818293 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817427    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-etc-systemd\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.818293 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817472    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-host-run-ovn-kubernetes\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.819230 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817521    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/175017d4-1fb6-4129-b96f-4990959c3a8b-dbus\") pod \"global-pull-secret-syncer-pm47l\" (UID: \"175017d4-1fb6-4129-b96f-4990959c3a8b\") " pod="kube-system/global-pull-secret-syncer-pm47l"
Aug 04 17:46:24.819230 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817525    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-etc-modprobe-d\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.819230 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817551    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-etc-systemd\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.819230 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817570    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7f50c49e-31bc-4d7f-bfe0-24f72a99c129-iptables-alerter-script\") pod \"iptables-alerter-mvqbx\" (UID: \"7f50c49e-31bc-4d7f-bfe0-24f72a99c129\") " pod="openshift-network-operator/iptables-alerter-mvqbx"
Aug 04 17:46:24.819230 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817597    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-run-ovn\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.819230 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817609    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/175017d4-1fb6-4129-b96f-4990959c3a8b-dbus\") pod \"global-pull-secret-syncer-pm47l\" (UID: \"175017d4-1fb6-4129-b96f-4990959c3a8b\") " pod="kube-system/global-pull-secret-syncer-pm47l"
Aug 04 17:46:24.819230 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817620    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-host-cni-bin\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.819230 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817648    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fbf8aa50-191e-49a4-8a78-c03a83900d95-serviceca\") pod \"node-ca-64wn5\" (UID: \"fbf8aa50-191e-49a4-8a78-c03a83900d95\") " pod="openshift-image-registry/node-ca-64wn5"
Aug 04 17:46:24.819230 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817674    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-host-cni-netd\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.819230 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817681    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-host-cni-bin\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.819230 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817649    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-run-ovn\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.819230 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817699    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/69dd0780-85db-48ac-adc9-eef4e735e68d-ovnkube-script-lib\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.819230 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817724    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-etc-sysctl-conf\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.819230 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817732    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/69dd0780-85db-48ac-adc9-eef4e735e68d-ovnkube-config\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.819230 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817746    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/59068cff-9e8e-4aa6-af07-d08f484171e9-agent-certs\") pod \"konnectivity-agent-xq7xp\" (UID: \"59068cff-9e8e-4aa6-af07-d08f484171e9\") " pod="kube-system/konnectivity-agent-xq7xp"
Aug 04 17:46:24.819230 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817787    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-etc-sysconfig\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.819230 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.817821    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/175017d4-1fb6-4129-b96f-4990959c3a8b-original-pull-secret\") pod \"global-pull-secret-syncer-pm47l\" (UID: \"175017d4-1fb6-4129-b96f-4990959c3a8b\") " pod="kube-system/global-pull-secret-syncer-pm47l"
Aug 04 17:46:24.819230 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:24.817951    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 17:46:24.820268 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:24.818023    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/175017d4-1fb6-4129-b96f-4990959c3a8b-original-pull-secret podName:175017d4-1fb6-4129-b96f-4990959c3a8b nodeName:}" failed. No retries permitted until 2026-08-04 17:46:25.317992141 +0000 UTC m=+2.119128468 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/175017d4-1fb6-4129-b96f-4990959c3a8b-original-pull-secret") pod "global-pull-secret-syncer-pm47l" (UID: "175017d4-1fb6-4129-b96f-4990959c3a8b") : object "kube-system"/"original-pull-secret" not registered
Aug 04 17:46:24.820268 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.818135    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7f50c49e-31bc-4d7f-bfe0-24f72a99c129-iptables-alerter-script\") pod \"iptables-alerter-mvqbx\" (UID: \"7f50c49e-31bc-4d7f-bfe0-24f72a99c129\") " pod="openshift-network-operator/iptables-alerter-mvqbx"
Aug 04 17:46:24.820268 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.818231    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-etc-sysconfig\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.820268 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.818392    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-etc-sysctl-conf\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.820268 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.818427    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-etc-tuned\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.820268 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.818445    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fbf8aa50-191e-49a4-8a78-c03a83900d95-serviceca\") pod \"node-ca-64wn5\" (UID: \"fbf8aa50-191e-49a4-8a78-c03a83900d95\") " pod="openshift-image-registry/node-ca-64wn5"
Aug 04 17:46:24.820268 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.818451    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/69dd0780-85db-48ac-adc9-eef4e735e68d-host-cni-netd\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.820268 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.818578    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-lib-modules\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.820268 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.818672    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/69dd0780-85db-48ac-adc9-eef4e735e68d-ovnkube-script-lib\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.820268 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.818760    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/69dd0780-85db-48ac-adc9-eef4e735e68d-ovn-node-metrics-cert\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.820268 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.819571    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-tmp\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.820268 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.819968    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/59068cff-9e8e-4aa6-af07-d08f484171e9-agent-certs\") pod \"konnectivity-agent-xq7xp\" (UID: \"59068cff-9e8e-4aa6-af07-d08f484171e9\") " pod="kube-system/konnectivity-agent-xq7xp"
Aug 04 17:46:24.823124 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:24.823106    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 17:46:24.823124 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:24.823124    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 17:46:24.823294 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:24.823133    2571 projected.go:196] Error preparing data for projected volume kube-api-access-sjgxv for pod openshift-network-diagnostics/network-check-target-qqhjm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:46:24.823294 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:24.823178    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a63fe4d6-9f64-4faa-bef7-93be6cde4970-kube-api-access-sjgxv podName:a63fe4d6-9f64-4faa-bef7-93be6cde4970 nodeName:}" failed. No retries permitted until 2026-08-04 17:46:25.323164648 +0000 UTC m=+2.124300955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-sjgxv" (UniqueName: "kubernetes.io/projected/a63fe4d6-9f64-4faa-bef7-93be6cde4970-kube-api-access-sjgxv") pod "network-check-target-qqhjm" (UID: "a63fe4d6-9f64-4faa-bef7-93be6cde4970") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:46:24.825165 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.825140    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8lxr\" (UniqueName: \"kubernetes.io/projected/fbf8aa50-191e-49a4-8a78-c03a83900d95-kube-api-access-p8lxr\") pod \"node-ca-64wn5\" (UID: \"fbf8aa50-191e-49a4-8a78-c03a83900d95\") " pod="openshift-image-registry/node-ca-64wn5"
Aug 04 17:46:24.825406 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.825387    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj4dk\" (UniqueName: \"kubernetes.io/projected/69dd0780-85db-48ac-adc9-eef4e735e68d-kube-api-access-rj4dk\") pod \"ovnkube-node-lwmwl\" (UID: \"69dd0780-85db-48ac-adc9-eef4e735e68d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:24.826280 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.826265    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hkmq\" (UniqueName: \"kubernetes.io/projected/b58bd571-ff87-4b8a-b59c-e4bcac813d5b-kube-api-access-2hkmq\") pod \"tuned-tr759\" (UID: \"b58bd571-ff87-4b8a-b59c-e4bcac813d5b\") " pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:24.826676 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.826654    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqmr8\" (UniqueName: \"kubernetes.io/projected/7f50c49e-31bc-4d7f-bfe0-24f72a99c129-kube-api-access-fqmr8\") pod \"iptables-alerter-mvqbx\" (UID: \"7f50c49e-31bc-4d7f-bfe0-24f72a99c129\") " pod="openshift-network-operator/iptables-alerter-mvqbx"
Aug 04 17:46:24.943744 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.943693    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-48dc2"
Aug 04 17:46:24.958485 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.958466    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6lrlf"
Aug 04 17:46:24.975214 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.975191    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4tcn"
Aug 04 17:46:24.987650 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:24.987631    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qgjr8"
Aug 04 17:46:25.007633 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:25.007617    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-64wn5"
Aug 04 17:46:25.023413 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:25.023393    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mvqbx"
Aug 04 17:46:25.045301 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:25.045279    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:25.065113 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:25.065089    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xq7xp"
Aug 04 17:46:25.068985 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:25.068968    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tr759"
Aug 04 17:46:25.139724 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:25.139700    2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 17:46:25.210119 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:25.210083    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38e66965b8a5bfd304ca9eefbb3544fa.slice/crio-29bd2c9fc0d5c639ab9b3c01e78f0c20238da65b5cae43618594ddf46b41a2c8 WatchSource:0}: Error finding container 29bd2c9fc0d5c639ab9b3c01e78f0c20238da65b5cae43618594ddf46b41a2c8: Status 404 returned error can't find the container with id 29bd2c9fc0d5c639ab9b3c01e78f0c20238da65b5cae43618594ddf46b41a2c8
Aug 04 17:46:25.210360 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:25.210332    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd50d574671ac25d0c57a314e2746b629.slice/crio-ce067fa05dc09bc10514c5142a8961e32feecdecd66a374092f0658521859b7c WatchSource:0}: Error finding container ce067fa05dc09bc10514c5142a8961e32feecdecd66a374092f0658521859b7c: Status 404 returned error can't find the container with id ce067fa05dc09bc10514c5142a8961e32feecdecd66a374092f0658521859b7c
Aug 04 17:46:25.214934 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:25.214916    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 17:46:25.220980 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:25.220962    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cec46231-ba14-4b07-b2b1-df119f58db12-metrics-certs\") pod \"network-metrics-daemon-bqph9\" (UID: \"cec46231-ba14-4b07-b2b1-df119f58db12\") " pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:46:25.221069 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:25.221057    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:46:25.221119 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:25.221109    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cec46231-ba14-4b07-b2b1-df119f58db12-metrics-certs podName:cec46231-ba14-4b07-b2b1-df119f58db12 nodeName:}" failed. No retries permitted until 2026-08-04 17:46:26.221092262 +0000 UTC m=+3.022228570 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cec46231-ba14-4b07-b2b1-df119f58db12-metrics-certs") pod "network-metrics-daemon-bqph9" (UID: "cec46231-ba14-4b07-b2b1-df119f58db12") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:46:25.321211 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:25.321187    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/175017d4-1fb6-4129-b96f-4990959c3a8b-original-pull-secret\") pod \"global-pull-secret-syncer-pm47l\" (UID: \"175017d4-1fb6-4129-b96f-4990959c3a8b\") " pod="kube-system/global-pull-secret-syncer-pm47l"
Aug 04 17:46:25.321333 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:25.321318    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 17:46:25.321385 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:25.321374    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/175017d4-1fb6-4129-b96f-4990959c3a8b-original-pull-secret podName:175017d4-1fb6-4129-b96f-4990959c3a8b nodeName:}" failed. No retries permitted until 2026-08-04 17:46:26.321356521 +0000 UTC m=+3.122492842 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/175017d4-1fb6-4129-b96f-4990959c3a8b-original-pull-secret") pod "global-pull-secret-syncer-pm47l" (UID: "175017d4-1fb6-4129-b96f-4990959c3a8b") : object "kube-system"/"original-pull-secret" not registered
Aug 04 17:46:25.347940 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:25.347909    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72c8d5dc_4be4_4f9a_9cc3_51444e78301a.slice/crio-e6285fda84b5a81535af820c86d13faffe894d6d009de39c37e44cfa97a4b53e WatchSource:0}: Error finding container e6285fda84b5a81535af820c86d13faffe894d6d009de39c37e44cfa97a4b53e: Status 404 returned error can't find the container with id e6285fda84b5a81535af820c86d13faffe894d6d009de39c37e44cfa97a4b53e
Aug 04 17:46:25.377272 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:25.377250    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ff78307_0cd9_4551_9b67_95943e190bfe.slice/crio-4c794edc5e85615c61143ca3e29f9b83f28a7aa40e0df9d5d2b48d7ebb67d6ea WatchSource:0}: Error finding container 4c794edc5e85615c61143ca3e29f9b83f28a7aa40e0df9d5d2b48d7ebb67d6ea: Status 404 returned error can't find the container with id 4c794edc5e85615c61143ca3e29f9b83f28a7aa40e0df9d5d2b48d7ebb67d6ea
Aug 04 17:46:25.384114 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:25.384092    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod466aca21_890a_48c7_ba36_047a46e4bf38.slice/crio-8821943d3a09cf44af9ddd923786a491457438ff74f881c2f9317180f5c2a5c6 WatchSource:0}: Error finding container 8821943d3a09cf44af9ddd923786a491457438ff74f881c2f9317180f5c2a5c6: Status 404 returned error can't find the container with id 8821943d3a09cf44af9ddd923786a491457438ff74f881c2f9317180f5c2a5c6
Aug 04 17:46:25.422179 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:25.422152    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjgxv\" (UniqueName: \"kubernetes.io/projected/a63fe4d6-9f64-4faa-bef7-93be6cde4970-kube-api-access-sjgxv\") pod \"network-check-target-qqhjm\" (UID: \"a63fe4d6-9f64-4faa-bef7-93be6cde4970\") " pod="openshift-network-diagnostics/network-check-target-qqhjm"
Aug 04 17:46:25.422308 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:25.422295    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 17:46:25.422350 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:25.422316    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 17:46:25.422350 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:25.422326    2571 projected.go:196] Error preparing data for projected volume kube-api-access-sjgxv for pod openshift-network-diagnostics/network-check-target-qqhjm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:46:25.422427 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:25.422365    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a63fe4d6-9f64-4faa-bef7-93be6cde4970-kube-api-access-sjgxv podName:a63fe4d6-9f64-4faa-bef7-93be6cde4970 nodeName:}" failed. No retries permitted until 2026-08-04 17:46:26.422353242 +0000 UTC m=+3.223489554 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-sjgxv" (UniqueName: "kubernetes.io/projected/a63fe4d6-9f64-4faa-bef7-93be6cde4970-kube-api-access-sjgxv") pod "network-check-target-qqhjm" (UID: "a63fe4d6-9f64-4faa-bef7-93be6cde4970") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:46:25.429963 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:25.429936    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9800c9e0_bedf_4d65_a981_0cb8b0726c61.slice/crio-a7a04f20c9d0581c13b52decc91e41aa9ac1033f037f263fad5cc304d8f1340d WatchSource:0}: Error finding container a7a04f20c9d0581c13b52decc91e41aa9ac1033f037f263fad5cc304d8f1340d: Status 404 returned error can't find the container with id a7a04f20c9d0581c13b52decc91e41aa9ac1033f037f263fad5cc304d8f1340d
Aug 04 17:46:25.431310 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:25.431279    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbf8aa50_191e_49a4_8a78_c03a83900d95.slice/crio-1fdd4d74feb92f3978698d13afcf8926b3c253876e00a184e7ba396cb2890597 WatchSource:0}: Error finding container 1fdd4d74feb92f3978698d13afcf8926b3c253876e00a184e7ba396cb2890597: Status 404 returned error can't find the container with id 1fdd4d74feb92f3978698d13afcf8926b3c253876e00a184e7ba396cb2890597
Aug 04 17:46:25.475406 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:25.475385    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f50c49e_31bc_4d7f_bfe0_24f72a99c129.slice/crio-5307ad35ac60fb304f459cd867f02589d9e81acfaf1bada85a3ee8fe69262cfe WatchSource:0}: Error finding container 5307ad35ac60fb304f459cd867f02589d9e81acfaf1bada85a3ee8fe69262cfe: Status 404 returned error can't find the container with id 5307ad35ac60fb304f459cd867f02589d9e81acfaf1bada85a3ee8fe69262cfe
Aug 04 17:46:25.493629 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:25.493610    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69dd0780_85db_48ac_adc9_eef4e735e68d.slice/crio-f843534cce769dc83925aeb96eaf23eb24626bc390273b90b286dcd7690e423b WatchSource:0}: Error finding container f843534cce769dc83925aeb96eaf23eb24626bc390273b90b286dcd7690e423b: Status 404 returned error can't find the container with id f843534cce769dc83925aeb96eaf23eb24626bc390273b90b286dcd7690e423b
Aug 04 17:46:25.613293 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:25.613271    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59068cff_9e8e_4aa6_af07_d08f484171e9.slice/crio-ded0377f595f5bd8af8ee979519aecee5759aa50162d13ceb84670129ac5ef7b WatchSource:0}: Error finding container ded0377f595f5bd8af8ee979519aecee5759aa50162d13ceb84670129ac5ef7b: Status 404 returned error can't find the container with id ded0377f595f5bd8af8ee979519aecee5759aa50162d13ceb84670129ac5ef7b
Aug 04 17:46:25.653909 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:25.653877    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 17:41:25 +0000 UTC" deadline="2028-02-01 19:55:33.848069312 +0000 UTC"
Aug 04 17:46:25.653909 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:25.653904    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13106h9m8.194168518s"
Aug 04 17:46:25.880129 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:25.879708    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqhjm"
Aug 04 17:46:25.880129 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:25.879831    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqhjm" podUID="a63fe4d6-9f64-4faa-bef7-93be6cde4970"
Aug 04 17:46:25.880129 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:25.879911    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm47l"
Aug 04 17:46:25.880129 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:25.880035    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pm47l" podUID="175017d4-1fb6-4129-b96f-4990959c3a8b"
Aug 04 17:46:25.883074 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:25.882985    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xq7xp" event={"ID":"59068cff-9e8e-4aa6-af07-d08f484171e9","Type":"ContainerStarted","Data":"ded0377f595f5bd8af8ee979519aecee5759aa50162d13ceb84670129ac5ef7b"}
Aug 04 17:46:25.884996 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:25.884968    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl" event={"ID":"69dd0780-85db-48ac-adc9-eef4e735e68d","Type":"ContainerStarted","Data":"f843534cce769dc83925aeb96eaf23eb24626bc390273b90b286dcd7690e423b"}
Aug 04 17:46:25.887144 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:25.887082    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mvqbx" event={"ID":"7f50c49e-31bc-4d7f-bfe0-24f72a99c129","Type":"ContainerStarted","Data":"5307ad35ac60fb304f459cd867f02589d9e81acfaf1bada85a3ee8fe69262cfe"}
Aug 04 17:46:25.888766 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:25.888737    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-64wn5" event={"ID":"fbf8aa50-191e-49a4-8a78-c03a83900d95","Type":"ContainerStarted","Data":"1fdd4d74feb92f3978698d13afcf8926b3c253876e00a184e7ba396cb2890597"}
Aug 04 17:46:25.890200 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:25.890173    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6lrlf" event={"ID":"9800c9e0-bedf-4d65-a981-0cb8b0726c61","Type":"ContainerStarted","Data":"a7a04f20c9d0581c13b52decc91e41aa9ac1033f037f263fad5cc304d8f1340d"}
Aug 04 17:46:25.892742 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:25.892718    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4tcn" event={"ID":"466aca21-890a-48c7-ba36-047a46e4bf38","Type":"ContainerStarted","Data":"8821943d3a09cf44af9ddd923786a491457438ff74f881c2f9317180f5c2a5c6"}
Aug 04 17:46:25.894403 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:25.894378    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qgjr8" event={"ID":"4ff78307-0cd9-4551-9b67-95943e190bfe","Type":"ContainerStarted","Data":"4c794edc5e85615c61143ca3e29f9b83f28a7aa40e0df9d5d2b48d7ebb67d6ea"}
Aug 04 17:46:25.897615 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:25.897591    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal" event={"ID":"d50d574671ac25d0c57a314e2746b629","Type":"ContainerStarted","Data":"ce067fa05dc09bc10514c5142a8961e32feecdecd66a374092f0658521859b7c"}
Aug 04 17:46:25.899747 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:25.899723    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-48dc2" event={"ID":"72c8d5dc-4be4-4f9a-9cc3-51444e78301a","Type":"ContainerStarted","Data":"e6285fda84b5a81535af820c86d13faffe894d6d009de39c37e44cfa97a4b53e"}
Aug 04 17:46:25.906765 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:25.906739    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal" event={"ID":"38e66965b8a5bfd304ca9eefbb3544fa","Type":"ContainerStarted","Data":"29bd2c9fc0d5c639ab9b3c01e78f0c20238da65b5cae43618594ddf46b41a2c8"}
Aug 04 17:46:25.911623 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:25.911585    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 17:46:25.942068 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:25.942042    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb58bd571_ff87_4b8a_b59c_e4bcac813d5b.slice/crio-7dd1399d25e964bba1ca0cb549cda0714b12a4df376720cf08188e076c014a7c WatchSource:0}: Error finding container 7dd1399d25e964bba1ca0cb549cda0714b12a4df376720cf08188e076c014a7c: Status 404 returned error can't find the container with id 7dd1399d25e964bba1ca0cb549cda0714b12a4df376720cf08188e076c014a7c
Aug 04 17:46:26.227767 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:26.227683    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cec46231-ba14-4b07-b2b1-df119f58db12-metrics-certs\") pod \"network-metrics-daemon-bqph9\" (UID: \"cec46231-ba14-4b07-b2b1-df119f58db12\") " pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:46:26.227940 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:26.227881    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:46:26.228006 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:26.227981    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cec46231-ba14-4b07-b2b1-df119f58db12-metrics-certs podName:cec46231-ba14-4b07-b2b1-df119f58db12 nodeName:}" failed. No retries permitted until 2026-08-04 17:46:28.227958253 +0000 UTC m=+5.029094564 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cec46231-ba14-4b07-b2b1-df119f58db12-metrics-certs") pod "network-metrics-daemon-bqph9" (UID: "cec46231-ba14-4b07-b2b1-df119f58db12") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:46:26.328592 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:26.328556    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/175017d4-1fb6-4129-b96f-4990959c3a8b-original-pull-secret\") pod \"global-pull-secret-syncer-pm47l\" (UID: \"175017d4-1fb6-4129-b96f-4990959c3a8b\") " pod="kube-system/global-pull-secret-syncer-pm47l"
Aug 04 17:46:26.328780 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:26.328737    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 17:46:26.328846 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:26.328799    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/175017d4-1fb6-4129-b96f-4990959c3a8b-original-pull-secret podName:175017d4-1fb6-4129-b96f-4990959c3a8b nodeName:}" failed. No retries permitted until 2026-08-04 17:46:28.328780448 +0000 UTC m=+5.129916759 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/175017d4-1fb6-4129-b96f-4990959c3a8b-original-pull-secret") pod "global-pull-secret-syncer-pm47l" (UID: "175017d4-1fb6-4129-b96f-4990959c3a8b") : object "kube-system"/"original-pull-secret" not registered
Aug 04 17:46:26.429805 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:26.429746    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjgxv\" (UniqueName: \"kubernetes.io/projected/a63fe4d6-9f64-4faa-bef7-93be6cde4970-kube-api-access-sjgxv\") pod \"network-check-target-qqhjm\" (UID: \"a63fe4d6-9f64-4faa-bef7-93be6cde4970\") " pod="openshift-network-diagnostics/network-check-target-qqhjm"
Aug 04 17:46:26.429998 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:26.429973    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 17:46:26.429998 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:26.429995    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 17:46:26.430129 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:26.430010    2571 projected.go:196] Error preparing data for projected volume kube-api-access-sjgxv for pod openshift-network-diagnostics/network-check-target-qqhjm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:46:26.430129 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:26.430082    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a63fe4d6-9f64-4faa-bef7-93be6cde4970-kube-api-access-sjgxv podName:a63fe4d6-9f64-4faa-bef7-93be6cde4970 nodeName:}" failed. No retries permitted until 2026-08-04 17:46:28.430063001 +0000 UTC m=+5.231199332 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-sjgxv" (UniqueName: "kubernetes.io/projected/a63fe4d6-9f64-4faa-bef7-93be6cde4970-kube-api-access-sjgxv") pod "network-check-target-qqhjm" (UID: "a63fe4d6-9f64-4faa-bef7-93be6cde4970") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:46:26.654454 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:26.654310    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 17:41:25 +0000 UTC" deadline="2028-03-12 01:32:01.070728745 +0000 UTC"
Aug 04 17:46:26.654454 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:26.654375    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14047h45m34.416358901s"
Aug 04 17:46:26.875049 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:26.874512    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:46:26.875049 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:26.874675    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqph9" podUID="cec46231-ba14-4b07-b2b1-df119f58db12"
Aug 04 17:46:26.923190 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:26.923099    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tr759" event={"ID":"b58bd571-ff87-4b8a-b59c-e4bcac813d5b","Type":"ContainerStarted","Data":"7dd1399d25e964bba1ca0cb549cda0714b12a4df376720cf08188e076c014a7c"}
Aug 04 17:46:27.684958 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:27.684927    2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 17:46:27.877091 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:27.877044    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqhjm"
Aug 04 17:46:27.877262 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:27.877186    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqhjm" podUID="a63fe4d6-9f64-4faa-bef7-93be6cde4970"
Aug 04 17:46:27.877647 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:27.877624    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm47l"
Aug 04 17:46:27.877774 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:27.877727    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pm47l" podUID="175017d4-1fb6-4129-b96f-4990959c3a8b"
Aug 04 17:46:28.245540 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:28.245456    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cec46231-ba14-4b07-b2b1-df119f58db12-metrics-certs\") pod \"network-metrics-daemon-bqph9\" (UID: \"cec46231-ba14-4b07-b2b1-df119f58db12\") " pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:46:28.245723 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:28.245677    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:46:28.245786 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:28.245738    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cec46231-ba14-4b07-b2b1-df119f58db12-metrics-certs podName:cec46231-ba14-4b07-b2b1-df119f58db12 nodeName:}" failed. No retries permitted until 2026-08-04 17:46:32.245718315 +0000 UTC m=+9.046854629 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cec46231-ba14-4b07-b2b1-df119f58db12-metrics-certs") pod "network-metrics-daemon-bqph9" (UID: "cec46231-ba14-4b07-b2b1-df119f58db12") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:46:28.347434 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:28.346852    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/175017d4-1fb6-4129-b96f-4990959c3a8b-original-pull-secret\") pod \"global-pull-secret-syncer-pm47l\" (UID: \"175017d4-1fb6-4129-b96f-4990959c3a8b\") " pod="kube-system/global-pull-secret-syncer-pm47l"
Aug 04 17:46:28.347434 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:28.347036    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 17:46:28.347434 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:28.347103    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/175017d4-1fb6-4129-b96f-4990959c3a8b-original-pull-secret podName:175017d4-1fb6-4129-b96f-4990959c3a8b nodeName:}" failed. No retries permitted until 2026-08-04 17:46:32.347082182 +0000 UTC m=+9.148218509 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/175017d4-1fb6-4129-b96f-4990959c3a8b-original-pull-secret") pod "global-pull-secret-syncer-pm47l" (UID: "175017d4-1fb6-4129-b96f-4990959c3a8b") : object "kube-system"/"original-pull-secret" not registered
Aug 04 17:46:28.448290 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:28.448256    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjgxv\" (UniqueName: \"kubernetes.io/projected/a63fe4d6-9f64-4faa-bef7-93be6cde4970-kube-api-access-sjgxv\") pod \"network-check-target-qqhjm\" (UID: \"a63fe4d6-9f64-4faa-bef7-93be6cde4970\") " pod="openshift-network-diagnostics/network-check-target-qqhjm"
Aug 04 17:46:28.448475 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:28.448414    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 17:46:28.448475 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:28.448435    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 17:46:28.448475 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:28.448447    2571 projected.go:196] Error preparing data for projected volume kube-api-access-sjgxv for pod openshift-network-diagnostics/network-check-target-qqhjm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:46:28.448703 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:28.448500    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a63fe4d6-9f64-4faa-bef7-93be6cde4970-kube-api-access-sjgxv podName:a63fe4d6-9f64-4faa-bef7-93be6cde4970 nodeName:}" failed. No retries permitted until 2026-08-04 17:46:32.448483004 +0000 UTC m=+9.249619312 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-sjgxv" (UniqueName: "kubernetes.io/projected/a63fe4d6-9f64-4faa-bef7-93be6cde4970-kube-api-access-sjgxv") pod "network-check-target-qqhjm" (UID: "a63fe4d6-9f64-4faa-bef7-93be6cde4970") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:46:28.874744 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:28.874664    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:46:28.875215 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:28.874839    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqph9" podUID="cec46231-ba14-4b07-b2b1-df119f58db12"
Aug 04 17:46:29.874887 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:29.874855    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqhjm"
Aug 04 17:46:29.875338 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:29.874987    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqhjm" podUID="a63fe4d6-9f64-4faa-bef7-93be6cde4970"
Aug 04 17:46:29.875399 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:29.875370    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm47l"
Aug 04 17:46:29.875489 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:29.875467    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pm47l" podUID="175017d4-1fb6-4129-b96f-4990959c3a8b"
Aug 04 17:46:30.874879 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:30.874797    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:46:30.875077 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:30.874932    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqph9" podUID="cec46231-ba14-4b07-b2b1-df119f58db12"
Aug 04 17:46:31.874917 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:31.874752    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqhjm"
Aug 04 17:46:31.874917 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:31.874878    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqhjm" podUID="a63fe4d6-9f64-4faa-bef7-93be6cde4970"
Aug 04 17:46:31.875425 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:31.874971    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm47l"
Aug 04 17:46:31.875425 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:31.875077    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pm47l" podUID="175017d4-1fb6-4129-b96f-4990959c3a8b"
Aug 04 17:46:32.280018 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:32.279977    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cec46231-ba14-4b07-b2b1-df119f58db12-metrics-certs\") pod \"network-metrics-daemon-bqph9\" (UID: \"cec46231-ba14-4b07-b2b1-df119f58db12\") " pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:46:32.280187 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:32.280147    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:46:32.280251 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:32.280209    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cec46231-ba14-4b07-b2b1-df119f58db12-metrics-certs podName:cec46231-ba14-4b07-b2b1-df119f58db12 nodeName:}" failed. No retries permitted until 2026-08-04 17:46:40.280190357 +0000 UTC m=+17.081326683 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cec46231-ba14-4b07-b2b1-df119f58db12-metrics-certs") pod "network-metrics-daemon-bqph9" (UID: "cec46231-ba14-4b07-b2b1-df119f58db12") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:46:32.380692 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:32.380659    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/175017d4-1fb6-4129-b96f-4990959c3a8b-original-pull-secret\") pod \"global-pull-secret-syncer-pm47l\" (UID: \"175017d4-1fb6-4129-b96f-4990959c3a8b\") " pod="kube-system/global-pull-secret-syncer-pm47l"
Aug 04 17:46:32.380862 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:32.380833    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 17:46:32.380923 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:32.380906    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/175017d4-1fb6-4129-b96f-4990959c3a8b-original-pull-secret podName:175017d4-1fb6-4129-b96f-4990959c3a8b nodeName:}" failed. No retries permitted until 2026-08-04 17:46:40.380883374 +0000 UTC m=+17.182019696 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/175017d4-1fb6-4129-b96f-4990959c3a8b-original-pull-secret") pod "global-pull-secret-syncer-pm47l" (UID: "175017d4-1fb6-4129-b96f-4990959c3a8b") : object "kube-system"/"original-pull-secret" not registered
Aug 04 17:46:32.482084 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:32.482001    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjgxv\" (UniqueName: \"kubernetes.io/projected/a63fe4d6-9f64-4faa-bef7-93be6cde4970-kube-api-access-sjgxv\") pod \"network-check-target-qqhjm\" (UID: \"a63fe4d6-9f64-4faa-bef7-93be6cde4970\") " pod="openshift-network-diagnostics/network-check-target-qqhjm"
Aug 04 17:46:32.482226 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:32.482175    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 17:46:32.482226 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:32.482197    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 17:46:32.482226 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:32.482208    2571 projected.go:196] Error preparing data for projected volume kube-api-access-sjgxv for pod openshift-network-diagnostics/network-check-target-qqhjm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:46:32.482386 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:32.482272    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a63fe4d6-9f64-4faa-bef7-93be6cde4970-kube-api-access-sjgxv podName:a63fe4d6-9f64-4faa-bef7-93be6cde4970 nodeName:}" failed. No retries permitted until 2026-08-04 17:46:40.482252798 +0000 UTC m=+17.283389123 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-sjgxv" (UniqueName: "kubernetes.io/projected/a63fe4d6-9f64-4faa-bef7-93be6cde4970-kube-api-access-sjgxv") pod "network-check-target-qqhjm" (UID: "a63fe4d6-9f64-4faa-bef7-93be6cde4970") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:46:32.874319 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:32.874252    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:46:32.874472 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:32.874373    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqph9" podUID="cec46231-ba14-4b07-b2b1-df119f58db12"
Aug 04 17:46:33.875680 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:33.875437    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqhjm"
Aug 04 17:46:33.875680 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:33.875550    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqhjm" podUID="a63fe4d6-9f64-4faa-bef7-93be6cde4970"
Aug 04 17:46:33.875680 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:33.875597    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm47l"
Aug 04 17:46:33.876224 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:33.875769    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pm47l" podUID="175017d4-1fb6-4129-b96f-4990959c3a8b"
Aug 04 17:46:34.874197 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:34.874163    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:46:34.874376 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:34.874319    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqph9" podUID="cec46231-ba14-4b07-b2b1-df119f58db12"
Aug 04 17:46:35.874728 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:35.874700    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqhjm"
Aug 04 17:46:35.875162 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:35.874822    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqhjm" podUID="a63fe4d6-9f64-4faa-bef7-93be6cde4970"
Aug 04 17:46:35.875162 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:35.874891    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm47l"
Aug 04 17:46:35.875162 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:35.874984    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pm47l" podUID="175017d4-1fb6-4129-b96f-4990959c3a8b"
Aug 04 17:46:36.874590 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:36.874555    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:46:36.874778 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:36.874682    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqph9" podUID="cec46231-ba14-4b07-b2b1-df119f58db12"
Aug 04 17:46:37.874434 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:37.874408    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqhjm"
Aug 04 17:46:37.874614 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:37.874533    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqhjm" podUID="a63fe4d6-9f64-4faa-bef7-93be6cde4970"
Aug 04 17:46:37.874614 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:37.874586    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm47l"
Aug 04 17:46:37.874738 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:37.874704    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pm47l" podUID="175017d4-1fb6-4129-b96f-4990959c3a8b"
Aug 04 17:46:38.874709 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:38.874675    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:46:38.875114 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:38.874810    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqph9" podUID="cec46231-ba14-4b07-b2b1-df119f58db12"
Aug 04 17:46:39.874536 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:39.874498    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqhjm"
Aug 04 17:46:39.874709 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:39.874624    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqhjm" podUID="a63fe4d6-9f64-4faa-bef7-93be6cde4970"
Aug 04 17:46:39.874709 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:39.874696    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm47l"
Aug 04 17:46:39.875073 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:39.874804    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pm47l" podUID="175017d4-1fb6-4129-b96f-4990959c3a8b"
Aug 04 17:46:40.342937 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:40.342864    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cec46231-ba14-4b07-b2b1-df119f58db12-metrics-certs\") pod \"network-metrics-daemon-bqph9\" (UID: \"cec46231-ba14-4b07-b2b1-df119f58db12\") " pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:46:40.343087 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:40.342987    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:46:40.343087 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:40.343050    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cec46231-ba14-4b07-b2b1-df119f58db12-metrics-certs podName:cec46231-ba14-4b07-b2b1-df119f58db12 nodeName:}" failed. No retries permitted until 2026-08-04 17:46:56.343031881 +0000 UTC m=+33.144168195 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cec46231-ba14-4b07-b2b1-df119f58db12-metrics-certs") pod "network-metrics-daemon-bqph9" (UID: "cec46231-ba14-4b07-b2b1-df119f58db12") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:46:40.444050 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:40.444017    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/175017d4-1fb6-4129-b96f-4990959c3a8b-original-pull-secret\") pod \"global-pull-secret-syncer-pm47l\" (UID: \"175017d4-1fb6-4129-b96f-4990959c3a8b\") " pod="kube-system/global-pull-secret-syncer-pm47l"
Aug 04 17:46:40.444215 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:40.444156    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 17:46:40.444282 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:40.444217    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/175017d4-1fb6-4129-b96f-4990959c3a8b-original-pull-secret podName:175017d4-1fb6-4129-b96f-4990959c3a8b nodeName:}" failed. No retries permitted until 2026-08-04 17:46:56.444200432 +0000 UTC m=+33.245336737 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/175017d4-1fb6-4129-b96f-4990959c3a8b-original-pull-secret") pod "global-pull-secret-syncer-pm47l" (UID: "175017d4-1fb6-4129-b96f-4990959c3a8b") : object "kube-system"/"original-pull-secret" not registered
Aug 04 17:46:40.545246 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:40.545214    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjgxv\" (UniqueName: \"kubernetes.io/projected/a63fe4d6-9f64-4faa-bef7-93be6cde4970-kube-api-access-sjgxv\") pod \"network-check-target-qqhjm\" (UID: \"a63fe4d6-9f64-4faa-bef7-93be6cde4970\") " pod="openshift-network-diagnostics/network-check-target-qqhjm"
Aug 04 17:46:40.545394 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:40.545383    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 17:46:40.545448 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:40.545403    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 17:46:40.545448 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:40.545414    2571 projected.go:196] Error preparing data for projected volume kube-api-access-sjgxv for pod openshift-network-diagnostics/network-check-target-qqhjm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:46:40.545553 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:40.545456    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a63fe4d6-9f64-4faa-bef7-93be6cde4970-kube-api-access-sjgxv podName:a63fe4d6-9f64-4faa-bef7-93be6cde4970 nodeName:}" failed. No retries permitted until 2026-08-04 17:46:56.545442324 +0000 UTC m=+33.346578648 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-sjgxv" (UniqueName: "kubernetes.io/projected/a63fe4d6-9f64-4faa-bef7-93be6cde4970-kube-api-access-sjgxv") pod "network-check-target-qqhjm" (UID: "a63fe4d6-9f64-4faa-bef7-93be6cde4970") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:46:40.874729 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:40.874697    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:46:40.874896 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:40.874832    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqph9" podUID="cec46231-ba14-4b07-b2b1-df119f58db12"
Aug 04 17:46:41.874307 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:41.874277    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqhjm"
Aug 04 17:46:41.874488 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:41.874391    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqhjm" podUID="a63fe4d6-9f64-4faa-bef7-93be6cde4970"
Aug 04 17:46:41.874488 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:41.874453    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm47l"
Aug 04 17:46:41.874624 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:41.874580    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pm47l" podUID="175017d4-1fb6-4129-b96f-4990959c3a8b"
Aug 04 17:46:42.874264 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:42.874228    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:46:42.874733 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:42.874357    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqph9" podUID="cec46231-ba14-4b07-b2b1-df119f58db12"
Aug 04 17:46:43.875735 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:43.875695    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqhjm"
Aug 04 17:46:43.876177 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:43.875790    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm47l"
Aug 04 17:46:43.876177 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:43.875829    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqhjm" podUID="a63fe4d6-9f64-4faa-bef7-93be6cde4970"
Aug 04 17:46:43.876177 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:43.875865    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pm47l" podUID="175017d4-1fb6-4129-b96f-4990959c3a8b"
Aug 04 17:46:44.874563 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:44.874536    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:46:44.874719 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:44.874633    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqph9" podUID="cec46231-ba14-4b07-b2b1-df119f58db12"
Aug 04 17:46:45.877248 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:45.877099    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm47l"
Aug 04 17:46:45.877694 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:45.877160    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqhjm"
Aug 04 17:46:45.877694 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:45.877313    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pm47l" podUID="175017d4-1fb6-4129-b96f-4990959c3a8b"
Aug 04 17:46:45.877694 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:45.877375    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqhjm" podUID="a63fe4d6-9f64-4faa-bef7-93be6cde4970"
Aug 04 17:46:45.958262 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:45.958230    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-48dc2" event={"ID":"72c8d5dc-4be4-4f9a-9cc3-51444e78301a","Type":"ContainerStarted","Data":"aabb7fe7134e40b94784fe2a9e4ef0df522704d7bd48941511026f31c422505e"}
Aug 04 17:46:45.960206 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:45.960185    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal" event={"ID":"38e66965b8a5bfd304ca9eefbb3544fa","Type":"ContainerStarted","Data":"7c97b755c8739436b424365b163703b83a58edb505642d9f2a6d10c4725055ca"}
Aug 04 17:46:45.961534 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:45.961500    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tr759" event={"ID":"b58bd571-ff87-4b8a-b59c-e4bcac813d5b","Type":"ContainerStarted","Data":"bf04f38355b72fcf3970acccd9438e8b11d5d4673fac3c87870b41a77d1ab72c"}
Aug 04 17:46:45.967160 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:45.967139    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl" event={"ID":"69dd0780-85db-48ac-adc9-eef4e735e68d","Type":"ContainerStarted","Data":"abe6e24db0f3c0d338594c0126e2ea7f2205e1f144cfe25a3e131c6867f1c2c8"}
Aug 04 17:46:45.967257 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:45.967241    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl" event={"ID":"69dd0780-85db-48ac-adc9-eef4e735e68d","Type":"ContainerStarted","Data":"f040e93e8117652747e743e1b2ce411f00251a11c4b63ac6dc30b138099c4147"}
Aug 04 17:46:45.967326 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:45.967297    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl" event={"ID":"69dd0780-85db-48ac-adc9-eef4e735e68d","Type":"ContainerStarted","Data":"a251cf685f6bad8f1c4291c4a5e0e87874b7421dda1aadef1bf15b236e1d6722"}
Aug 04 17:46:45.967386 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:45.967346    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl" event={"ID":"69dd0780-85db-48ac-adc9-eef4e735e68d","Type":"ContainerStarted","Data":"2c57597fd99e219cecab83e6dd670a9fdbc797d7f6e86513fe19e27ccebf3279"}
Aug 04 17:46:45.967441 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:45.967395    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl" event={"ID":"69dd0780-85db-48ac-adc9-eef4e735e68d","Type":"ContainerStarted","Data":"b289c13deb726049beaa4f5e85732839dab29402c4b26bf2c188d1c6e6c1dfdd"}
Aug 04 17:46:45.981346 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:45.981307    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-48dc2" podStartSLOduration=2.118633712 podStartE2EDuration="21.981296033s" totalImagesPullingTime="19.862662321s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:46:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:46:45.980839063 +0000 UTC m=+22.781975404" watchObservedRunningTime="2026-08-04 17:46:45.981296033 +0000 UTC m=+22.782432359"
Aug 04 17:46:45.995972 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:45.995940    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tr759" podStartSLOduration=2.767647397 podStartE2EDuration="21.995930168s" totalImagesPullingTime="19.228282771s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:46:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:46:45.995688922 +0000 UTC m=+22.796825249" watchObservedRunningTime="2026-08-04 17:46:45.995930168 +0000 UTC m=+22.797066495"
Aug 04 17:46:46.009582 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:46.009539    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal" podStartSLOduration=22.009505406 podStartE2EDuration="22.009505406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:46:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:46:46.007904826 +0000 UTC m=+22.809041155" watchObservedRunningTime="2026-08-04 17:46:46.009505406 +0000 UTC m=+22.810641735"
Aug 04 17:46:46.874975 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:46.874826    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:46:46.875068 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:46.875047    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqph9" podUID="cec46231-ba14-4b07-b2b1-df119f58db12"
Aug 04 17:46:46.969717 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:46.969694    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xq7xp" event={"ID":"59068cff-9e8e-4aa6-af07-d08f484171e9","Type":"ContainerStarted","Data":"36b04fefef603bc6ecd60e1fc608f974fdd38c6ce0e94ef12b996cb022db2e04"}
Aug 04 17:46:46.972485 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:46.972456    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl" event={"ID":"69dd0780-85db-48ac-adc9-eef4e735e68d","Type":"ContainerStarted","Data":"c36ff5bfbc69f939a9d1134aeb00514797e85f21fdcf1d64118618ad86c89f07"}
Aug 04 17:46:46.973692 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:46.973668    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mvqbx" event={"ID":"7f50c49e-31bc-4d7f-bfe0-24f72a99c129","Type":"ContainerStarted","Data":"392ac3b459e2ffc174602d68f60150be2b5553e44ebb86c96d7609e505161698"}
Aug 04 17:46:46.974858 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:46.974835    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-64wn5" event={"ID":"fbf8aa50-191e-49a4-8a78-c03a83900d95","Type":"ContainerStarted","Data":"f4665a173828bf90a5b834d92df1f78f2b2c6f2bcfa7d23ff892c6911661dc75"}
Aug 04 17:46:46.976089 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:46.976068    2571 generic.go:356] "Generic (PLEG): container finished" podID="9800c9e0-bedf-4d65-a981-0cb8b0726c61" containerID="9a850e2bf2545a34eda91b37920bad2a6789492fa2105c7f894164c10a35c39e" exitCode=0
Aug 04 17:46:46.976174 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:46.976142    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6lrlf" event={"ID":"9800c9e0-bedf-4d65-a981-0cb8b0726c61","Type":"ContainerDied","Data":"9a850e2bf2545a34eda91b37920bad2a6789492fa2105c7f894164c10a35c39e"}
Aug 04 17:46:46.977445 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:46.977424    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4tcn" event={"ID":"466aca21-890a-48c7-ba36-047a46e4bf38","Type":"ContainerStarted","Data":"0d1635e5ae5921bbcb52b3c91b2af48158922556dcb76fb444e4806ac61ae5a6"}
Aug 04 17:46:46.978859 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:46.978791    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qgjr8" event={"ID":"4ff78307-0cd9-4551-9b67-95943e190bfe","Type":"ContainerStarted","Data":"1c4ed97ea6db2a2706d0c941bb7bb8eaf779ea6b66c6993acc77d68603347258"}
Aug 04 17:46:46.980147 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:46.980127    2571 generic.go:356] "Generic (PLEG): container finished" podID="d50d574671ac25d0c57a314e2746b629" containerID="b7a38d69ffd82ec17ccfab6792aaba616ca39993c0aecef0fc5a88df43eedb65" exitCode=0
Aug 04 17:46:46.980229 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:46.980185    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal" event={"ID":"d50d574671ac25d0c57a314e2746b629","Type":"ContainerDied","Data":"b7a38d69ffd82ec17ccfab6792aaba616ca39993c0aecef0fc5a88df43eedb65"}
Aug 04 17:46:46.984759 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:46.984728    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xq7xp" podStartSLOduration=3.405540978 podStartE2EDuration="22.98471733s" totalImagesPullingTime="19.579176352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:46:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:46:46.984406967 +0000 UTC m=+23.785543306" watchObservedRunningTime="2026-08-04 17:46:46.98471733 +0000 UTC m=+23.785853656"
Aug 04 17:46:47.067403 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:47.067099    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qgjr8" podStartSLOduration=3.272629665 podStartE2EDuration="23.067080803s" totalImagesPullingTime="19.794451138s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:46:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:46:47.066834684 +0000 UTC m=+23.867971012" watchObservedRunningTime="2026-08-04 17:46:47.067080803 +0000 UTC m=+23.868217131"
Aug 04 17:46:47.100372 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:47.100341    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-64wn5" podStartSLOduration=3.31711217 podStartE2EDuration="23.100330262s" totalImagesPullingTime="19.783218092s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:46:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:46:47.085728235 +0000 UTC m=+23.886864572" watchObservedRunningTime="2026-08-04 17:46:47.100330262 +0000 UTC m=+23.901466589"
Aug 04 17:46:47.100472 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:47.100441    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mvqbx" podStartSLOduration=3.3650264 podStartE2EDuration="23.10043665s" totalImagesPullingTime="19.73541025s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:46:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:46:47.100097738 +0000 UTC m=+23.901234075" watchObservedRunningTime="2026-08-04 17:46:47.10043665 +0000 UTC m=+23.901572974"
Aug 04 17:46:47.874061 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:47.874029    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqhjm"
Aug 04 17:46:47.874422 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:47.874144    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqhjm" podUID="a63fe4d6-9f64-4faa-bef7-93be6cde4970"
Aug 04 17:46:47.874422 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:47.874204    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm47l"
Aug 04 17:46:47.874422 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:47.874303    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pm47l" podUID="175017d4-1fb6-4129-b96f-4990959c3a8b"
Aug 04 17:46:47.984076 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:47.984035    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal" event={"ID":"d50d574671ac25d0c57a314e2746b629","Type":"ContainerStarted","Data":"1d72ace22063bfbeed38a76d42be01bd5856ae715e3c2237c76c1aebba5855e3"}
Aug 04 17:46:47.998531 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:47.998479    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal" podStartSLOduration=23.998467937 podStartE2EDuration="23.998467937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:46:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:46:47.997822419 +0000 UTC m=+24.798958769" watchObservedRunningTime="2026-08-04 17:46:47.998467937 +0000 UTC m=+24.799604263"
Aug 04 17:46:48.562799 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:48.562772    2571 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Aug 04 17:46:48.675185 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:48.675113    2571 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-04T17:46:48.562790461Z","UUID":"58b47f5a-c3b7-485e-9fc8-317fe1a2a0fc","Handler":null,"Name":"","Endpoint":""}
Aug 04 17:46:48.676547 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:48.676512    2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Aug 04 17:46:48.676670 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:48.676568    2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Aug 04 17:46:48.773221 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:48.773172    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xq7xp"
Aug 04 17:46:48.773696 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:48.773678    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xq7xp"
Aug 04 17:46:48.874808 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:48.874789    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:46:48.874929 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:48.874907    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqph9" podUID="cec46231-ba14-4b07-b2b1-df119f58db12"
Aug 04 17:46:48.989756 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:48.989730    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl" event={"ID":"69dd0780-85db-48ac-adc9-eef4e735e68d","Type":"ContainerStarted","Data":"ab8c6b4d6f55d5caac2a7a2628531ec48bd6af6ea2f2a553754e7f2701461bc7"}
Aug 04 17:46:48.991729 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:48.991705    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4tcn" event={"ID":"466aca21-890a-48c7-ba36-047a46e4bf38","Type":"ContainerStarted","Data":"84bb1684bbaa8d15a9f759aa531deef252fd559e8230c19ad715861349f641e7"}
Aug 04 17:46:48.992036 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:48.992018    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xq7xp"
Aug 04 17:46:48.992413 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:48.992397    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xq7xp"
Aug 04 17:46:49.874616 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:49.874584    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqhjm"
Aug 04 17:46:49.874820 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:49.874586    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm47l"
Aug 04 17:46:49.874820 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:49.874688    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqhjm" podUID="a63fe4d6-9f64-4faa-bef7-93be6cde4970"
Aug 04 17:46:49.874820 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:49.874794    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pm47l" podUID="175017d4-1fb6-4129-b96f-4990959c3a8b"
Aug 04 17:46:50.874478 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:50.874437    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:46:50.874850 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:50.874564    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqph9" podUID="cec46231-ba14-4b07-b2b1-df119f58db12"
Aug 04 17:46:50.997367 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:50.997332    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4tcn" event={"ID":"466aca21-890a-48c7-ba36-047a46e4bf38","Type":"ContainerStarted","Data":"bf5b187c0a0cbdd81eaa7dadd9ac1d2ee1e75079640efff485305043b58dce6e"}
Aug 04 17:46:51.012926 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:51.012875    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4tcn" podStartSLOduration=3.48549185 podStartE2EDuration="27.012859252s" totalImagesPullingTime="23.527367402s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:46:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:46:51.012766596 +0000 UTC m=+27.813902957" watchObservedRunningTime="2026-08-04 17:46:51.012859252 +0000 UTC m=+27.813995576"
Aug 04 17:46:51.874939 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:51.874730    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqhjm"
Aug 04 17:46:51.875498 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:51.874740    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm47l"
Aug 04 17:46:51.875498 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:51.875041    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqhjm" podUID="a63fe4d6-9f64-4faa-bef7-93be6cde4970"
Aug 04 17:46:51.875498 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:51.875124    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pm47l" podUID="175017d4-1fb6-4129-b96f-4990959c3a8b"
Aug 04 17:46:52.001540 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:52.001486    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6lrlf" event={"ID":"9800c9e0-bedf-4d65-a981-0cb8b0726c61","Type":"ContainerStarted","Data":"64908e01eab45036be20b505af4f7d91db3ed966c5880b4afd6d4c6aab55869d"}
Aug 04 17:46:52.005870 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:52.005720    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl" event={"ID":"69dd0780-85db-48ac-adc9-eef4e735e68d","Type":"ContainerStarted","Data":"ca4d9e6f5a4274d06127538711cb2654e9538af3a950b510dc82ac1133095222"}
Aug 04 17:46:52.006762 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:52.006700    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:52.008804 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:52.007037    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:52.023421 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:52.023397    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:52.023569 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:52.023556    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:52.042646 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:52.042609    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl" podStartSLOduration=8.096898841 podStartE2EDuration="28.042596838s" totalImagesPullingTime="19.945697997s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:46:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:46:52.042218855 +0000 UTC m=+28.843355181" watchObservedRunningTime="2026-08-04 17:46:52.042596838 +0000 UTC m=+28.843733165"
Aug 04 17:46:52.874378 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:52.874350    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:46:52.874638 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:52.874469    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqph9" podUID="cec46231-ba14-4b07-b2b1-df119f58db12"
Aug 04 17:46:53.008968 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:53.008935    2571 generic.go:356] "Generic (PLEG): container finished" podID="9800c9e0-bedf-4d65-a981-0cb8b0726c61" containerID="64908e01eab45036be20b505af4f7d91db3ed966c5880b4afd6d4c6aab55869d" exitCode=0
Aug 04 17:46:53.009423 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:53.008990    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6lrlf" event={"ID":"9800c9e0-bedf-4d65-a981-0cb8b0726c61","Type":"ContainerDied","Data":"64908e01eab45036be20b505af4f7d91db3ed966c5880b4afd6d4c6aab55869d"}
Aug 04 17:46:53.009423 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:53.009095    2571 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Aug 04 17:46:53.626881 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:53.626854    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pm47l"]
Aug 04 17:46:53.627033 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:53.626966    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm47l"
Aug 04 17:46:53.627093 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:53.627040    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pm47l" podUID="175017d4-1fb6-4129-b96f-4990959c3a8b"
Aug 04 17:46:53.631587 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:53.631338    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qqhjm"]
Aug 04 17:46:53.633671 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:53.632370    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bqph9"]
Aug 04 17:46:53.633671 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:53.632500    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:46:53.633671 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:53.632666    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqph9" podUID="cec46231-ba14-4b07-b2b1-df119f58db12"
Aug 04 17:46:53.633868 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:53.633682    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqhjm"
Aug 04 17:46:53.633868 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:53.633820    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqhjm" podUID="a63fe4d6-9f64-4faa-bef7-93be6cde4970"
Aug 04 17:46:54.010963 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:54.010882    2571 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Aug 04 17:46:54.050989 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:54.050966    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:46:55.015240 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:55.015179    2571 generic.go:356] "Generic (PLEG): container finished" podID="9800c9e0-bedf-4d65-a981-0cb8b0726c61" containerID="1f1d87ba9a550519ac0ea358d0faf52ee86cdeeb37a57754c7af8b23217f1bff" exitCode=0
Aug 04 17:46:55.015613 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:55.015271    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6lrlf" event={"ID":"9800c9e0-bedf-4d65-a981-0cb8b0726c61","Type":"ContainerDied","Data":"1f1d87ba9a550519ac0ea358d0faf52ee86cdeeb37a57754c7af8b23217f1bff"}
Aug 04 17:46:55.877384 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:55.877360    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqhjm"
Aug 04 17:46:55.877384 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:55.877376    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm47l"
Aug 04 17:46:55.877624 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:55.877360    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:46:55.877624 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:55.877459    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqhjm" podUID="a63fe4d6-9f64-4faa-bef7-93be6cde4970"
Aug 04 17:46:55.877624 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:55.877561    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pm47l" podUID="175017d4-1fb6-4129-b96f-4990959c3a8b"
Aug 04 17:46:55.877789 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:55.877649    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqph9" podUID="cec46231-ba14-4b07-b2b1-df119f58db12"
Aug 04 17:46:56.367066 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:56.367042    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cec46231-ba14-4b07-b2b1-df119f58db12-metrics-certs\") pod \"network-metrics-daemon-bqph9\" (UID: \"cec46231-ba14-4b07-b2b1-df119f58db12\") " pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:46:56.367419 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:56.367211    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:46:56.367419 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:56.367265    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cec46231-ba14-4b07-b2b1-df119f58db12-metrics-certs podName:cec46231-ba14-4b07-b2b1-df119f58db12 nodeName:}" failed. No retries permitted until 2026-08-04 17:47:28.367246969 +0000 UTC m=+65.168383280 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cec46231-ba14-4b07-b2b1-df119f58db12-metrics-certs") pod "network-metrics-daemon-bqph9" (UID: "cec46231-ba14-4b07-b2b1-df119f58db12") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:46:56.467903 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:56.467883    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/175017d4-1fb6-4129-b96f-4990959c3a8b-original-pull-secret\") pod \"global-pull-secret-syncer-pm47l\" (UID: \"175017d4-1fb6-4129-b96f-4990959c3a8b\") " pod="kube-system/global-pull-secret-syncer-pm47l"
Aug 04 17:46:56.467986 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:56.467966    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 17:46:56.468026 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:56.468007    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/175017d4-1fb6-4129-b96f-4990959c3a8b-original-pull-secret podName:175017d4-1fb6-4129-b96f-4990959c3a8b nodeName:}" failed. No retries permitted until 2026-08-04 17:47:28.467994948 +0000 UTC m=+65.269131253 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/175017d4-1fb6-4129-b96f-4990959c3a8b-original-pull-secret") pod "global-pull-secret-syncer-pm47l" (UID: "175017d4-1fb6-4129-b96f-4990959c3a8b") : object "kube-system"/"original-pull-secret" not registered
Aug 04 17:46:56.568781 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:56.568732    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjgxv\" (UniqueName: \"kubernetes.io/projected/a63fe4d6-9f64-4faa-bef7-93be6cde4970-kube-api-access-sjgxv\") pod \"network-check-target-qqhjm\" (UID: \"a63fe4d6-9f64-4faa-bef7-93be6cde4970\") " pod="openshift-network-diagnostics/network-check-target-qqhjm"
Aug 04 17:46:56.568868 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:56.568842    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 17:46:56.568868 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:56.568856    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 17:46:56.568868 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:56.568864    2571 projected.go:196] Error preparing data for projected volume kube-api-access-sjgxv for pod openshift-network-diagnostics/network-check-target-qqhjm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:46:56.568983 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:56.568901    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a63fe4d6-9f64-4faa-bef7-93be6cde4970-kube-api-access-sjgxv podName:a63fe4d6-9f64-4faa-bef7-93be6cde4970 nodeName:}" failed. No retries permitted until 2026-08-04 17:47:28.568891082 +0000 UTC m=+65.370027386 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-sjgxv" (UniqueName: "kubernetes.io/projected/a63fe4d6-9f64-4faa-bef7-93be6cde4970-kube-api-access-sjgxv") pod "network-check-target-qqhjm" (UID: "a63fe4d6-9f64-4faa-bef7-93be6cde4970") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:46:57.020928 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:57.020900    2571 generic.go:356] "Generic (PLEG): container finished" podID="9800c9e0-bedf-4d65-a981-0cb8b0726c61" containerID="03b461f010361c9dbcfdd1c31a1ab0f879ec5d513cbdacfe1dae82413d12424d" exitCode=0
Aug 04 17:46:57.021046 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:57.020937    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6lrlf" event={"ID":"9800c9e0-bedf-4d65-a981-0cb8b0726c61","Type":"ContainerDied","Data":"03b461f010361c9dbcfdd1c31a1ab0f879ec5d513cbdacfe1dae82413d12424d"}
Aug 04 17:46:57.877626 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:57.877595    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm47l"
Aug 04 17:46:57.878067 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:57.877595    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqhjm"
Aug 04 17:46:57.878067 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:57.877749    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pm47l" podUID="175017d4-1fb6-4129-b96f-4990959c3a8b"
Aug 04 17:46:57.878067 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:57.877813    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqhjm" podUID="a63fe4d6-9f64-4faa-bef7-93be6cde4970"
Aug 04 17:46:57.878067 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:57.877597    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:46:57.878067 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:57.877913    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqph9" podUID="cec46231-ba14-4b07-b2b1-df119f58db12"
Aug 04 17:46:59.023817 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.023593    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeReady"
Aug 04 17:46:59.024370 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.023928    2571 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Aug 04 17:46:59.057211 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.057183    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-5z7qg"]
Aug 04 17:46:59.060801 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.060780    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-594fdf9495-66w8b"]
Aug 04 17:46:59.060944 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.060914    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-5z7qg"
Aug 04 17:46:59.063142 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.063097    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Aug 04 17:46:59.063601 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.063582    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Aug 04 17:46:59.063704 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.063608    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-qplz9\""
Aug 04 17:46:59.064370 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.064351    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d54dcfd6-t79zb"]
Aug 04 17:46:59.064498 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.064482    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:46:59.067029 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.067009    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Aug 04 17:46:59.067454 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.067434    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Aug 04 17:46:59.067564 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.067513    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6z64c\""
Aug 04 17:46:59.067623 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.067577    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Aug 04 17:46:59.068070 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.068042    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c45b7648-x97l7"]
Aug 04 17:46:59.068681 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.068661    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d54dcfd6-t79zb"
Aug 04 17:46:59.071339 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.071320    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Aug 04 17:46:59.071880 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.071560    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Aug 04 17:46:59.071880 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.071564    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Aug 04 17:46:59.071880 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.071622    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4fb7b886-87x2s"]
Aug 04 17:46:59.071880 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.071709    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c45b7648-x97l7"
Aug 04 17:46:59.071880 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.071622    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-4vr5c\""
Aug 04 17:46:59.072349 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.071921    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Aug 04 17:46:59.074036 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.073997    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Aug 04 17:46:59.074224 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.074204    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Aug 04 17:46:59.074874 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.074859    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Aug 04 17:46:59.075155 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.074879    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Aug 04 17:46:59.075568 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.074879    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Aug 04 17:46:59.075568 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.075500    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4fb7b886-87x2s"
Aug 04 17:46:59.076172 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.075801    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8bxm5"]
Aug 04 17:46:59.078371 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.078092    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Aug 04 17:46:59.079364 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.079346    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ksm84"]
Aug 04 17:46:59.079746 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.079726    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8bxm5"
Aug 04 17:46:59.082363 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.082150    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Aug 04 17:46:59.082363 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.082178    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-56pss\""
Aug 04 17:46:59.082505 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.082415    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Aug 04 17:46:59.083944 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.083703    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-5z7qg"]
Aug 04 17:46:59.083944 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.083735    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d54dcfd6-t79zb"]
Aug 04 17:46:59.083944 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.083751    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4fb7b886-87x2s"]
Aug 04 17:46:59.083944 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.083765    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-594fdf9495-66w8b"]
Aug 04 17:46:59.083944 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.083836    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ksm84"
Aug 04 17:46:59.087124 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.087097    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dvz98\""
Aug 04 17:46:59.089268 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.089245    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ksm84"]
Aug 04 17:46:59.090381 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.090171    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Aug 04 17:46:59.090381 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.090181    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Aug 04 17:46:59.090913 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.090601    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Aug 04 17:46:59.099332 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.099311    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8bxm5"]
Aug 04 17:46:59.100426 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.100408    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c45b7648-x97l7"]
Aug 04 17:46:59.187981 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.187951    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d5c369c3-199c-4805-9d5b-ffc8d36a1780-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-9c45b7648-x97l7\" (UID: \"d5c369c3-199c-4805-9d5b-ffc8d36a1780\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c45b7648-x97l7"
Aug 04 17:46:59.188097 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.187982    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njpj6\" (UniqueName: \"kubernetes.io/projected/3a5553b1-b587-461d-86f7-a6043849503c-kube-api-access-njpj6\") pod \"managed-serviceaccount-addon-agent-9d54dcfd6-t79zb\" (UID: \"3a5553b1-b587-461d-86f7-a6043849503c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d54dcfd6-t79zb"
Aug 04 17:46:59.188097 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.188005    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e1b5f8e-8269-4d96-bc60-4cf728aff9cc-tmp\") pod \"klusterlet-addon-workmgr-6f4fb7b886-87x2s\" (UID: \"7e1b5f8e-8269-4d96-bc60-4cf728aff9cc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4fb7b886-87x2s"
Aug 04 17:46:59.188097 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.188078    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-config-volume\") pod \"dns-default-8bxm5\" (UID: \"e1d0f03c-af81-42ad-8fff-4d32ba94c3e7\") " pod="openshift-dns/dns-default-8bxm5"
Aug 04 17:46:59.188261 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.188103    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2v6x\" (UniqueName: \"kubernetes.io/projected/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-kube-api-access-c2v6x\") pod \"dns-default-8bxm5\" (UID: \"e1d0f03c-af81-42ad-8fff-4d32ba94c3e7\") " pod="openshift-dns/dns-default-8bxm5"
Aug 04 17:46:59.188261 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.188141    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d5c369c3-199c-4805-9d5b-ffc8d36a1780-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-9c45b7648-x97l7\" (UID: \"d5c369c3-199c-4805-9d5b-ffc8d36a1780\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c45b7648-x97l7"
Aug 04 17:46:59.188261 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.188167    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cb892edb-7af7-4903-9178-4d1070e50a4f-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-5z7qg\" (UID: \"cb892edb-7af7-4903-9178-4d1070e50a4f\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-5z7qg"
Aug 04 17:46:59.188261 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.188195    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff200bb2-9a58-43af-9369-3c300edacd50-installation-pull-secrets\") pod \"image-registry-594fdf9495-66w8b\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") " pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:46:59.188261 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.188252    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84548\" (UniqueName: \"kubernetes.io/projected/7e1b5f8e-8269-4d96-bc60-4cf728aff9cc-kube-api-access-84548\") pod \"klusterlet-addon-workmgr-6f4fb7b886-87x2s\" (UID: \"7e1b5f8e-8269-4d96-bc60-4cf728aff9cc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4fb7b886-87x2s"
Aug 04 17:46:59.188499 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.188278    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-tmp-dir\") pod \"dns-default-8bxm5\" (UID: \"e1d0f03c-af81-42ad-8fff-4d32ba94c3e7\") " pod="openshift-dns/dns-default-8bxm5"
Aug 04 17:46:59.188499 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.188301    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhg94\" (UniqueName: \"kubernetes.io/projected/d109d386-1913-448d-a113-ca36b9aee7c0-kube-api-access-qhg94\") pod \"ingress-canary-ksm84\" (UID: \"d109d386-1913-448d-a113-ca36b9aee7c0\") " pod="openshift-ingress-canary/ingress-canary-ksm84"
Aug 04 17:46:59.188499 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.188343    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff200bb2-9a58-43af-9369-3c300edacd50-ca-trust-extracted\") pod \"image-registry-594fdf9495-66w8b\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") " pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:46:59.188499 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.188361    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5c369c3-199c-4805-9d5b-ffc8d36a1780-additional-service-ca\") pod \"cluster-proxy-proxy-agent-9c45b7648-x97l7\" (UID: \"d5c369c3-199c-4805-9d5b-ffc8d36a1780\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c45b7648-x97l7"
Aug 04 17:46:59.188499 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.188418    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d5c369c3-199c-4805-9d5b-ffc8d36a1780-hub\") pod \"cluster-proxy-proxy-agent-9c45b7648-x97l7\" (UID: \"d5c369c3-199c-4805-9d5b-ffc8d36a1780\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c45b7648-x97l7"
Aug 04 17:46:59.188499 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.188493    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-registry-tls\") pod \"image-registry-594fdf9495-66w8b\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") " pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:46:59.189028 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.188518    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff200bb2-9a58-43af-9369-3c300edacd50-registry-certificates\") pod \"image-registry-594fdf9495-66w8b\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") " pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:46:59.189028 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.188559    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d5c369c3-199c-4805-9d5b-ffc8d36a1780-ca\") pod \"cluster-proxy-proxy-agent-9c45b7648-x97l7\" (UID: \"d5c369c3-199c-4805-9d5b-ffc8d36a1780\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c45b7648-x97l7"
Aug 04 17:46:59.189028 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.188600    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3a5553b1-b587-461d-86f7-a6043849503c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9d54dcfd6-t79zb\" (UID: \"3a5553b1-b587-461d-86f7-a6043849503c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d54dcfd6-t79zb"
Aug 04 17:46:59.189028 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.188679    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff200bb2-9a58-43af-9369-3c300edacd50-trusted-ca\") pod \"image-registry-594fdf9495-66w8b\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") " pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:46:59.189028 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.188730    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47j89\" (UniqueName: \"kubernetes.io/projected/d5c369c3-199c-4805-9d5b-ffc8d36a1780-kube-api-access-47j89\") pod \"cluster-proxy-proxy-agent-9c45b7648-x97l7\" (UID: \"d5c369c3-199c-4805-9d5b-ffc8d36a1780\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c45b7648-x97l7"
Aug 04 17:46:59.189028 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.188759    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d109d386-1913-448d-a113-ca36b9aee7c0-cert\") pod \"ingress-canary-ksm84\" (UID: \"d109d386-1913-448d-a113-ca36b9aee7c0\") " pod="openshift-ingress-canary/ingress-canary-ksm84"
Aug 04 17:46:59.189028 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.188820    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7e1b5f8e-8269-4d96-bc60-4cf728aff9cc-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f4fb7b886-87x2s\" (UID: \"7e1b5f8e-8269-4d96-bc60-4cf728aff9cc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4fb7b886-87x2s"
Aug 04 17:46:59.189028 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.188867    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-metrics-tls\") pod \"dns-default-8bxm5\" (UID: \"e1d0f03c-af81-42ad-8fff-4d32ba94c3e7\") " pod="openshift-dns/dns-default-8bxm5"
Aug 04 17:46:59.189028 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.188892    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-bound-sa-token\") pod \"image-registry-594fdf9495-66w8b\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") " pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:46:59.189028 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.188936    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-267vg\" (UniqueName: \"kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-kube-api-access-267vg\") pod \"image-registry-594fdf9495-66w8b\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") " pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:46:59.189028 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.188962    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cb892edb-7af7-4903-9178-4d1070e50a4f-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-5z7qg\" (UID: \"cb892edb-7af7-4903-9178-4d1070e50a4f\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-5z7qg"
Aug 04 17:46:59.189028 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.188987    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff200bb2-9a58-43af-9369-3c300edacd50-image-registry-private-configuration\") pod \"image-registry-594fdf9495-66w8b\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") " pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:46:59.212738 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.212712    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xq7xp_59068cff-9e8e-4aa6-af07-d08f484171e9/konnectivity-agent/0.log" limit=1024
Aug 04 17:46:59.289541 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.289503    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff200bb2-9a58-43af-9369-3c300edacd50-ca-trust-extracted\") pod \"image-registry-594fdf9495-66w8b\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") " pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:46:59.289654 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.289556    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5c369c3-199c-4805-9d5b-ffc8d36a1780-additional-service-ca\") pod \"cluster-proxy-proxy-agent-9c45b7648-x97l7\" (UID: \"d5c369c3-199c-4805-9d5b-ffc8d36a1780\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c45b7648-x97l7"
Aug 04 17:46:59.289654 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.289581    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d5c369c3-199c-4805-9d5b-ffc8d36a1780-hub\") pod \"cluster-proxy-proxy-agent-9c45b7648-x97l7\" (UID: \"d5c369c3-199c-4805-9d5b-ffc8d36a1780\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c45b7648-x97l7"
Aug 04 17:46:59.289654 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.289607    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-registry-tls\") pod \"image-registry-594fdf9495-66w8b\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") " pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:46:59.289654 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.289637    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff200bb2-9a58-43af-9369-3c300edacd50-registry-certificates\") pod \"image-registry-594fdf9495-66w8b\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") " pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:46:59.289859 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.289658    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d5c369c3-199c-4805-9d5b-ffc8d36a1780-ca\") pod \"cluster-proxy-proxy-agent-9c45b7648-x97l7\" (UID: \"d5c369c3-199c-4805-9d5b-ffc8d36a1780\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c45b7648-x97l7"
Aug 04 17:46:59.289859 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.289683    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3a5553b1-b587-461d-86f7-a6043849503c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9d54dcfd6-t79zb\" (UID: \"3a5553b1-b587-461d-86f7-a6043849503c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d54dcfd6-t79zb"
Aug 04 17:46:59.289859 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.289711    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff200bb2-9a58-43af-9369-3c300edacd50-trusted-ca\") pod \"image-registry-594fdf9495-66w8b\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") " pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:46:59.289859 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.289735    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47j89\" (UniqueName: \"kubernetes.io/projected/d5c369c3-199c-4805-9d5b-ffc8d36a1780-kube-api-access-47j89\") pod \"cluster-proxy-proxy-agent-9c45b7648-x97l7\" (UID: \"d5c369c3-199c-4805-9d5b-ffc8d36a1780\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c45b7648-x97l7"
Aug 04 17:46:59.289859 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:59.289746    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 17:46:59.289859 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.289760    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d109d386-1913-448d-a113-ca36b9aee7c0-cert\") pod \"ingress-canary-ksm84\" (UID: \"d109d386-1913-448d-a113-ca36b9aee7c0\") " pod="openshift-ingress-canary/ingress-canary-ksm84"
Aug 04 17:46:59.289859 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.289789    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7e1b5f8e-8269-4d96-bc60-4cf728aff9cc-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f4fb7b886-87x2s\" (UID: \"7e1b5f8e-8269-4d96-bc60-4cf728aff9cc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4fb7b886-87x2s"
Aug 04 17:46:59.289859 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.289820    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-metrics-tls\") pod \"dns-default-8bxm5\" (UID: \"e1d0f03c-af81-42ad-8fff-4d32ba94c3e7\") " pod="openshift-dns/dns-default-8bxm5"
Aug 04 17:46:59.289859 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.289845    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-bound-sa-token\") pod \"image-registry-594fdf9495-66w8b\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") " pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:46:59.290269 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.289891    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-267vg\" (UniqueName: \"kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-kube-api-access-267vg\") pod \"image-registry-594fdf9495-66w8b\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") " pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:46:59.290269 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.289920    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cb892edb-7af7-4903-9178-4d1070e50a4f-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-5z7qg\" (UID: \"cb892edb-7af7-4903-9178-4d1070e50a4f\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-5z7qg"
Aug 04 17:46:59.290269 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.289950    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff200bb2-9a58-43af-9369-3c300edacd50-image-registry-private-configuration\") pod \"image-registry-594fdf9495-66w8b\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") " pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:46:59.290269 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.289975    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d5c369c3-199c-4805-9d5b-ffc8d36a1780-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-9c45b7648-x97l7\" (UID: \"d5c369c3-199c-4805-9d5b-ffc8d36a1780\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c45b7648-x97l7"
Aug 04 17:46:59.290269 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.290024    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njpj6\" (UniqueName: \"kubernetes.io/projected/3a5553b1-b587-461d-86f7-a6043849503c-kube-api-access-njpj6\") pod \"managed-serviceaccount-addon-agent-9d54dcfd6-t79zb\" (UID: \"3a5553b1-b587-461d-86f7-a6043849503c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d54dcfd6-t79zb"
Aug 04 17:46:59.290269 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.290050    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e1b5f8e-8269-4d96-bc60-4cf728aff9cc-tmp\") pod \"klusterlet-addon-workmgr-6f4fb7b886-87x2s\" (UID: \"7e1b5f8e-8269-4d96-bc60-4cf728aff9cc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4fb7b886-87x2s"
Aug 04 17:46:59.290269 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.290098    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-config-volume\") pod \"dns-default-8bxm5\" (UID: \"e1d0f03c-af81-42ad-8fff-4d32ba94c3e7\") " pod="openshift-dns/dns-default-8bxm5"
Aug 04 17:46:59.290269 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.290125    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2v6x\" (UniqueName: \"kubernetes.io/projected/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-kube-api-access-c2v6x\") pod \"dns-default-8bxm5\" (UID: \"e1d0f03c-af81-42ad-8fff-4d32ba94c3e7\") " pod="openshift-dns/dns-default-8bxm5"
Aug 04 17:46:59.290269 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.290167    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d5c369c3-199c-4805-9d5b-ffc8d36a1780-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-9c45b7648-x97l7\" (UID: \"d5c369c3-199c-4805-9d5b-ffc8d36a1780\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c45b7648-x97l7"
Aug 04 17:46:59.290269 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.290179    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff200bb2-9a58-43af-9369-3c300edacd50-ca-trust-extracted\") pod \"image-registry-594fdf9495-66w8b\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") " pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:46:59.290269 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.290198    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cb892edb-7af7-4903-9178-4d1070e50a4f-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-5z7qg\" (UID: \"cb892edb-7af7-4903-9178-4d1070e50a4f\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-5z7qg"
Aug 04 17:46:59.290269 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.290226    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff200bb2-9a58-43af-9369-3c300edacd50-installation-pull-secrets\") pod \"image-registry-594fdf9495-66w8b\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") " pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:46:59.290269 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.290253    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84548\" (UniqueName: \"kubernetes.io/projected/7e1b5f8e-8269-4d96-bc60-4cf728aff9cc-kube-api-access-84548\") pod \"klusterlet-addon-workmgr-6f4fb7b886-87x2s\" (UID: \"7e1b5f8e-8269-4d96-bc60-4cf728aff9cc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4fb7b886-87x2s"
Aug 04 17:46:59.290928 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.290279    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-tmp-dir\") pod \"dns-default-8bxm5\" (UID: \"e1d0f03c-af81-42ad-8fff-4d32ba94c3e7\") " pod="openshift-dns/dns-default-8bxm5"
Aug 04 17:46:59.290928 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.290428    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff200bb2-9a58-43af-9369-3c300edacd50-registry-certificates\") pod \"image-registry-594fdf9495-66w8b\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") " pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:46:59.290928 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:59.289766    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-594fdf9495-66w8b: secret "image-registry-tls" not found
Aug 04 17:46:59.290928 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:59.290539    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-registry-tls podName:ff200bb2-9a58-43af-9369-3c300edacd50 nodeName:}" failed. No retries permitted until 2026-08-04 17:46:59.790501611 +0000 UTC m=+36.591637923 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-registry-tls") pod "image-registry-594fdf9495-66w8b" (UID: "ff200bb2-9a58-43af-9369-3c300edacd50") : secret "image-registry-tls" not found
Aug 04 17:46:59.290928 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.290600    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-tmp-dir\") pod \"dns-default-8bxm5\" (UID: \"e1d0f03c-af81-42ad-8fff-4d32ba94c3e7\") " pod="openshift-dns/dns-default-8bxm5"
Aug 04 17:46:59.290928 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.290705    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5c369c3-199c-4805-9d5b-ffc8d36a1780-additional-service-ca\") pod \"cluster-proxy-proxy-agent-9c45b7648-x97l7\" (UID: \"d5c369c3-199c-4805-9d5b-ffc8d36a1780\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c45b7648-x97l7"
Aug 04 17:46:59.290928 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.290760    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff200bb2-9a58-43af-9369-3c300edacd50-trusted-ca\") pod \"image-registry-594fdf9495-66w8b\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") " pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:46:59.290928 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:59.290777    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 17:46:59.290928 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:59.290821    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-metrics-tls podName:e1d0f03c-af81-42ad-8fff-4d32ba94c3e7 nodeName:}" failed. No retries permitted until 2026-08-04 17:46:59.790804951 +0000 UTC m=+36.591941268 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-metrics-tls") pod "dns-default-8bxm5" (UID: "e1d0f03c-af81-42ad-8fff-4d32ba94c3e7") : secret "dns-default-metrics-tls" not found
Aug 04 17:46:59.290928 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:59.290888    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 04 17:46:59.291406 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:59.290945    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb892edb-7af7-4903-9178-4d1070e50a4f-networking-console-plugin-cert podName:cb892edb-7af7-4903-9178-4d1070e50a4f nodeName:}" failed. No retries permitted until 2026-08-04 17:46:59.790929241 +0000 UTC m=+36.592065556 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cb892edb-7af7-4903-9178-4d1070e50a4f-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-5z7qg" (UID: "cb892edb-7af7-4903-9178-4d1070e50a4f") : secret "networking-console-plugin-cert" not found
Aug 04 17:46:59.294792 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.293020    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cb892edb-7af7-4903-9178-4d1070e50a4f-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-5z7qg\" (UID: \"cb892edb-7af7-4903-9178-4d1070e50a4f\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-5z7qg"
Aug 04 17:46:59.294792 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.293812    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-config-volume\") pod \"dns-default-8bxm5\" (UID: \"e1d0f03c-af81-42ad-8fff-4d32ba94c3e7\") " pod="openshift-dns/dns-default-8bxm5"
Aug 04 17:46:59.294951 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.294804    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhg94\" (UniqueName: \"kubernetes.io/projected/d109d386-1913-448d-a113-ca36b9aee7c0-kube-api-access-qhg94\") pod \"ingress-canary-ksm84\" (UID: \"d109d386-1913-448d-a113-ca36b9aee7c0\") " pod="openshift-ingress-canary/ingress-canary-ksm84"
Aug 04 17:46:59.295507 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.295109    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e1b5f8e-8269-4d96-bc60-4cf728aff9cc-tmp\") pod \"klusterlet-addon-workmgr-6f4fb7b886-87x2s\" (UID: \"7e1b5f8e-8269-4d96-bc60-4cf728aff9cc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4fb7b886-87x2s"
Aug 04 17:46:59.295507 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.295314    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d5c369c3-199c-4805-9d5b-ffc8d36a1780-ca\") pod \"cluster-proxy-proxy-agent-9c45b7648-x97l7\" (UID: \"d5c369c3-199c-4805-9d5b-ffc8d36a1780\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c45b7648-x97l7"
Aug 04 17:46:59.295507 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.295321    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d109d386-1913-448d-a113-ca36b9aee7c0-cert\") pod \"ingress-canary-ksm84\" (UID: \"d109d386-1913-448d-a113-ca36b9aee7c0\") " pod="openshift-ingress-canary/ingress-canary-ksm84"
Aug 04 17:46:59.295507 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.295372    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d5c369c3-199c-4805-9d5b-ffc8d36a1780-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-9c45b7648-x97l7\" (UID: \"d5c369c3-199c-4805-9d5b-ffc8d36a1780\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c45b7648-x97l7"
Aug 04 17:46:59.295507 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.295471    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff200bb2-9a58-43af-9369-3c300edacd50-installation-pull-secrets\") pod \"image-registry-594fdf9495-66w8b\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") " pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:46:59.295819 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.295750    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3a5553b1-b587-461d-86f7-a6043849503c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9d54dcfd6-t79zb\" (UID: \"3a5553b1-b587-461d-86f7-a6043849503c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d54dcfd6-t79zb"
Aug 04 17:46:59.295819 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.295805    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d5c369c3-199c-4805-9d5b-ffc8d36a1780-hub\") pod \"cluster-proxy-proxy-agent-9c45b7648-x97l7\" (UID: \"d5c369c3-199c-4805-9d5b-ffc8d36a1780\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c45b7648-x97l7"
Aug 04 17:46:59.295936 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.295919    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff200bb2-9a58-43af-9369-3c300edacd50-image-registry-private-configuration\") pod \"image-registry-594fdf9495-66w8b\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") " pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:46:59.297027 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.297008    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d5c369c3-199c-4805-9d5b-ffc8d36a1780-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-9c45b7648-x97l7\" (UID: \"d5c369c3-199c-4805-9d5b-ffc8d36a1780\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c45b7648-x97l7"
Aug 04 17:46:59.297307 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.297288    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7e1b5f8e-8269-4d96-bc60-4cf728aff9cc-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f4fb7b886-87x2s\" (UID: \"7e1b5f8e-8269-4d96-bc60-4cf728aff9cc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4fb7b886-87x2s"
Aug 04 17:46:59.299017 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.298993    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47j89\" (UniqueName: \"kubernetes.io/projected/d5c369c3-199c-4805-9d5b-ffc8d36a1780-kube-api-access-47j89\") pod \"cluster-proxy-proxy-agent-9c45b7648-x97l7\" (UID: \"d5c369c3-199c-4805-9d5b-ffc8d36a1780\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c45b7648-x97l7"
Aug 04 17:46:59.299481 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.299466    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-bound-sa-token\") pod \"image-registry-594fdf9495-66w8b\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") " pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:46:59.299698 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.299679    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-267vg\" (UniqueName: \"kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-kube-api-access-267vg\") pod \"image-registry-594fdf9495-66w8b\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") " pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:46:59.302632 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.302617    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84548\" (UniqueName: \"kubernetes.io/projected/7e1b5f8e-8269-4d96-bc60-4cf728aff9cc-kube-api-access-84548\") pod \"klusterlet-addon-workmgr-6f4fb7b886-87x2s\" (UID: \"7e1b5f8e-8269-4d96-bc60-4cf728aff9cc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4fb7b886-87x2s"
Aug 04 17:46:59.305107 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.305089    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2v6x\" (UniqueName: \"kubernetes.io/projected/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-kube-api-access-c2v6x\") pod \"dns-default-8bxm5\" (UID: \"e1d0f03c-af81-42ad-8fff-4d32ba94c3e7\") " pod="openshift-dns/dns-default-8bxm5"
Aug 04 17:46:59.305494 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.305472    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njpj6\" (UniqueName: \"kubernetes.io/projected/3a5553b1-b587-461d-86f7-a6043849503c-kube-api-access-njpj6\") pod \"managed-serviceaccount-addon-agent-9d54dcfd6-t79zb\" (UID: \"3a5553b1-b587-461d-86f7-a6043849503c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d54dcfd6-t79zb"
Aug 04 17:46:59.305587 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.305501    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhg94\" (UniqueName: \"kubernetes.io/projected/d109d386-1913-448d-a113-ca36b9aee7c0-kube-api-access-qhg94\") pod \"ingress-canary-ksm84\" (UID: \"d109d386-1913-448d-a113-ca36b9aee7c0\") " pod="openshift-ingress-canary/ingress-canary-ksm84"
Aug 04 17:46:59.312271 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.312241    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xq7xp_59068cff-9e8e-4aa6-af07-d08f484171e9/konnectivity-agent/0.log" limit=1024
Aug 04 17:46:59.405115 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.405061    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d54dcfd6-t79zb"
Aug 04 17:46:59.412094 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.412080    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c45b7648-x97l7"
Aug 04 17:46:59.433533 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.433367    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4fb7b886-87x2s"
Aug 04 17:46:59.447040 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.447016    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ksm84"
Aug 04 17:46:59.611752 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.611688    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d54dcfd6-t79zb"]
Aug 04 17:46:59.617382 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:59.617354    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a5553b1_b587_461d_86f7_a6043849503c.slice/crio-1aab95b80c6575b21e7e03501943d4bb61b7d7c4e7c14119406f75ec03b10ab2 WatchSource:0}: Error finding container 1aab95b80c6575b21e7e03501943d4bb61b7d7c4e7c14119406f75ec03b10ab2: Status 404 returned error can't find the container with id 1aab95b80c6575b21e7e03501943d4bb61b7d7c4e7c14119406f75ec03b10ab2
Aug 04 17:46:59.627823 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.627798    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c45b7648-x97l7"]
Aug 04 17:46:59.630671 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:59.630618    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd5c369c3_199c_4805_9d5b_ffc8d36a1780.slice/crio-f3e40b9e4a0b23caa23a199234bbd5f0f9c81f3faf10576245a809e5c2774a41 WatchSource:0}: Error finding container f3e40b9e4a0b23caa23a199234bbd5f0f9c81f3faf10576245a809e5c2774a41: Status 404 returned error can't find the container with id f3e40b9e4a0b23caa23a199234bbd5f0f9c81f3faf10576245a809e5c2774a41
Aug 04 17:46:59.630770 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.630698    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4fb7b886-87x2s"]
Aug 04 17:46:59.633388 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:59.633363    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e1b5f8e_8269_4d96_bc60_4cf728aff9cc.slice/crio-fd544fedd2b1a237a9fce14506a23ccba67b89f6bc2e0e7046b76f45c2a9ceb3 WatchSource:0}: Error finding container fd544fedd2b1a237a9fce14506a23ccba67b89f6bc2e0e7046b76f45c2a9ceb3: Status 404 returned error can't find the container with id fd544fedd2b1a237a9fce14506a23ccba67b89f6bc2e0e7046b76f45c2a9ceb3
Aug 04 17:46:59.642912 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.642876    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ksm84"]
Aug 04 17:46:59.645283 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:46:59.645261    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd109d386_1913_448d_a113_ca36b9aee7c0.slice/crio-460b0a739313a901e899d39c806de485112b6da21512e41f306a642b4b14e936 WatchSource:0}: Error finding container 460b0a739313a901e899d39c806de485112b6da21512e41f306a642b4b14e936: Status 404 returned error can't find the container with id 460b0a739313a901e899d39c806de485112b6da21512e41f306a642b4b14e936
Aug 04 17:46:59.798314 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.798279    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-metrics-tls\") pod \"dns-default-8bxm5\" (UID: \"e1d0f03c-af81-42ad-8fff-4d32ba94c3e7\") " pod="openshift-dns/dns-default-8bxm5"
Aug 04 17:46:59.798465 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.798376    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cb892edb-7af7-4903-9178-4d1070e50a4f-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-5z7qg\" (UID: \"cb892edb-7af7-4903-9178-4d1070e50a4f\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-5z7qg"
Aug 04 17:46:59.798465 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:59.798413    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 17:46:59.798600 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:59.798479    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-metrics-tls podName:e1d0f03c-af81-42ad-8fff-4d32ba94c3e7 nodeName:}" failed. No retries permitted until 2026-08-04 17:47:00.798459634 +0000 UTC m=+37.599595945 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-metrics-tls") pod "dns-default-8bxm5" (UID: "e1d0f03c-af81-42ad-8fff-4d32ba94c3e7") : secret "dns-default-metrics-tls" not found
Aug 04 17:46:59.798600 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.798417    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-registry-tls\") pod \"image-registry-594fdf9495-66w8b\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") " pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:46:59.798600 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:59.798505    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 17:46:59.798600 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:59.798514    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 04 17:46:59.798600 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:59.798536    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-594fdf9495-66w8b: secret "image-registry-tls" not found
Aug 04 17:46:59.798600 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:59.798586    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-registry-tls podName:ff200bb2-9a58-43af-9369-3c300edacd50 nodeName:}" failed. No retries permitted until 2026-08-04 17:47:00.798573167 +0000 UTC m=+37.599709480 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-registry-tls") pod "image-registry-594fdf9495-66w8b" (UID: "ff200bb2-9a58-43af-9369-3c300edacd50") : secret "image-registry-tls" not found
Aug 04 17:46:59.798600 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:46:59.798600    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb892edb-7af7-4903-9178-4d1070e50a4f-networking-console-plugin-cert podName:cb892edb-7af7-4903-9178-4d1070e50a4f nodeName:}" failed. No retries permitted until 2026-08-04 17:47:00.798594269 +0000 UTC m=+37.599730573 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cb892edb-7af7-4903-9178-4d1070e50a4f-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-5z7qg" (UID: "cb892edb-7af7-4903-9178-4d1070e50a4f") : secret "networking-console-plugin-cert" not found
Aug 04 17:46:59.878155 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.878128    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqhjm"
Aug 04 17:46:59.878155 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.878142    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm47l"
Aug 04 17:46:59.878322 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.878165    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:46:59.880756 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.880739    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 04 17:46:59.881040 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.880982    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 04 17:46:59.881040 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.881014    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dfqn6\""
Aug 04 17:46:59.881040 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.881014    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 04 17:46:59.884541 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.881560    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 04 17:46:59.884541 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:46:59.881017    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5wlqn\""
Aug 04 17:47:00.031028 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:00.030997    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c45b7648-x97l7" event={"ID":"d5c369c3-199c-4805-9d5b-ffc8d36a1780","Type":"ContainerStarted","Data":"f3e40b9e4a0b23caa23a199234bbd5f0f9c81f3faf10576245a809e5c2774a41"}
Aug 04 17:47:00.032162 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:00.032139    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d54dcfd6-t79zb" event={"ID":"3a5553b1-b587-461d-86f7-a6043849503c","Type":"ContainerStarted","Data":"1aab95b80c6575b21e7e03501943d4bb61b7d7c4e7c14119406f75ec03b10ab2"}
Aug 04 17:47:00.033297 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:00.033268    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ksm84" event={"ID":"d109d386-1913-448d-a113-ca36b9aee7c0","Type":"ContainerStarted","Data":"460b0a739313a901e899d39c806de485112b6da21512e41f306a642b4b14e936"}
Aug 04 17:47:00.034342 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:00.034316    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4fb7b886-87x2s" event={"ID":"7e1b5f8e-8269-4d96-bc60-4cf728aff9cc","Type":"ContainerStarted","Data":"fd544fedd2b1a237a9fce14506a23ccba67b89f6bc2e0e7046b76f45c2a9ceb3"}
Aug 04 17:47:00.805602 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:00.805568    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-metrics-tls\") pod \"dns-default-8bxm5\" (UID: \"e1d0f03c-af81-42ad-8fff-4d32ba94c3e7\") " pod="openshift-dns/dns-default-8bxm5"
Aug 04 17:47:00.805780 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:00.805684    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cb892edb-7af7-4903-9178-4d1070e50a4f-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-5z7qg\" (UID: \"cb892edb-7af7-4903-9178-4d1070e50a4f\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-5z7qg"
Aug 04 17:47:00.805780 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:00.805732    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-registry-tls\") pod \"image-registry-594fdf9495-66w8b\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") " pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:47:00.805780 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:47:00.805769    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 17:47:00.805937 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:47:00.805836    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 04 17:47:00.805937 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:47:00.805851    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 17:47:00.805937 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:47:00.805867    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-594fdf9495-66w8b: secret "image-registry-tls" not found
Aug 04 17:47:00.805937 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:47:00.805854    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-metrics-tls podName:e1d0f03c-af81-42ad-8fff-4d32ba94c3e7 nodeName:}" failed. No retries permitted until 2026-08-04 17:47:02.805832493 +0000 UTC m=+39.606968804 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-metrics-tls") pod "dns-default-8bxm5" (UID: "e1d0f03c-af81-42ad-8fff-4d32ba94c3e7") : secret "dns-default-metrics-tls" not found
Aug 04 17:47:00.805937 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:47:00.805916    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb892edb-7af7-4903-9178-4d1070e50a4f-networking-console-plugin-cert podName:cb892edb-7af7-4903-9178-4d1070e50a4f nodeName:}" failed. No retries permitted until 2026-08-04 17:47:02.805900113 +0000 UTC m=+39.607036418 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cb892edb-7af7-4903-9178-4d1070e50a4f-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-5z7qg" (UID: "cb892edb-7af7-4903-9178-4d1070e50a4f") : secret "networking-console-plugin-cert" not found
Aug 04 17:47:00.805937 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:47:00.805934    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-registry-tls podName:ff200bb2-9a58-43af-9369-3c300edacd50 nodeName:}" failed. No retries permitted until 2026-08-04 17:47:02.805923724 +0000 UTC m=+39.607060033 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-registry-tls") pod "image-registry-594fdf9495-66w8b" (UID: "ff200bb2-9a58-43af-9369-3c300edacd50") : secret "image-registry-tls" not found
Aug 04 17:47:02.044385 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:02.044255    2571 generic.go:356] "Generic (PLEG): container finished" podID="9800c9e0-bedf-4d65-a981-0cb8b0726c61" containerID="9bdd97ed48735278dfa2504f0af86e42862fd6e95087b9185031da7f61e622cc" exitCode=0
Aug 04 17:47:02.044385 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:02.044332    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6lrlf" event={"ID":"9800c9e0-bedf-4d65-a981-0cb8b0726c61","Type":"ContainerDied","Data":"9bdd97ed48735278dfa2504f0af86e42862fd6e95087b9185031da7f61e622cc"}
Aug 04 17:47:02.659352 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:02.659242    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xq7xp_59068cff-9e8e-4aa6-af07-d08f484171e9/konnectivity-agent/0.log" limit=1024
Aug 04 17:47:02.823496 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:02.823461    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-metrics-tls\") pod \"dns-default-8bxm5\" (UID: \"e1d0f03c-af81-42ad-8fff-4d32ba94c3e7\") " pod="openshift-dns/dns-default-8bxm5"
Aug 04 17:47:02.823675 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:02.823588    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cb892edb-7af7-4903-9178-4d1070e50a4f-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-5z7qg\" (UID: \"cb892edb-7af7-4903-9178-4d1070e50a4f\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-5z7qg"
Aug 04 17:47:02.823675 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:02.823640    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-registry-tls\") pod \"image-registry-594fdf9495-66w8b\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") " pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:47:02.823675 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:47:02.823645    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 17:47:02.823844 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:47:02.823712    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-metrics-tls podName:e1d0f03c-af81-42ad-8fff-4d32ba94c3e7 nodeName:}" failed. No retries permitted until 2026-08-04 17:47:06.823693 +0000 UTC m=+43.624829316 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-metrics-tls") pod "dns-default-8bxm5" (UID: "e1d0f03c-af81-42ad-8fff-4d32ba94c3e7") : secret "dns-default-metrics-tls" not found
Aug 04 17:47:02.823844 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:47:02.823798    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 17:47:02.823844 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:47:02.823813    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-594fdf9495-66w8b: secret "image-registry-tls" not found
Aug 04 17:47:02.823991 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:47:02.823859    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-registry-tls podName:ff200bb2-9a58-43af-9369-3c300edacd50 nodeName:}" failed. No retries permitted until 2026-08-04 17:47:06.823843702 +0000 UTC m=+43.624980020 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-registry-tls") pod "image-registry-594fdf9495-66w8b" (UID: "ff200bb2-9a58-43af-9369-3c300edacd50") : secret "image-registry-tls" not found
Aug 04 17:47:02.823991 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:47:02.823925    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 04 17:47:02.823991 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:47:02.823959    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb892edb-7af7-4903-9178-4d1070e50a4f-networking-console-plugin-cert podName:cb892edb-7af7-4903-9178-4d1070e50a4f nodeName:}" failed. No retries permitted until 2026-08-04 17:47:06.823948167 +0000 UTC m=+43.625084477 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cb892edb-7af7-4903-9178-4d1070e50a4f-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-5z7qg" (UID: "cb892edb-7af7-4903-9178-4d1070e50a4f") : secret "networking-console-plugin-cert" not found
Aug 04 17:47:02.888782 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:02.888663    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xq7xp_59068cff-9e8e-4aa6-af07-d08f484171e9/konnectivity-agent/0.log" limit=1024
Aug 04 17:47:02.939610 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:02.939483    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xq7xp_59068cff-9e8e-4aa6-af07-d08f484171e9/konnectivity-agent/0.log" limit=1024
Aug 04 17:47:03.051969 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:03.051933    2571 generic.go:356] "Generic (PLEG): container finished" podID="9800c9e0-bedf-4d65-a981-0cb8b0726c61" containerID="9b8973b589daaceb57e20e7787867e3afb1d798636306f3b42b1b3bc792fe55e" exitCode=0
Aug 04 17:47:03.052379 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:03.051996    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6lrlf" event={"ID":"9800c9e0-bedf-4d65-a981-0cb8b0726c61","Type":"ContainerDied","Data":"9b8973b589daaceb57e20e7787867e3afb1d798636306f3b42b1b3bc792fe55e"}
Aug 04 17:47:06.854232 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:06.854208    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-metrics-tls\") pod \"dns-default-8bxm5\" (UID: \"e1d0f03c-af81-42ad-8fff-4d32ba94c3e7\") " pod="openshift-dns/dns-default-8bxm5"
Aug 04 17:47:06.854577 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:06.854312    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cb892edb-7af7-4903-9178-4d1070e50a4f-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-5z7qg\" (UID: \"cb892edb-7af7-4903-9178-4d1070e50a4f\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-5z7qg"
Aug 04 17:47:06.854577 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:47:06.854350    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 17:47:06.854577 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:06.854364    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-registry-tls\") pod \"image-registry-594fdf9495-66w8b\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") " pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:47:06.854577 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:47:06.854409    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-metrics-tls podName:e1d0f03c-af81-42ad-8fff-4d32ba94c3e7 nodeName:}" failed. No retries permitted until 2026-08-04 17:47:14.85438822 +0000 UTC m=+51.655524532 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-metrics-tls") pod "dns-default-8bxm5" (UID: "e1d0f03c-af81-42ad-8fff-4d32ba94c3e7") : secret "dns-default-metrics-tls" not found
Aug 04 17:47:06.854577 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:47:06.854462    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 04 17:47:06.854577 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:47:06.854483    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 17:47:06.854577 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:47:06.854497    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-594fdf9495-66w8b: secret "image-registry-tls" not found
Aug 04 17:47:06.854577 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:47:06.854533    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb892edb-7af7-4903-9178-4d1070e50a4f-networking-console-plugin-cert podName:cb892edb-7af7-4903-9178-4d1070e50a4f nodeName:}" failed. No retries permitted until 2026-08-04 17:47:14.854505771 +0000 UTC m=+51.655642092 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cb892edb-7af7-4903-9178-4d1070e50a4f-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-5z7qg" (UID: "cb892edb-7af7-4903-9178-4d1070e50a4f") : secret "networking-console-plugin-cert" not found
Aug 04 17:47:06.854577 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:47:06.854575    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-registry-tls podName:ff200bb2-9a58-43af-9369-3c300edacd50 nodeName:}" failed. No retries permitted until 2026-08-04 17:47:14.854558683 +0000 UTC m=+51.655695007 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-registry-tls") pod "image-registry-594fdf9495-66w8b" (UID: "ff200bb2-9a58-43af-9369-3c300edacd50") : secret "image-registry-tls" not found
Aug 04 17:47:07.063141 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:07.063054    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d54dcfd6-t79zb" event={"ID":"3a5553b1-b587-461d-86f7-a6043849503c","Type":"ContainerStarted","Data":"89058425f1d35a880b30e6191bfced4d6177af4c264578665f830245abff939b"}
Aug 04 17:47:07.064630 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:07.064600    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ksm84" event={"ID":"d109d386-1913-448d-a113-ca36b9aee7c0","Type":"ContainerStarted","Data":"f6258ddea9a6fc56905a9cee7855aca5ffef18d24ff10872898e766f9057e646"}
Aug 04 17:47:07.067832 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:07.067808    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4fb7b886-87x2s" event={"ID":"7e1b5f8e-8269-4d96-bc60-4cf728aff9cc","Type":"ContainerStarted","Data":"068896964ccad9519c0be7cc52a39b2cbed58423c4ea0b55316d981bddde48d3"}
Aug 04 17:47:07.067996 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:07.067978    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4fb7b886-87x2s"
Aug 04 17:47:07.069892 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:07.069868    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4fb7b886-87x2s"
Aug 04 17:47:07.072045 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:07.072021    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6lrlf" event={"ID":"9800c9e0-bedf-4d65-a981-0cb8b0726c61","Type":"ContainerStarted","Data":"0aae63790887020b7de315a047888e5ee0c85063c85e70e88b6f8143f3909b41"}
Aug 04 17:47:07.083399 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:07.081271    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d54dcfd6-t79zb" podStartSLOduration=7.899344292 podStartE2EDuration="15.081254092s" totalImagesPullingTime="7.1819098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:47:07.079424397 +0000 UTC m=+43.880560725" watchObservedRunningTime="2026-08-04 17:47:07.081254092 +0000 UTC m=+43.882390420"
Aug 04 17:47:07.098299 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:07.098262    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4fb7b886-87x2s" podStartSLOduration=7.911259568 podStartE2EDuration="15.098251488s" totalImagesPullingTime="7.18699192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:47:07.097918324 +0000 UTC m=+43.899054651" watchObservedRunningTime="2026-08-04 17:47:07.098251488 +0000 UTC m=+43.899387795"
Aug 04 17:47:07.115247 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:07.115203    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ksm84" podStartSLOduration=0.959857127 podStartE2EDuration="8.115193474s" totalImagesPullingTime="7.155336347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:46:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:47:07.114946971 +0000 UTC m=+43.916083329" watchObservedRunningTime="2026-08-04 17:47:07.115193474 +0000 UTC m=+43.916329783"
Aug 04 17:47:07.140371 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:07.140327    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6lrlf" podStartSLOduration=11.646039629 podStartE2EDuration="43.140311931s" totalImagesPullingTime="31.494272302s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:46:24 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:47:07.13913927 +0000 UTC m=+43.940275616" watchObservedRunningTime="2026-08-04 17:47:07.140311931 +0000 UTC m=+43.941448259"
Aug 04 17:47:07.264135 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:07.264115    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xq7xp_59068cff-9e8e-4aa6-af07-d08f484171e9/konnectivity-agent/0.log" limit=1024
Aug 04 17:47:07.362074 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:07.362012    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xq7xp_59068cff-9e8e-4aa6-af07-d08f484171e9/konnectivity-agent/0.log" limit=1024
Aug 04 17:47:12.086985 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:12.086952    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c45b7648-x97l7" event={"ID":"d5c369c3-199c-4805-9d5b-ffc8d36a1780","Type":"ContainerStarted","Data":"2b6da0b15f87854d3bc9b8b60a9b08732e188fe3bef1e6f278d9c5d16092fca7"}
Aug 04 17:47:12.087359 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:12.086991    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c45b7648-x97l7" event={"ID":"d5c369c3-199c-4805-9d5b-ffc8d36a1780","Type":"ContainerStarted","Data":"6fd664779552b5468fbf5f18ef06a7202eb7ca8baf02acfa72096b3c5f24e3bf"}
Aug 04 17:47:12.087359 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:12.087005    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c45b7648-x97l7" event={"ID":"d5c369c3-199c-4805-9d5b-ffc8d36a1780","Type":"ContainerStarted","Data":"b85b897005cbdb523d339581ccb038c9aef2456e94f5a394a0c930fa5dd643ce"}
Aug 04 17:47:12.104978 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:12.104938    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c45b7648-x97l7" podStartSLOduration=8.671384935 podStartE2EDuration="20.10489053s" totalImagesPullingTime="11.433505595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:47:12.103452336 +0000 UTC m=+48.904588664" watchObservedRunningTime="2026-08-04 17:47:12.10489053 +0000 UTC m=+48.906026857"
Aug 04 17:47:14.918217 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:14.918186    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cb892edb-7af7-4903-9178-4d1070e50a4f-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-5z7qg\" (UID: \"cb892edb-7af7-4903-9178-4d1070e50a4f\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-5z7qg"
Aug 04 17:47:14.918619 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:14.918227    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-registry-tls\") pod \"image-registry-594fdf9495-66w8b\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") " pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:47:14.918619 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:14.918251    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-metrics-tls\") pod \"dns-default-8bxm5\" (UID: \"e1d0f03c-af81-42ad-8fff-4d32ba94c3e7\") " pod="openshift-dns/dns-default-8bxm5"
Aug 04 17:47:14.918619 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:47:14.918321    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 17:47:14.918619 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:47:14.918332    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 04 17:47:14.918619 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:47:14.918335    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 17:47:14.918619 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:47:14.918375    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-594fdf9495-66w8b: secret "image-registry-tls" not found
Aug 04 17:47:14.918619 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:47:14.918368    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-metrics-tls podName:e1d0f03c-af81-42ad-8fff-4d32ba94c3e7 nodeName:}" failed. No retries permitted until 2026-08-04 17:47:30.918355524 +0000 UTC m=+67.719491829 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-metrics-tls") pod "dns-default-8bxm5" (UID: "e1d0f03c-af81-42ad-8fff-4d32ba94c3e7") : secret "dns-default-metrics-tls" not found
Aug 04 17:47:14.918619 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:47:14.918408    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb892edb-7af7-4903-9178-4d1070e50a4f-networking-console-plugin-cert podName:cb892edb-7af7-4903-9178-4d1070e50a4f nodeName:}" failed. No retries permitted until 2026-08-04 17:47:30.918395978 +0000 UTC m=+67.719532283 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cb892edb-7af7-4903-9178-4d1070e50a4f-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-5z7qg" (UID: "cb892edb-7af7-4903-9178-4d1070e50a4f") : secret "networking-console-plugin-cert" not found
Aug 04 17:47:14.918619 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:47:14.918444    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-registry-tls podName:ff200bb2-9a58-43af-9369-3c300edacd50 nodeName:}" failed. No retries permitted until 2026-08-04 17:47:30.918414518 +0000 UTC m=+67.719550836 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-registry-tls") pod "image-registry-594fdf9495-66w8b" (UID: "ff200bb2-9a58-43af-9369-3c300edacd50") : secret "image-registry-tls" not found
Aug 04 17:47:25.033057 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:25.033031    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lwmwl"
Aug 04 17:47:28.415765 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:28.415729    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cec46231-ba14-4b07-b2b1-df119f58db12-metrics-certs\") pod \"network-metrics-daemon-bqph9\" (UID: \"cec46231-ba14-4b07-b2b1-df119f58db12\") " pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:47:28.418172 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:28.418152    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 04 17:47:28.426033 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:47:28.426017    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Aug 04 17:47:28.426105 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:47:28.426090    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cec46231-ba14-4b07-b2b1-df119f58db12-metrics-certs podName:cec46231-ba14-4b07-b2b1-df119f58db12 nodeName:}" failed. No retries permitted until 2026-08-04 17:48:32.426070569 +0000 UTC m=+129.227206888 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cec46231-ba14-4b07-b2b1-df119f58db12-metrics-certs") pod "network-metrics-daemon-bqph9" (UID: "cec46231-ba14-4b07-b2b1-df119f58db12") : secret "metrics-daemon-secret" not found
Aug 04 17:47:28.516873 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:28.516845    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/175017d4-1fb6-4129-b96f-4990959c3a8b-original-pull-secret\") pod \"global-pull-secret-syncer-pm47l\" (UID: \"175017d4-1fb6-4129-b96f-4990959c3a8b\") " pod="kube-system/global-pull-secret-syncer-pm47l"
Aug 04 17:47:28.519164 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:28.519149    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 04 17:47:28.530222 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:28.530199    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/175017d4-1fb6-4129-b96f-4990959c3a8b-original-pull-secret\") pod \"global-pull-secret-syncer-pm47l\" (UID: \"175017d4-1fb6-4129-b96f-4990959c3a8b\") " pod="kube-system/global-pull-secret-syncer-pm47l"
Aug 04 17:47:28.617218 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:28.617190    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjgxv\" (UniqueName: \"kubernetes.io/projected/a63fe4d6-9f64-4faa-bef7-93be6cde4970-kube-api-access-sjgxv\") pod \"network-check-target-qqhjm\" (UID: \"a63fe4d6-9f64-4faa-bef7-93be6cde4970\") " pod="openshift-network-diagnostics/network-check-target-qqhjm"
Aug 04 17:47:28.619404 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:28.619384    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 04 17:47:28.629706 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:28.629691    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 04 17:47:28.640480 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:28.640458    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjgxv\" (UniqueName: \"kubernetes.io/projected/a63fe4d6-9f64-4faa-bef7-93be6cde4970-kube-api-access-sjgxv\") pod \"network-check-target-qqhjm\" (UID: \"a63fe4d6-9f64-4faa-bef7-93be6cde4970\") " pod="openshift-network-diagnostics/network-check-target-qqhjm"
Aug 04 17:47:28.695784 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:28.695742    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dfqn6\""
Aug 04 17:47:28.701389 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:28.701369    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm47l"
Aug 04 17:47:28.704548 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:28.704513    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqhjm"
Aug 04 17:47:28.826711 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:28.826683    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qqhjm"]
Aug 04 17:47:28.829925 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:47:28.829890    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda63fe4d6_9f64_4faa_bef7_93be6cde4970.slice/crio-211b8eff83fa8552ff07be04b5a979258b00e019945626bed92071d3409c9cfc WatchSource:0}: Error finding container 211b8eff83fa8552ff07be04b5a979258b00e019945626bed92071d3409c9cfc: Status 404 returned error can't find the container with id 211b8eff83fa8552ff07be04b5a979258b00e019945626bed92071d3409c9cfc
Aug 04 17:47:28.840115 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:28.840092    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pm47l"]
Aug 04 17:47:28.842436 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:47:28.842418    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod175017d4_1fb6_4129_b96f_4990959c3a8b.slice/crio-ff442d9e8f9520d3c899586322f5e156a779827db4323b232c9c6d1148fc2889 WatchSource:0}: Error finding container ff442d9e8f9520d3c899586322f5e156a779827db4323b232c9c6d1148fc2889: Status 404 returned error can't find the container with id ff442d9e8f9520d3c899586322f5e156a779827db4323b232c9c6d1148fc2889
Aug 04 17:47:29.135832 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:29.135799    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pm47l" event={"ID":"175017d4-1fb6-4129-b96f-4990959c3a8b","Type":"ContainerStarted","Data":"ff442d9e8f9520d3c899586322f5e156a779827db4323b232c9c6d1148fc2889"}
Aug 04 17:47:29.136828 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:29.136808    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qqhjm" event={"ID":"a63fe4d6-9f64-4faa-bef7-93be6cde4970","Type":"ContainerStarted","Data":"211b8eff83fa8552ff07be04b5a979258b00e019945626bed92071d3409c9cfc"}
Aug 04 17:47:30.934901 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:30.934866    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cb892edb-7af7-4903-9178-4d1070e50a4f-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-5z7qg\" (UID: \"cb892edb-7af7-4903-9178-4d1070e50a4f\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-5z7qg"
Aug 04 17:47:30.935366 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:30.934928    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-registry-tls\") pod \"image-registry-594fdf9495-66w8b\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") " pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:47:30.935366 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:30.934968    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-metrics-tls\") pod \"dns-default-8bxm5\" (UID: \"e1d0f03c-af81-42ad-8fff-4d32ba94c3e7\") " pod="openshift-dns/dns-default-8bxm5"
Aug 04 17:47:30.935366 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:47:30.935031    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 04 17:47:30.935366 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:47:30.935095    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 17:47:30.935366 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:47:30.935108    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb892edb-7af7-4903-9178-4d1070e50a4f-networking-console-plugin-cert podName:cb892edb-7af7-4903-9178-4d1070e50a4f nodeName:}" failed. No retries permitted until 2026-08-04 17:48:02.935090437 +0000 UTC m=+99.736226747 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cb892edb-7af7-4903-9178-4d1070e50a4f-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-5z7qg" (UID: "cb892edb-7af7-4903-9178-4d1070e50a4f") : secret "networking-console-plugin-cert" not found
Aug 04 17:47:30.935366 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:47:30.935155    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-metrics-tls podName:e1d0f03c-af81-42ad-8fff-4d32ba94c3e7 nodeName:}" failed. No retries permitted until 2026-08-04 17:48:02.935138894 +0000 UTC m=+99.736275204 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-metrics-tls") pod "dns-default-8bxm5" (UID: "e1d0f03c-af81-42ad-8fff-4d32ba94c3e7") : secret "dns-default-metrics-tls" not found
Aug 04 17:47:30.935366 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:47:30.935034    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 17:47:30.935366 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:47:30.935176    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-594fdf9495-66w8b: secret "image-registry-tls" not found
Aug 04 17:47:30.935366 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:47:30.935208    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-registry-tls podName:ff200bb2-9a58-43af-9369-3c300edacd50 nodeName:}" failed. No retries permitted until 2026-08-04 17:48:02.935198072 +0000 UTC m=+99.736334391 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-registry-tls") pod "image-registry-594fdf9495-66w8b" (UID: "ff200bb2-9a58-43af-9369-3c300edacd50") : secret "image-registry-tls" not found
Aug 04 17:47:34.157167 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:34.157130    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qqhjm" event={"ID":"a63fe4d6-9f64-4faa-bef7-93be6cde4970","Type":"ContainerStarted","Data":"ee0090f3af239d0766cbb95d299149616fde2b52c330d2c92943e7a76b791c5f"}
Aug 04 17:47:34.157616 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:34.157222    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qqhjm"
Aug 04 17:47:34.158495 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:34.158475    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pm47l" event={"ID":"175017d4-1fb6-4129-b96f-4990959c3a8b","Type":"ContainerStarted","Data":"3f76a6c6c54ba8644e5ce904732febadd5838c4f2c227e79217db49a350e17cc"}
Aug 04 17:47:34.172242 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:34.172204    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qqhjm" podStartSLOduration=65.443799978 podStartE2EDuration="1m10.172193143s" totalImagesPullingTime="4.728393165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:46:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:47:34.171143277 +0000 UTC m=+70.972279603" watchObservedRunningTime="2026-08-04 17:47:34.172193143 +0000 UTC m=+70.973329470"
Aug 04 17:47:34.184267 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:47:34.184231    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pm47l" podStartSLOduration=65.45340327 podStartE2EDuration="1m10.184218612s" totalImagesPullingTime="4.730815342s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:46:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:47:34.183800162 +0000 UTC m=+70.984936490" watchObservedRunningTime="2026-08-04 17:47:34.184218612 +0000 UTC m=+70.985354939"
Aug 04 17:48:02.961745 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:48:02.961629    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-metrics-tls\") pod \"dns-default-8bxm5\" (UID: \"e1d0f03c-af81-42ad-8fff-4d32ba94c3e7\") " pod="openshift-dns/dns-default-8bxm5"
Aug 04 17:48:02.961745 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:48:02.961719    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cb892edb-7af7-4903-9178-4d1070e50a4f-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-5z7qg\" (UID: \"cb892edb-7af7-4903-9178-4d1070e50a4f\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-5z7qg"
Aug 04 17:48:02.962278 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:48:02.961764    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 17:48:02.962278 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:48:02.961840    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 04 17:48:02.962278 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:48:02.961849    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 17:48:02.962278 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:48:02.961766    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-registry-tls\") pod \"image-registry-594fdf9495-66w8b\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") " pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:48:02.962278 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:48:02.961861    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-594fdf9495-66w8b: secret "image-registry-tls" not found
Aug 04 17:48:02.962278 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:48:02.961845    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-metrics-tls podName:e1d0f03c-af81-42ad-8fff-4d32ba94c3e7 nodeName:}" failed. No retries permitted until 2026-08-04 17:49:06.961826654 +0000 UTC m=+163.762962960 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-metrics-tls") pod "dns-default-8bxm5" (UID: "e1d0f03c-af81-42ad-8fff-4d32ba94c3e7") : secret "dns-default-metrics-tls" not found
Aug 04 17:48:02.962278 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:48:02.961914    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb892edb-7af7-4903-9178-4d1070e50a4f-networking-console-plugin-cert podName:cb892edb-7af7-4903-9178-4d1070e50a4f nodeName:}" failed. No retries permitted until 2026-08-04 17:49:06.961899414 +0000 UTC m=+163.763035720 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cb892edb-7af7-4903-9178-4d1070e50a4f-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-5z7qg" (UID: "cb892edb-7af7-4903-9178-4d1070e50a4f") : secret "networking-console-plugin-cert" not found
Aug 04 17:48:02.962278 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:48:02.961929    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-registry-tls podName:ff200bb2-9a58-43af-9369-3c300edacd50 nodeName:}" failed. No retries permitted until 2026-08-04 17:49:06.961921525 +0000 UTC m=+163.763057830 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-registry-tls") pod "image-registry-594fdf9495-66w8b" (UID: "ff200bb2-9a58-43af-9369-3c300edacd50") : secret "image-registry-tls" not found
Aug 04 17:48:05.162825 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:48:05.162797    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qqhjm"
Aug 04 17:48:32.462146 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:48:32.462106    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cec46231-ba14-4b07-b2b1-df119f58db12-metrics-certs\") pod \"network-metrics-daemon-bqph9\" (UID: \"cec46231-ba14-4b07-b2b1-df119f58db12\") " pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:48:32.462588 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:48:32.462254    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Aug 04 17:48:32.462588 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:48:32.462317    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cec46231-ba14-4b07-b2b1-df119f58db12-metrics-certs podName:cec46231-ba14-4b07-b2b1-df119f58db12 nodeName:}" failed. No retries permitted until 2026-08-04 17:50:34.462301983 +0000 UTC m=+251.263438291 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cec46231-ba14-4b07-b2b1-df119f58db12-metrics-certs") pod "network-metrics-daemon-bqph9" (UID: "cec46231-ba14-4b07-b2b1-df119f58db12") : secret "metrics-daemon-secret" not found
Aug 04 17:49:02.074006 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:49:02.073970    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-f77f48c6d-5z7qg" podUID="cb892edb-7af7-4903-9178-4d1070e50a4f"
Aug 04 17:49:02.084148 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:49:02.084117    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-594fdf9495-66w8b" podUID="ff200bb2-9a58-43af-9369-3c300edacd50"
Aug 04 17:49:02.141560 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:49:02.141534    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8bxm5" podUID="e1d0f03c-af81-42ad-8fff-4d32ba94c3e7"
Aug 04 17:49:02.384000 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:49:02.383949    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8bxm5"
Aug 04 17:49:02.384073 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:49:02.383949    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-5z7qg"
Aug 04 17:49:02.384073 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:49:02.383962    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:49:02.906605 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:49:02.906580    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-bqph9" podUID="cec46231-ba14-4b07-b2b1-df119f58db12"
Aug 04 17:49:07.002752 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:49:07.002633    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cb892edb-7af7-4903-9178-4d1070e50a4f-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-5z7qg\" (UID: \"cb892edb-7af7-4903-9178-4d1070e50a4f\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-5z7qg"
Aug 04 17:49:07.002752 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:49:07.002673    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-registry-tls\") pod \"image-registry-594fdf9495-66w8b\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") " pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:49:07.002752 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:49:07.002716    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-metrics-tls\") pod \"dns-default-8bxm5\" (UID: \"e1d0f03c-af81-42ad-8fff-4d32ba94c3e7\") " pod="openshift-dns/dns-default-8bxm5"
Aug 04 17:49:07.003026 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:49:07.002775    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 04 17:49:07.003026 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:49:07.002819    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 17:49:07.003026 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:49:07.002836    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb892edb-7af7-4903-9178-4d1070e50a4f-networking-console-plugin-cert podName:cb892edb-7af7-4903-9178-4d1070e50a4f nodeName:}" failed. No retries permitted until 2026-08-04 17:51:09.002817323 +0000 UTC m=+285.803953640 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cb892edb-7af7-4903-9178-4d1070e50a4f-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-5z7qg" (UID: "cb892edb-7af7-4903-9178-4d1070e50a4f") : secret "networking-console-plugin-cert" not found
Aug 04 17:49:07.003026 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:49:07.002836    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-594fdf9495-66w8b: secret "image-registry-tls" not found
Aug 04 17:49:07.003026 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:49:07.002865    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-registry-tls podName:ff200bb2-9a58-43af-9369-3c300edacd50 nodeName:}" failed. No retries permitted until 2026-08-04 17:51:09.002858093 +0000 UTC m=+285.803994397 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-registry-tls") pod "image-registry-594fdf9495-66w8b" (UID: "ff200bb2-9a58-43af-9369-3c300edacd50") : secret "image-registry-tls" not found
Aug 04 17:49:07.003026 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:49:07.002821    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 17:49:07.003026 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:49:07.002886    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-metrics-tls podName:e1d0f03c-af81-42ad-8fff-4d32ba94c3e7 nodeName:}" failed. No retries permitted until 2026-08-04 17:51:09.002879141 +0000 UTC m=+285.804015446 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-metrics-tls") pod "dns-default-8bxm5" (UID: "e1d0f03c-af81-42ad-8fff-4d32ba94c3e7") : secret "dns-default-metrics-tls" not found
Aug 04 17:49:07.068753 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:49:07.068722    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4fb7b886-87x2s" podUID="7e1b5f8e-8269-4d96-bc60-4cf728aff9cc" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.9:8000/readyz\": dial tcp 10.132.0.9:8000: connect: connection refused"
Aug 04 17:49:07.398259 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:49:07.398235    2571 generic.go:356] "Generic (PLEG): container finished" podID="7e1b5f8e-8269-4d96-bc60-4cf728aff9cc" containerID="068896964ccad9519c0be7cc52a39b2cbed58423c4ea0b55316d981bddde48d3" exitCode=1
Aug 04 17:49:07.398457 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:49:07.398312    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4fb7b886-87x2s" event={"ID":"7e1b5f8e-8269-4d96-bc60-4cf728aff9cc","Type":"ContainerDied","Data":"068896964ccad9519c0be7cc52a39b2cbed58423c4ea0b55316d981bddde48d3"}
Aug 04 17:49:07.398664 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:49:07.398650    2571 scope.go:117] "RemoveContainer" containerID="068896964ccad9519c0be7cc52a39b2cbed58423c4ea0b55316d981bddde48d3"
Aug 04 17:49:07.399774 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:49:07.399714    2571 generic.go:356] "Generic (PLEG): container finished" podID="3a5553b1-b587-461d-86f7-a6043849503c" containerID="89058425f1d35a880b30e6191bfced4d6177af4c264578665f830245abff939b" exitCode=255
Aug 04 17:49:07.399774 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:49:07.399752    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d54dcfd6-t79zb" event={"ID":"3a5553b1-b587-461d-86f7-a6043849503c","Type":"ContainerDied","Data":"89058425f1d35a880b30e6191bfced4d6177af4c264578665f830245abff939b"}
Aug 04 17:49:07.400035 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:49:07.400021    2571 scope.go:117] "RemoveContainer" containerID="89058425f1d35a880b30e6191bfced4d6177af4c264578665f830245abff939b"
Aug 04 17:49:08.404476 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:49:08.404442    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d54dcfd6-t79zb" event={"ID":"3a5553b1-b587-461d-86f7-a6043849503c","Type":"ContainerStarted","Data":"a450befab852e6f2948694857c10d1927fa7db1a150c0ffd11b30fe99a0dbb1b"}
Aug 04 17:49:08.406079 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:49:08.406058    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4fb7b886-87x2s" event={"ID":"7e1b5f8e-8269-4d96-bc60-4cf728aff9cc","Type":"ContainerStarted","Data":"ac39402332c9c0fc016ff4e03a4b5cb612d53dcd3d9e183e3f34526904102595"}
Aug 04 17:49:08.406317 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:49:08.406302    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4fb7b886-87x2s"
Aug 04 17:49:08.406866 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:49:08.406849    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4fb7b886-87x2s"
Aug 04 17:49:13.875979 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:49:13.875943    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:50:34.469535 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:34.469478    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cec46231-ba14-4b07-b2b1-df119f58db12-metrics-certs\") pod \"network-metrics-daemon-bqph9\" (UID: \"cec46231-ba14-4b07-b2b1-df119f58db12\") " pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:50:34.470023 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:50:34.469606    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Aug 04 17:50:34.470023 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:50:34.469670    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cec46231-ba14-4b07-b2b1-df119f58db12-metrics-certs podName:cec46231-ba14-4b07-b2b1-df119f58db12 nodeName:}" failed. No retries permitted until 2026-08-04 17:52:36.469654481 +0000 UTC m=+373.270790786 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cec46231-ba14-4b07-b2b1-df119f58db12-metrics-certs") pod "network-metrics-daemon-bqph9" (UID: "cec46231-ba14-4b07-b2b1-df119f58db12") : secret "metrics-daemon-secret" not found
Aug 04 17:50:38.456406 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:38.456372    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-s2256"]
Aug 04 17:50:38.459325 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:38.459304    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s2256"
Aug 04 17:50:38.461530 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:38.461500    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Aug 04 17:50:38.461637 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:38.461609    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tv89b\""
Aug 04 17:50:38.461754 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:38.461668    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Aug 04 17:50:38.462357 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:38.462341    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Aug 04 17:50:38.462435 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:38.462360    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Aug 04 17:50:38.470727 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:38.470711    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s2256"]
Aug 04 17:50:38.492114 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:38.492092    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3cd662d-7512-46f5-8fcc-46055872098e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s2256\" (UID: \"b3cd662d-7512-46f5-8fcc-46055872098e\") " pod="openshift-insights/insights-runtime-extractor-s2256"
Aug 04 17:50:38.492200 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:38.492140    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b3cd662d-7512-46f5-8fcc-46055872098e-crio-socket\") pod \"insights-runtime-extractor-s2256\" (UID: \"b3cd662d-7512-46f5-8fcc-46055872098e\") " pod="openshift-insights/insights-runtime-extractor-s2256"
Aug 04 17:50:38.492200 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:38.492159    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3cd662d-7512-46f5-8fcc-46055872098e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s2256\" (UID: \"b3cd662d-7512-46f5-8fcc-46055872098e\") " pod="openshift-insights/insights-runtime-extractor-s2256"
Aug 04 17:50:38.492268 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:38.492206    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glbqv\" (UniqueName: \"kubernetes.io/projected/b3cd662d-7512-46f5-8fcc-46055872098e-kube-api-access-glbqv\") pod \"insights-runtime-extractor-s2256\" (UID: \"b3cd662d-7512-46f5-8fcc-46055872098e\") " pod="openshift-insights/insights-runtime-extractor-s2256"
Aug 04 17:50:38.492268 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:38.492228    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3cd662d-7512-46f5-8fcc-46055872098e-data-volume\") pod \"insights-runtime-extractor-s2256\" (UID: \"b3cd662d-7512-46f5-8fcc-46055872098e\") " pod="openshift-insights/insights-runtime-extractor-s2256"
Aug 04 17:50:38.594567 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:38.594540    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b3cd662d-7512-46f5-8fcc-46055872098e-crio-socket\") pod \"insights-runtime-extractor-s2256\" (UID: \"b3cd662d-7512-46f5-8fcc-46055872098e\") " pod="openshift-insights/insights-runtime-extractor-s2256"
Aug 04 17:50:38.594801 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:38.594592    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3cd662d-7512-46f5-8fcc-46055872098e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s2256\" (UID: \"b3cd662d-7512-46f5-8fcc-46055872098e\") " pod="openshift-insights/insights-runtime-extractor-s2256"
Aug 04 17:50:38.594801 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:38.594631    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glbqv\" (UniqueName: \"kubernetes.io/projected/b3cd662d-7512-46f5-8fcc-46055872098e-kube-api-access-glbqv\") pod \"insights-runtime-extractor-s2256\" (UID: \"b3cd662d-7512-46f5-8fcc-46055872098e\") " pod="openshift-insights/insights-runtime-extractor-s2256"
Aug 04 17:50:38.594801 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:38.594662    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3cd662d-7512-46f5-8fcc-46055872098e-data-volume\") pod \"insights-runtime-extractor-s2256\" (UID: \"b3cd662d-7512-46f5-8fcc-46055872098e\") " pod="openshift-insights/insights-runtime-extractor-s2256"
Aug 04 17:50:38.594801 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:38.594739    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3cd662d-7512-46f5-8fcc-46055872098e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s2256\" (UID: \"b3cd662d-7512-46f5-8fcc-46055872098e\") " pod="openshift-insights/insights-runtime-extractor-s2256"
Aug 04 17:50:38.594992 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:50:38.594848    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 17:50:38.594992 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:50:38.594914    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3cd662d-7512-46f5-8fcc-46055872098e-kube-rbac-proxy-cm podName:b3cd662d-7512-46f5-8fcc-46055872098e nodeName:}" failed. No retries permitted until 2026-08-04 17:50:39.094896781 +0000 UTC m=+255.896033100 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b3cd662d-7512-46f5-8fcc-46055872098e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s2256" (UID: "b3cd662d-7512-46f5-8fcc-46055872098e") : configmap "kube-rbac-proxy" not found
Aug 04 17:50:38.595204 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:38.595184    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b3cd662d-7512-46f5-8fcc-46055872098e-crio-socket\") pod \"insights-runtime-extractor-s2256\" (UID: \"b3cd662d-7512-46f5-8fcc-46055872098e\") " pod="openshift-insights/insights-runtime-extractor-s2256"
Aug 04 17:50:38.595307 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:50:38.595293    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 17:50:38.595368 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:50:38.595346    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3cd662d-7512-46f5-8fcc-46055872098e-insights-runtime-extractor-tls podName:b3cd662d-7512-46f5-8fcc-46055872098e nodeName:}" failed. No retries permitted until 2026-08-04 17:50:39.09533125 +0000 UTC m=+255.896467558 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b3cd662d-7512-46f5-8fcc-46055872098e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s2256" (UID: "b3cd662d-7512-46f5-8fcc-46055872098e") : secret "insights-runtime-extractor-tls" not found
Aug 04 17:50:38.595847 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:38.595827    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3cd662d-7512-46f5-8fcc-46055872098e-data-volume\") pod \"insights-runtime-extractor-s2256\" (UID: \"b3cd662d-7512-46f5-8fcc-46055872098e\") " pod="openshift-insights/insights-runtime-extractor-s2256"
Aug 04 17:50:38.602820 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:38.602792    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glbqv\" (UniqueName: \"kubernetes.io/projected/b3cd662d-7512-46f5-8fcc-46055872098e-kube-api-access-glbqv\") pod \"insights-runtime-extractor-s2256\" (UID: \"b3cd662d-7512-46f5-8fcc-46055872098e\") " pod="openshift-insights/insights-runtime-extractor-s2256"
Aug 04 17:50:39.099506 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:39.099484    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3cd662d-7512-46f5-8fcc-46055872098e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s2256\" (UID: \"b3cd662d-7512-46f5-8fcc-46055872098e\") " pod="openshift-insights/insights-runtime-extractor-s2256"
Aug 04 17:50:39.099603 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:39.099544    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3cd662d-7512-46f5-8fcc-46055872098e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s2256\" (UID: \"b3cd662d-7512-46f5-8fcc-46055872098e\") " pod="openshift-insights/insights-runtime-extractor-s2256"
Aug 04 17:50:39.099650 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:50:39.099622    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 17:50:39.099650 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:50:39.099640    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 17:50:39.099716 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:50:39.099669    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3cd662d-7512-46f5-8fcc-46055872098e-insights-runtime-extractor-tls podName:b3cd662d-7512-46f5-8fcc-46055872098e nodeName:}" failed. No retries permitted until 2026-08-04 17:50:40.09965772 +0000 UTC m=+256.900794028 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b3cd662d-7512-46f5-8fcc-46055872098e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s2256" (UID: "b3cd662d-7512-46f5-8fcc-46055872098e") : secret "insights-runtime-extractor-tls" not found
Aug 04 17:50:39.099716 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:50:39.099687    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3cd662d-7512-46f5-8fcc-46055872098e-kube-rbac-proxy-cm podName:b3cd662d-7512-46f5-8fcc-46055872098e nodeName:}" failed. No retries permitted until 2026-08-04 17:50:40.099674941 +0000 UTC m=+256.900811246 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b3cd662d-7512-46f5-8fcc-46055872098e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s2256" (UID: "b3cd662d-7512-46f5-8fcc-46055872098e") : configmap "kube-rbac-proxy" not found
Aug 04 17:50:40.105885 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:40.105852    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3cd662d-7512-46f5-8fcc-46055872098e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s2256\" (UID: \"b3cd662d-7512-46f5-8fcc-46055872098e\") " pod="openshift-insights/insights-runtime-extractor-s2256"
Aug 04 17:50:40.106384 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:40.105912    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3cd662d-7512-46f5-8fcc-46055872098e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s2256\" (UID: \"b3cd662d-7512-46f5-8fcc-46055872098e\") " pod="openshift-insights/insights-runtime-extractor-s2256"
Aug 04 17:50:40.106384 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:50:40.105972    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 17:50:40.106384 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:50:40.106012    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 17:50:40.106384 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:50:40.106039    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3cd662d-7512-46f5-8fcc-46055872098e-kube-rbac-proxy-cm podName:b3cd662d-7512-46f5-8fcc-46055872098e nodeName:}" failed. No retries permitted until 2026-08-04 17:50:42.106020764 +0000 UTC m=+258.907157070 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b3cd662d-7512-46f5-8fcc-46055872098e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s2256" (UID: "b3cd662d-7512-46f5-8fcc-46055872098e") : configmap "kube-rbac-proxy" not found
Aug 04 17:50:40.106384 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:50:40.106059    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3cd662d-7512-46f5-8fcc-46055872098e-insights-runtime-extractor-tls podName:b3cd662d-7512-46f5-8fcc-46055872098e nodeName:}" failed. No retries permitted until 2026-08-04 17:50:42.106049401 +0000 UTC m=+258.907185706 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b3cd662d-7512-46f5-8fcc-46055872098e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s2256" (UID: "b3cd662d-7512-46f5-8fcc-46055872098e") : secret "insights-runtime-extractor-tls" not found
Aug 04 17:50:40.434548 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:40.434487    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qgjr8_4ff78307-0cd9-4551-9b67-95943e190bfe/dns-node-resolver/0.log"
Aug 04 17:50:41.233629 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:41.233607    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-64wn5_fbf8aa50-191e-49a4-8a78-c03a83900d95/node-ca/0.log"
Aug 04 17:50:42.120615 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:42.120585    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3cd662d-7512-46f5-8fcc-46055872098e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s2256\" (UID: \"b3cd662d-7512-46f5-8fcc-46055872098e\") " pod="openshift-insights/insights-runtime-extractor-s2256"
Aug 04 17:50:42.120758 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:42.120645    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3cd662d-7512-46f5-8fcc-46055872098e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s2256\" (UID: \"b3cd662d-7512-46f5-8fcc-46055872098e\") " pod="openshift-insights/insights-runtime-extractor-s2256"
Aug 04 17:50:42.120758 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:50:42.120717    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 17:50:42.120843 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:50:42.120769    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3cd662d-7512-46f5-8fcc-46055872098e-insights-runtime-extractor-tls podName:b3cd662d-7512-46f5-8fcc-46055872098e nodeName:}" failed. No retries permitted until 2026-08-04 17:50:46.120756022 +0000 UTC m=+262.921892327 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b3cd662d-7512-46f5-8fcc-46055872098e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s2256" (UID: "b3cd662d-7512-46f5-8fcc-46055872098e") : secret "insights-runtime-extractor-tls" not found
Aug 04 17:50:42.120843 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:50:42.120720    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 17:50:42.120918 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:50:42.120868    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3cd662d-7512-46f5-8fcc-46055872098e-kube-rbac-proxy-cm podName:b3cd662d-7512-46f5-8fcc-46055872098e nodeName:}" failed. No retries permitted until 2026-08-04 17:50:46.12085474 +0000 UTC m=+262.921991046 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b3cd662d-7512-46f5-8fcc-46055872098e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s2256" (UID: "b3cd662d-7512-46f5-8fcc-46055872098e") : configmap "kube-rbac-proxy" not found
Aug 04 17:50:42.234331 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:42.234309    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ksm84_d109d386-1913-448d-a113-ca36b9aee7c0/serve-healthcheck-canary/0.log"
Aug 04 17:50:46.148368 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:46.148287    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3cd662d-7512-46f5-8fcc-46055872098e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s2256\" (UID: \"b3cd662d-7512-46f5-8fcc-46055872098e\") " pod="openshift-insights/insights-runtime-extractor-s2256"
Aug 04 17:50:46.148368 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:46.148343    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3cd662d-7512-46f5-8fcc-46055872098e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s2256\" (UID: \"b3cd662d-7512-46f5-8fcc-46055872098e\") " pod="openshift-insights/insights-runtime-extractor-s2256"
Aug 04 17:50:46.148851 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:50:46.148407    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 17:50:46.148851 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:50:46.148443    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 17:50:46.148851 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:50:46.148481    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3cd662d-7512-46f5-8fcc-46055872098e-kube-rbac-proxy-cm podName:b3cd662d-7512-46f5-8fcc-46055872098e nodeName:}" failed. No retries permitted until 2026-08-04 17:50:54.148460428 +0000 UTC m=+270.949596756 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b3cd662d-7512-46f5-8fcc-46055872098e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s2256" (UID: "b3cd662d-7512-46f5-8fcc-46055872098e") : configmap "kube-rbac-proxy" not found
Aug 04 17:50:46.148851 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:50:46.148496    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3cd662d-7512-46f5-8fcc-46055872098e-insights-runtime-extractor-tls podName:b3cd662d-7512-46f5-8fcc-46055872098e nodeName:}" failed. No retries permitted until 2026-08-04 17:50:54.148490264 +0000 UTC m=+270.949626569 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b3cd662d-7512-46f5-8fcc-46055872098e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s2256" (UID: "b3cd662d-7512-46f5-8fcc-46055872098e") : secret "insights-runtime-extractor-tls" not found
Aug 04 17:50:54.204413 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:54.204375    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3cd662d-7512-46f5-8fcc-46055872098e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s2256\" (UID: \"b3cd662d-7512-46f5-8fcc-46055872098e\") " pod="openshift-insights/insights-runtime-extractor-s2256"
Aug 04 17:50:54.205002 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:54.204436    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3cd662d-7512-46f5-8fcc-46055872098e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s2256\" (UID: \"b3cd662d-7512-46f5-8fcc-46055872098e\") " pod="openshift-insights/insights-runtime-extractor-s2256"
Aug 04 17:50:54.205079 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:54.205036    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3cd662d-7512-46f5-8fcc-46055872098e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s2256\" (UID: \"b3cd662d-7512-46f5-8fcc-46055872098e\") " pod="openshift-insights/insights-runtime-extractor-s2256"
Aug 04 17:50:54.206560 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:54.206543    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3cd662d-7512-46f5-8fcc-46055872098e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s2256\" (UID: \"b3cd662d-7512-46f5-8fcc-46055872098e\") " pod="openshift-insights/insights-runtime-extractor-s2256"
Aug 04 17:50:54.368028 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:54.368007    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s2256"
Aug 04 17:50:54.485404 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:54.485240    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s2256"]
Aug 04 17:50:54.487851 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:50:54.487816    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3cd662d_7512_46f5_8fcc_46055872098e.slice/crio-1f4359e65fd901be99fad957e60a449690bad6d1388a8da5af98951027db8f7b WatchSource:0}: Error finding container 1f4359e65fd901be99fad957e60a449690bad6d1388a8da5af98951027db8f7b: Status 404 returned error can't find the container with id 1f4359e65fd901be99fad957e60a449690bad6d1388a8da5af98951027db8f7b
Aug 04 17:50:54.682292 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:54.682261    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s2256" event={"ID":"b3cd662d-7512-46f5-8fcc-46055872098e","Type":"ContainerStarted","Data":"a9beac251f4dcfefa11d58648fc76c14035f774ba979a3a564bdfc8e992d2801"}
Aug 04 17:50:54.682391 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:54.682311    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s2256" event={"ID":"b3cd662d-7512-46f5-8fcc-46055872098e","Type":"ContainerStarted","Data":"1f4359e65fd901be99fad957e60a449690bad6d1388a8da5af98951027db8f7b"}
Aug 04 17:50:55.686413 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:55.686387    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s2256" event={"ID":"b3cd662d-7512-46f5-8fcc-46055872098e","Type":"ContainerStarted","Data":"9257e1b35ac6e758e3b4d69ee38c28dd250affaf6f13a3bd7365b37d0c2148e4"}
Aug 04 17:50:57.693862 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:57.693832    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s2256" event={"ID":"b3cd662d-7512-46f5-8fcc-46055872098e","Type":"ContainerStarted","Data":"c5aa3430c1c435ba8af740ed85cbcf0380fe1a996f1f66baa9287b959362f5d5"}
Aug 04 17:50:57.709366 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:57.709328    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-s2256" podStartSLOduration=17.576679916 podStartE2EDuration="19.709315208s" totalImagesPullingTime="2.132635292s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:50:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:50:57.708463764 +0000 UTC m=+274.509600091" watchObservedRunningTime="2026-08-04 17:50:57.709315208 +0000 UTC m=+274.510451534"
Aug 04 17:50:59.413888 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:50:59.413857    2571 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c45b7648-x97l7" podUID="d5c369c3-199c-4805-9d5b-ffc8d36a1780" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Aug 04 17:51:05.384919 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:51:05.384884    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-594fdf9495-66w8b" podUID="ff200bb2-9a58-43af-9369-3c300edacd50"
Aug 04 17:51:05.384919 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:51:05.384901    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-f77f48c6d-5z7qg" podUID="cb892edb-7af7-4903-9178-4d1070e50a4f"
Aug 04 17:51:05.384919 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:51:05.384922    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8bxm5" podUID="e1d0f03c-af81-42ad-8fff-4d32ba94c3e7"
Aug 04 17:51:05.717046 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:05.716997    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8bxm5"
Aug 04 17:51:05.717046 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:05.717012    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-5z7qg"
Aug 04 17:51:05.717175 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:05.716997    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:51:07.724448 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:07.724422    2571 generic.go:356] "Generic (PLEG): container finished" podID="7e1b5f8e-8269-4d96-bc60-4cf728aff9cc" containerID="ac39402332c9c0fc016ff4e03a4b5cb612d53dcd3d9e183e3f34526904102595" exitCode=1
Aug 04 17:51:07.724786 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:07.724496    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4fb7b886-87x2s" event={"ID":"7e1b5f8e-8269-4d96-bc60-4cf728aff9cc","Type":"ContainerDied","Data":"ac39402332c9c0fc016ff4e03a4b5cb612d53dcd3d9e183e3f34526904102595"}
Aug 04 17:51:07.724786 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:07.724577    2571 scope.go:117] "RemoveContainer" containerID="068896964ccad9519c0be7cc52a39b2cbed58423c4ea0b55316d981bddde48d3"
Aug 04 17:51:07.724894 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:07.724856    2571 scope.go:117] "RemoveContainer" containerID="ac39402332c9c0fc016ff4e03a4b5cb612d53dcd3d9e183e3f34526904102595"
Aug 04 17:51:07.725045 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:51:07.725012    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-6f4fb7b886-87x2s_open-cluster-management-agent-addon(7e1b5f8e-8269-4d96-bc60-4cf728aff9cc)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4fb7b886-87x2s" podUID="7e1b5f8e-8269-4d96-bc60-4cf728aff9cc"
Aug 04 17:51:07.726471 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:07.726450    2571 generic.go:356] "Generic (PLEG): container finished" podID="3a5553b1-b587-461d-86f7-a6043849503c" containerID="a450befab852e6f2948694857c10d1927fa7db1a150c0ffd11b30fe99a0dbb1b" exitCode=255
Aug 04 17:51:07.726568 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:07.726487    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d54dcfd6-t79zb" event={"ID":"3a5553b1-b587-461d-86f7-a6043849503c","Type":"ContainerDied","Data":"a450befab852e6f2948694857c10d1927fa7db1a150c0ffd11b30fe99a0dbb1b"}
Aug 04 17:51:07.726760 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:07.726747    2571 scope.go:117] "RemoveContainer" containerID="a450befab852e6f2948694857c10d1927fa7db1a150c0ffd11b30fe99a0dbb1b"
Aug 04 17:51:07.726893 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:51:07.726877    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-9d54dcfd6-t79zb_open-cluster-management-agent-addon(3a5553b1-b587-461d-86f7-a6043849503c)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d54dcfd6-t79zb" podUID="3a5553b1-b587-461d-86f7-a6043849503c"
Aug 04 17:51:07.734100 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:07.734085    2571 scope.go:117] "RemoveContainer" containerID="89058425f1d35a880b30e6191bfced4d6177af4c264578665f830245abff939b"
Aug 04 17:51:08.406491 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:08.406471    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4fb7b886-87x2s"
Aug 04 17:51:08.731380 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:08.731333    2571 scope.go:117] "RemoveContainer" containerID="ac39402332c9c0fc016ff4e03a4b5cb612d53dcd3d9e183e3f34526904102595"
Aug 04 17:51:08.731715 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:51:08.731454    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-6f4fb7b886-87x2s_open-cluster-management-agent-addon(7e1b5f8e-8269-4d96-bc60-4cf728aff9cc)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4fb7b886-87x2s" podUID="7e1b5f8e-8269-4d96-bc60-4cf728aff9cc"
Aug 04 17:51:09.002911 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:09.002848    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cb892edb-7af7-4903-9178-4d1070e50a4f-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-5z7qg\" (UID: \"cb892edb-7af7-4903-9178-4d1070e50a4f\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-5z7qg"
Aug 04 17:51:09.002911 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:09.002900    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-registry-tls\") pod \"image-registry-594fdf9495-66w8b\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") " pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:51:09.005129 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:09.005108    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cb892edb-7af7-4903-9178-4d1070e50a4f-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-5z7qg\" (UID: \"cb892edb-7af7-4903-9178-4d1070e50a4f\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-5z7qg"
Aug 04 17:51:09.005226 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:09.005165    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-registry-tls\") pod \"image-registry-594fdf9495-66w8b\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") " pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:51:09.020111 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:09.020090    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6z64c\""
Aug 04 17:51:09.020216 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:09.020177    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-qplz9\""
Aug 04 17:51:09.028771 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:09.028753    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-5z7qg"
Aug 04 17:51:09.028853 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:09.028840    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:51:09.103293 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:09.103223    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-metrics-tls\") pod \"dns-default-8bxm5\" (UID: \"e1d0f03c-af81-42ad-8fff-4d32ba94c3e7\") " pod="openshift-dns/dns-default-8bxm5"
Aug 04 17:51:09.105379 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:09.105334    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1d0f03c-af81-42ad-8fff-4d32ba94c3e7-metrics-tls\") pod \"dns-default-8bxm5\" (UID: \"e1d0f03c-af81-42ad-8fff-4d32ba94c3e7\") " pod="openshift-dns/dns-default-8bxm5"
Aug 04 17:51:09.158549 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:09.158507    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-5z7qg"]
Aug 04 17:51:09.161982 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:51:09.161957    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb892edb_7af7_4903_9178_4d1070e50a4f.slice/crio-d4c4ed9709b36a4d75c3abbad618bce4f61ade57995f8a2a82e2cb43d53916ea WatchSource:0}: Error finding container d4c4ed9709b36a4d75c3abbad618bce4f61ade57995f8a2a82e2cb43d53916ea: Status 404 returned error can't find the container with id d4c4ed9709b36a4d75c3abbad618bce4f61ade57995f8a2a82e2cb43d53916ea
Aug 04 17:51:09.175260 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:09.175238    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-594fdf9495-66w8b"]
Aug 04 17:51:09.177677 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:51:09.177655    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff200bb2_9a58_43af_9369_3c300edacd50.slice/crio-fde1c62c4ff91ab4c0fe2ef9031866db57bcd1fd66b447e426b649d55c8bc09e WatchSource:0}: Error finding container fde1c62c4ff91ab4c0fe2ef9031866db57bcd1fd66b447e426b649d55c8bc09e: Status 404 returned error can't find the container with id fde1c62c4ff91ab4c0fe2ef9031866db57bcd1fd66b447e426b649d55c8bc09e
Aug 04 17:51:09.320741 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:09.320715    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-56pss\""
Aug 04 17:51:09.328818 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:09.328799    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8bxm5"
Aug 04 17:51:09.405837 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:09.405784    2571 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d54dcfd6-t79zb"
Aug 04 17:51:09.406170 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:09.406152    2571 scope.go:117] "RemoveContainer" containerID="a450befab852e6f2948694857c10d1927fa7db1a150c0ffd11b30fe99a0dbb1b"
Aug 04 17:51:09.406736 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:51:09.406326    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-9d54dcfd6-t79zb_open-cluster-management-agent-addon(3a5553b1-b587-461d-86f7-a6043849503c)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d54dcfd6-t79zb" podUID="3a5553b1-b587-461d-86f7-a6043849503c"
Aug 04 17:51:09.413934 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:09.413903    2571 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c45b7648-x97l7" podUID="d5c369c3-199c-4805-9d5b-ffc8d36a1780" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Aug 04 17:51:09.434501 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:09.434481    2571 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4fb7b886-87x2s"
Aug 04 17:51:09.450507 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:09.450485    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8bxm5"]
Aug 04 17:51:09.453413 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:51:09.453390    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1d0f03c_af81_42ad_8fff_4d32ba94c3e7.slice/crio-1549249ed3bfa3984a65ffd512d15b27d86439d3b8e39fe5d49a172a400b167c WatchSource:0}: Error finding container 1549249ed3bfa3984a65ffd512d15b27d86439d3b8e39fe5d49a172a400b167c: Status 404 returned error can't find the container with id 1549249ed3bfa3984a65ffd512d15b27d86439d3b8e39fe5d49a172a400b167c
Aug 04 17:51:09.736168 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:09.736091    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8bxm5" event={"ID":"e1d0f03c-af81-42ad-8fff-4d32ba94c3e7","Type":"ContainerStarted","Data":"1549249ed3bfa3984a65ffd512d15b27d86439d3b8e39fe5d49a172a400b167c"}
Aug 04 17:51:09.737502 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:09.737471    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-5z7qg" event={"ID":"cb892edb-7af7-4903-9178-4d1070e50a4f","Type":"ContainerStarted","Data":"d4c4ed9709b36a4d75c3abbad618bce4f61ade57995f8a2a82e2cb43d53916ea"}
Aug 04 17:51:09.739248 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:09.739223    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-594fdf9495-66w8b" event={"ID":"ff200bb2-9a58-43af-9369-3c300edacd50","Type":"ContainerStarted","Data":"b9d86717b2d7d77e016fe2dd36718f0ec7933702806aebc94b90a26baa277ccf"}
Aug 04 17:51:09.739346 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:09.739268    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-594fdf9495-66w8b" event={"ID":"ff200bb2-9a58-43af-9369-3c300edacd50","Type":"ContainerStarted","Data":"fde1c62c4ff91ab4c0fe2ef9031866db57bcd1fd66b447e426b649d55c8bc09e"}
Aug 04 17:51:09.739510 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:09.739491    2571 scope.go:117] "RemoveContainer" containerID="ac39402332c9c0fc016ff4e03a4b5cb612d53dcd3d9e183e3f34526904102595"
Aug 04 17:51:09.739726 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:51:09.739700    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-6f4fb7b886-87x2s_open-cluster-management-agent-addon(7e1b5f8e-8269-4d96-bc60-4cf728aff9cc)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4fb7b886-87x2s" podUID="7e1b5f8e-8269-4d96-bc60-4cf728aff9cc"
Aug 04 17:51:09.763916 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:09.763870    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-594fdf9495-66w8b" podStartSLOduration=285.763857083 podStartE2EDuration="4m45.763857083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:46:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:51:09.762844365 +0000 UTC m=+286.563980719" watchObservedRunningTime="2026-08-04 17:51:09.763857083 +0000 UTC m=+286.564993406"
Aug 04 17:51:10.744009 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:10.743978    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-5z7qg" event={"ID":"cb892edb-7af7-4903-9178-4d1070e50a4f","Type":"ContainerStarted","Data":"2884f02ea712f25bbb39aa75567e3c7470b9a0821fdbf975c03301e14dc8e015"}
Aug 04 17:51:10.744375 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:10.744182    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:51:10.758705 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:10.758656    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-f77f48c6d-5z7qg" podStartSLOduration=273.67113452 podStartE2EDuration="4m34.758638375s" totalImagesPullingTime="1.087503855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:46:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:51:10.758172602 +0000 UTC m=+287.559308931" watchObservedRunningTime="2026-08-04 17:51:10.758638375 +0000 UTC m=+287.559774703"
Aug 04 17:51:11.748820 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:11.748785    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8bxm5" event={"ID":"e1d0f03c-af81-42ad-8fff-4d32ba94c3e7","Type":"ContainerStarted","Data":"68d7494a4be5745b2624b17d920a3579fa631d22dfb73b8e8c2b5a10afad9082"}
Aug 04 17:51:11.749212 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:11.749175    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8bxm5"
Aug 04 17:51:11.749272 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:11.749212    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8bxm5" event={"ID":"e1d0f03c-af81-42ad-8fff-4d32ba94c3e7","Type":"ContainerStarted","Data":"22116b60bf87c0497f6421c348b544653d0280a49ed0e94e1ac02db6476bde0c"}
Aug 04 17:51:11.768643 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:11.768602    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8bxm5" podStartSLOduration=251.01277242 podStartE2EDuration="4m12.76858913s" totalImagesPullingTime="1.75581671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:46:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:51:11.768114685 +0000 UTC m=+288.569251012" watchObservedRunningTime="2026-08-04 17:51:11.76858913 +0000 UTC m=+288.569725457"
Aug 04 17:51:16.876921 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:51:16.876878    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-bqph9" podUID="cec46231-ba14-4b07-b2b1-df119f58db12"
Aug 04 17:51:18.151014 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:18.150986    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8zzxs"]
Aug 04 17:51:18.153935 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:18.153916    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8zzxs"
Aug 04 17:51:18.156907 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:18.156886    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Aug 04 17:51:18.157142 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:18.157129    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Aug 04 17:51:18.157287 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:18.157271    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hmd7r\""
Aug 04 17:51:18.157386 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:18.157370    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Aug 04 17:51:18.157458 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:18.157394    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Aug 04 17:51:18.157545 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:18.157469    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Aug 04 17:51:18.157693 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:18.157680    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Aug 04 17:51:18.266662 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:18.266643    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/229e973e-d1c0-4114-8d67-5d65a7688217-node-exporter-textfile\") pod \"node-exporter-8zzxs\" (UID: \"229e973e-d1c0-4114-8d67-5d65a7688217\") " pod="openshift-monitoring/node-exporter-8zzxs"
Aug 04 17:51:18.266774 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:18.266678    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/229e973e-d1c0-4114-8d67-5d65a7688217-node-exporter-accelerators-collector-config\") pod \"node-exporter-8zzxs\" (UID: \"229e973e-d1c0-4114-8d67-5d65a7688217\") " pod="openshift-monitoring/node-exporter-8zzxs"
Aug 04 17:51:18.266774 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:18.266709    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/229e973e-d1c0-4114-8d67-5d65a7688217-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8zzxs\" (UID: \"229e973e-d1c0-4114-8d67-5d65a7688217\") " pod="openshift-monitoring/node-exporter-8zzxs"
Aug 04 17:51:18.266875 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:18.266773    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/229e973e-d1c0-4114-8d67-5d65a7688217-node-exporter-tls\") pod \"node-exporter-8zzxs\" (UID: \"229e973e-d1c0-4114-8d67-5d65a7688217\") " pod="openshift-monitoring/node-exporter-8zzxs"
Aug 04 17:51:18.266875 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:18.266804    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x95bt\" (UniqueName: \"kubernetes.io/projected/229e973e-d1c0-4114-8d67-5d65a7688217-kube-api-access-x95bt\") pod \"node-exporter-8zzxs\" (UID: \"229e973e-d1c0-4114-8d67-5d65a7688217\") " pod="openshift-monitoring/node-exporter-8zzxs"
Aug 04 17:51:18.266875 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:18.266837    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/229e973e-d1c0-4114-8d67-5d65a7688217-sys\") pod \"node-exporter-8zzxs\" (UID: \"229e973e-d1c0-4114-8d67-5d65a7688217\") " pod="openshift-monitoring/node-exporter-8zzxs"
Aug 04 17:51:18.266875 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:18.266861    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/229e973e-d1c0-4114-8d67-5d65a7688217-node-exporter-wtmp\") pod \"node-exporter-8zzxs\" (UID: \"229e973e-d1c0-4114-8d67-5d65a7688217\") " pod="openshift-monitoring/node-exporter-8zzxs"
Aug 04 17:51:18.267021 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:18.266888    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/229e973e-d1c0-4114-8d67-5d65a7688217-root\") pod \"node-exporter-8zzxs\" (UID: \"229e973e-d1c0-4114-8d67-5d65a7688217\") " pod="openshift-monitoring/node-exporter-8zzxs"
Aug 04 17:51:18.267021 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:18.266903    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/229e973e-d1c0-4114-8d67-5d65a7688217-metrics-client-ca\") pod \"node-exporter-8zzxs\" (UID: \"229e973e-d1c0-4114-8d67-5d65a7688217\") " pod="openshift-monitoring/node-exporter-8zzxs"
Aug 04 17:51:18.367996 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:18.367976    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/229e973e-d1c0-4114-8d67-5d65a7688217-root\") pod \"node-exporter-8zzxs\" (UID: \"229e973e-d1c0-4114-8d67-5d65a7688217\") " pod="openshift-monitoring/node-exporter-8zzxs"
Aug 04 17:51:18.368089 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:18.368002    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/229e973e-d1c0-4114-8d67-5d65a7688217-metrics-client-ca\") pod \"node-exporter-8zzxs\" (UID: \"229e973e-d1c0-4114-8d67-5d65a7688217\") " pod="openshift-monitoring/node-exporter-8zzxs"
Aug 04 17:51:18.368089 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:18.368021    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/229e973e-d1c0-4114-8d67-5d65a7688217-node-exporter-textfile\") pod \"node-exporter-8zzxs\" (UID: \"229e973e-d1c0-4114-8d67-5d65a7688217\") " pod="openshift-monitoring/node-exporter-8zzxs"
Aug 04 17:51:18.368089 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:18.368038    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/229e973e-d1c0-4114-8d67-5d65a7688217-node-exporter-accelerators-collector-config\") pod \"node-exporter-8zzxs\" (UID: \"229e973e-d1c0-4114-8d67-5d65a7688217\") " pod="openshift-monitoring/node-exporter-8zzxs"
Aug 04 17:51:18.368089 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:18.368063    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/229e973e-d1c0-4114-8d67-5d65a7688217-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8zzxs\" (UID: \"229e973e-d1c0-4114-8d67-5d65a7688217\") " pod="openshift-monitoring/node-exporter-8zzxs"
Aug 04 17:51:18.368284 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:18.368107    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/229e973e-d1c0-4114-8d67-5d65a7688217-node-exporter-tls\") pod \"node-exporter-8zzxs\" (UID: \"229e973e-d1c0-4114-8d67-5d65a7688217\") " pod="openshift-monitoring/node-exporter-8zzxs"
Aug 04 17:51:18.368284 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:18.368130    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x95bt\" (UniqueName: \"kubernetes.io/projected/229e973e-d1c0-4114-8d67-5d65a7688217-kube-api-access-x95bt\") pod \"node-exporter-8zzxs\" (UID: \"229e973e-d1c0-4114-8d67-5d65a7688217\") " pod="openshift-monitoring/node-exporter-8zzxs"
Aug 04 17:51:18.368284 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:18.368137    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/229e973e-d1c0-4114-8d67-5d65a7688217-root\") pod \"node-exporter-8zzxs\" (UID: \"229e973e-d1c0-4114-8d67-5d65a7688217\") " pod="openshift-monitoring/node-exporter-8zzxs"
Aug 04 17:51:18.368284 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:18.368154    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/229e973e-d1c0-4114-8d67-5d65a7688217-sys\") pod \"node-exporter-8zzxs\" (UID: \"229e973e-d1c0-4114-8d67-5d65a7688217\") " pod="openshift-monitoring/node-exporter-8zzxs"
Aug 04 17:51:18.368284 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:18.368199    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/229e973e-d1c0-4114-8d67-5d65a7688217-sys\") pod \"node-exporter-8zzxs\" (UID: \"229e973e-d1c0-4114-8d67-5d65a7688217\") " pod="openshift-monitoring/node-exporter-8zzxs"
Aug 04 17:51:18.368284 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:18.368208    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/229e973e-d1c0-4114-8d67-5d65a7688217-node-exporter-wtmp\") pod \"node-exporter-8zzxs\" (UID: \"229e973e-d1c0-4114-8d67-5d65a7688217\") " pod="openshift-monitoring/node-exporter-8zzxs"
Aug 04 17:51:18.368637 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:51:18.368292    2571 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Aug 04 17:51:18.368637 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:51:18.368346    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/229e973e-d1c0-4114-8d67-5d65a7688217-node-exporter-tls podName:229e973e-d1c0-4114-8d67-5d65a7688217 nodeName:}" failed. No retries permitted until 2026-08-04 17:51:18.868326785 +0000 UTC m=+295.669463101 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/229e973e-d1c0-4114-8d67-5d65a7688217-node-exporter-tls") pod "node-exporter-8zzxs" (UID: "229e973e-d1c0-4114-8d67-5d65a7688217") : secret "node-exporter-tls" not found
Aug 04 17:51:18.368637 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:18.368354    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/229e973e-d1c0-4114-8d67-5d65a7688217-node-exporter-wtmp\") pod \"node-exporter-8zzxs\" (UID: \"229e973e-d1c0-4114-8d67-5d65a7688217\") " pod="openshift-monitoring/node-exporter-8zzxs"
Aug 04 17:51:18.368637 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:18.368377    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/229e973e-d1c0-4114-8d67-5d65a7688217-node-exporter-textfile\") pod \"node-exporter-8zzxs\" (UID: \"229e973e-d1c0-4114-8d67-5d65a7688217\") " pod="openshift-monitoring/node-exporter-8zzxs"
Aug 04 17:51:18.368825 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:18.368686    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/229e973e-d1c0-4114-8d67-5d65a7688217-metrics-client-ca\") pod \"node-exporter-8zzxs\" (UID: \"229e973e-d1c0-4114-8d67-5d65a7688217\") " pod="openshift-monitoring/node-exporter-8zzxs"
Aug 04 17:51:18.368825 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:18.368728    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/229e973e-d1c0-4114-8d67-5d65a7688217-node-exporter-accelerators-collector-config\") pod \"node-exporter-8zzxs\" (UID: \"229e973e-d1c0-4114-8d67-5d65a7688217\") " pod="openshift-monitoring/node-exporter-8zzxs"
Aug 04 17:51:18.370478 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:18.370459    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/229e973e-d1c0-4114-8d67-5d65a7688217-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8zzxs\" (UID: \"229e973e-d1c0-4114-8d67-5d65a7688217\") " pod="openshift-monitoring/node-exporter-8zzxs"
Aug 04 17:51:18.378181 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:18.378160    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x95bt\" (UniqueName: \"kubernetes.io/projected/229e973e-d1c0-4114-8d67-5d65a7688217-kube-api-access-x95bt\") pod \"node-exporter-8zzxs\" (UID: \"229e973e-d1c0-4114-8d67-5d65a7688217\") " pod="openshift-monitoring/node-exporter-8zzxs"
Aug 04 17:51:18.870269 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:18.870241    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/229e973e-d1c0-4114-8d67-5d65a7688217-node-exporter-tls\") pod \"node-exporter-8zzxs\" (UID: \"229e973e-d1c0-4114-8d67-5d65a7688217\") " pod="openshift-monitoring/node-exporter-8zzxs"
Aug 04 17:51:18.872264 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:18.872245    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/229e973e-d1c0-4114-8d67-5d65a7688217-node-exporter-tls\") pod \"node-exporter-8zzxs\" (UID: \"229e973e-d1c0-4114-8d67-5d65a7688217\") " pod="openshift-monitoring/node-exporter-8zzxs"
Aug 04 17:51:19.062761 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:19.062736    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8zzxs"
Aug 04 17:51:19.072146 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:51:19.072123    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod229e973e_d1c0_4114_8d67_5d65a7688217.slice/crio-2c300eebd6bd1b2d6c8ec684881b1f4db47572e2599ff8cf9b6df4deb0bde4f0 WatchSource:0}: Error finding container 2c300eebd6bd1b2d6c8ec684881b1f4db47572e2599ff8cf9b6df4deb0bde4f0: Status 404 returned error can't find the container with id 2c300eebd6bd1b2d6c8ec684881b1f4db47572e2599ff8cf9b6df4deb0bde4f0
Aug 04 17:51:19.413734 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:19.413699    2571 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c45b7648-x97l7" podUID="d5c369c3-199c-4805-9d5b-ffc8d36a1780" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Aug 04 17:51:19.414035 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:19.413767    2571 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c45b7648-x97l7"
Aug 04 17:51:19.414218 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:19.414178    2571 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"2b6da0b15f87854d3bc9b8b60a9b08732e188fe3bef1e6f278d9c5d16092fca7"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c45b7648-x97l7" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Aug 04 17:51:19.414255 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:19.414238    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c45b7648-x97l7" podUID="d5c369c3-199c-4805-9d5b-ffc8d36a1780" containerName="service-proxy" containerID="cri-o://2b6da0b15f87854d3bc9b8b60a9b08732e188fe3bef1e6f278d9c5d16092fca7" gracePeriod=30
Aug 04 17:51:19.775310 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:19.775282    2571 generic.go:356] "Generic (PLEG): container finished" podID="d5c369c3-199c-4805-9d5b-ffc8d36a1780" containerID="2b6da0b15f87854d3bc9b8b60a9b08732e188fe3bef1e6f278d9c5d16092fca7" exitCode=2
Aug 04 17:51:19.775428 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:19.775359    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c45b7648-x97l7" event={"ID":"d5c369c3-199c-4805-9d5b-ffc8d36a1780","Type":"ContainerDied","Data":"2b6da0b15f87854d3bc9b8b60a9b08732e188fe3bef1e6f278d9c5d16092fca7"}
Aug 04 17:51:19.775428 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:19.775403    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c45b7648-x97l7" event={"ID":"d5c369c3-199c-4805-9d5b-ffc8d36a1780","Type":"ContainerStarted","Data":"7e90760943f7fce4ae84748cffbb511772caee3c6da92bceaf0853ca375a2ec7"}
Aug 04 17:51:19.776538 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:19.776503    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8zzxs" event={"ID":"229e973e-d1c0-4114-8d67-5d65a7688217","Type":"ContainerStarted","Data":"2c300eebd6bd1b2d6c8ec684881b1f4db47572e2599ff8cf9b6df4deb0bde4f0"}
Aug 04 17:51:20.781723 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:20.781695    2571 generic.go:356] "Generic (PLEG): container finished" podID="229e973e-d1c0-4114-8d67-5d65a7688217" containerID="fbf336f0eef724dc2f5dbfbea893ed109b8b8d3d70b62f4f5659ea03a5a74e99" exitCode=0
Aug 04 17:51:20.782003 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:20.781779    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8zzxs" event={"ID":"229e973e-d1c0-4114-8d67-5d65a7688217","Type":"ContainerDied","Data":"fbf336f0eef724dc2f5dbfbea893ed109b8b8d3d70b62f4f5659ea03a5a74e99"}
Aug 04 17:51:20.874349 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:20.874326    2571 scope.go:117] "RemoveContainer" containerID="ac39402332c9c0fc016ff4e03a4b5cb612d53dcd3d9e183e3f34526904102595"
Aug 04 17:51:21.786716 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:21.786681    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8zzxs" event={"ID":"229e973e-d1c0-4114-8d67-5d65a7688217","Type":"ContainerStarted","Data":"38f209776cbd3cd6b09cbaf81ffd0ec0bb03fe120ba54b0c624cdbb49a1563dc"}
Aug 04 17:51:21.787125 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:21.786733    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8zzxs" event={"ID":"229e973e-d1c0-4114-8d67-5d65a7688217","Type":"ContainerStarted","Data":"e18e04194a249ffb3415acfa425ec6834be1988ec7315c0e29e1ba8769d4126a"}
Aug 04 17:51:21.788399 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:21.788376    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4fb7b886-87x2s" event={"ID":"7e1b5f8e-8269-4d96-bc60-4cf728aff9cc","Type":"ContainerStarted","Data":"d518a04925b17ba7cd3b187148fcfcd2601676ea1795332dd148536688fa308d"}
Aug 04 17:51:21.788647 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:21.788632    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4fb7b886-87x2s"
Aug 04 17:51:21.789979 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:21.789961    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4fb7b886-87x2s"
Aug 04 17:51:21.805080 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:21.805040    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8zzxs" podStartSLOduration=2.41495593 podStartE2EDuration="3.805027706s" totalImagesPullingTime="1.328652148s" totalInitContainerRuntime="61.419628ms" isStatefulPod=true podCreationTimestamp="2026-08-04 17:51:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:51:21.803830831 +0000 UTC m=+298.604967168" watchObservedRunningTime="2026-08-04 17:51:21.805027706 +0000 UTC m=+298.606164032"
Aug 04 17:51:22.757847 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:22.757820    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8bxm5"
Aug 04 17:51:22.874562 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:22.874517    2571 scope.go:117] "RemoveContainer" containerID="a450befab852e6f2948694857c10d1927fa7db1a150c0ffd11b30fe99a0dbb1b"
Aug 04 17:51:23.626659 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:23.626634    2571 kubelet.go:1648] "Image garbage collection succeeded"
Aug 04 17:51:23.797856 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:23.797824    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d54dcfd6-t79zb" event={"ID":"3a5553b1-b587-461d-86f7-a6043849503c","Type":"ContainerStarted","Data":"9aa5f50a495624549e59e00eb56e878d39edd03936163141049bc2a0a099252d"}
Aug 04 17:51:24.945937 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:24.945907    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-594fdf9495-66w8b"]
Aug 04 17:51:24.950258 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:24.950226    2571 patch_prober.go:28] interesting pod/image-registry-594fdf9495-66w8b container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Aug 04 17:51:24.950391 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:24.950279    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-594fdf9495-66w8b" podUID="ff200bb2-9a58-43af-9369-3c300edacd50" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 17:51:27.874904 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:27.874875    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:51:34.950751 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:34.950725    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:51:49.963932 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:49.963880    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-594fdf9495-66w8b" podUID="ff200bb2-9a58-43af-9369-3c300edacd50" containerName="registry" containerID="cri-o://b9d86717b2d7d77e016fe2dd36718f0ec7933702806aebc94b90a26baa277ccf" gracePeriod=30
Aug 04 17:51:50.200188 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:50.200167    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:51:50.264175 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:50.264123    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff200bb2-9a58-43af-9369-3c300edacd50-registry-certificates\") pod \"ff200bb2-9a58-43af-9369-3c300edacd50\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") "
Aug 04 17:51:50.264175 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:50.264156    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff200bb2-9a58-43af-9369-3c300edacd50-installation-pull-secrets\") pod \"ff200bb2-9a58-43af-9369-3c300edacd50\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") "
Aug 04 17:51:50.264316 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:50.264187    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-267vg\" (UniqueName: \"kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-kube-api-access-267vg\") pod \"ff200bb2-9a58-43af-9369-3c300edacd50\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") "
Aug 04 17:51:50.264316 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:50.264210    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff200bb2-9a58-43af-9369-3c300edacd50-ca-trust-extracted\") pod \"ff200bb2-9a58-43af-9369-3c300edacd50\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") "
Aug 04 17:51:50.264316 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:50.264235    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-registry-tls\") pod \"ff200bb2-9a58-43af-9369-3c300edacd50\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") "
Aug 04 17:51:50.264316 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:50.264252    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-bound-sa-token\") pod \"ff200bb2-9a58-43af-9369-3c300edacd50\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") "
Aug 04 17:51:50.264316 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:50.264288    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff200bb2-9a58-43af-9369-3c300edacd50-image-registry-private-configuration\") pod \"ff200bb2-9a58-43af-9369-3c300edacd50\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") "
Aug 04 17:51:50.264586 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:50.264326    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff200bb2-9a58-43af-9369-3c300edacd50-trusted-ca\") pod \"ff200bb2-9a58-43af-9369-3c300edacd50\" (UID: \"ff200bb2-9a58-43af-9369-3c300edacd50\") "
Aug 04 17:51:50.264895 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:50.264859    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff200bb2-9a58-43af-9369-3c300edacd50-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ff200bb2-9a58-43af-9369-3c300edacd50" (UID: "ff200bb2-9a58-43af-9369-3c300edacd50"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 17:51:50.264895 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:50.264875    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff200bb2-9a58-43af-9369-3c300edacd50-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ff200bb2-9a58-43af-9369-3c300edacd50" (UID: "ff200bb2-9a58-43af-9369-3c300edacd50"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 17:51:50.266764 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:50.266738    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff200bb2-9a58-43af-9369-3c300edacd50-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ff200bb2-9a58-43af-9369-3c300edacd50" (UID: "ff200bb2-9a58-43af-9369-3c300edacd50"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 17:51:50.266870 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:50.266840    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff200bb2-9a58-43af-9369-3c300edacd50-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ff200bb2-9a58-43af-9369-3c300edacd50" (UID: "ff200bb2-9a58-43af-9369-3c300edacd50"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 17:51:50.266924 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:50.266890    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-kube-api-access-267vg" (OuterVolumeSpecName: "kube-api-access-267vg") pod "ff200bb2-9a58-43af-9369-3c300edacd50" (UID: "ff200bb2-9a58-43af-9369-3c300edacd50"). InnerVolumeSpecName "kube-api-access-267vg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:51:50.266973 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:50.266923    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ff200bb2-9a58-43af-9369-3c300edacd50" (UID: "ff200bb2-9a58-43af-9369-3c300edacd50"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:51:50.267173 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:50.267157    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ff200bb2-9a58-43af-9369-3c300edacd50" (UID: "ff200bb2-9a58-43af-9369-3c300edacd50"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:51:50.275291 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:50.275261    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff200bb2-9a58-43af-9369-3c300edacd50-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ff200bb2-9a58-43af-9369-3c300edacd50" (UID: "ff200bb2-9a58-43af-9369-3c300edacd50"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:51:50.365268 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:50.365237    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-267vg\" (UniqueName: \"kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-kube-api-access-267vg\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 17:51:50.365268 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:50.365266    2571 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff200bb2-9a58-43af-9369-3c300edacd50-ca-trust-extracted\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 17:51:50.365268 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:50.365275    2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-registry-tls\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 17:51:50.365414 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:50.365284    2571 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff200bb2-9a58-43af-9369-3c300edacd50-bound-sa-token\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 17:51:50.365414 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:50.365293    2571 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff200bb2-9a58-43af-9369-3c300edacd50-image-registry-private-configuration\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 17:51:50.365414 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:50.365301    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff200bb2-9a58-43af-9369-3c300edacd50-trusted-ca\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 17:51:50.365414 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:50.365309    2571 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff200bb2-9a58-43af-9369-3c300edacd50-registry-certificates\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 17:51:50.365414 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:50.365317    2571 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff200bb2-9a58-43af-9369-3c300edacd50-installation-pull-secrets\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 17:51:50.880596 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:50.880571    2571 generic.go:356] "Generic (PLEG): container finished" podID="ff200bb2-9a58-43af-9369-3c300edacd50" containerID="b9d86717b2d7d77e016fe2dd36718f0ec7933702806aebc94b90a26baa277ccf" exitCode=0
Aug 04 17:51:50.880697 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:50.880610    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-594fdf9495-66w8b" event={"ID":"ff200bb2-9a58-43af-9369-3c300edacd50","Type":"ContainerDied","Data":"b9d86717b2d7d77e016fe2dd36718f0ec7933702806aebc94b90a26baa277ccf"}
Aug 04 17:51:50.880697 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:50.880619    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-594fdf9495-66w8b"
Aug 04 17:51:50.880697 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:50.880639    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-594fdf9495-66w8b" event={"ID":"ff200bb2-9a58-43af-9369-3c300edacd50","Type":"ContainerDied","Data":"fde1c62c4ff91ab4c0fe2ef9031866db57bcd1fd66b447e426b649d55c8bc09e"}
Aug 04 17:51:50.880697 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:50.880658    2571 scope.go:117] "RemoveContainer" containerID="b9d86717b2d7d77e016fe2dd36718f0ec7933702806aebc94b90a26baa277ccf"
Aug 04 17:51:50.888694 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:50.888677    2571 scope.go:117] "RemoveContainer" containerID="b9d86717b2d7d77e016fe2dd36718f0ec7933702806aebc94b90a26baa277ccf"
Aug 04 17:51:50.888933 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:51:50.888914    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9d86717b2d7d77e016fe2dd36718f0ec7933702806aebc94b90a26baa277ccf\": container with ID starting with b9d86717b2d7d77e016fe2dd36718f0ec7933702806aebc94b90a26baa277ccf not found: ID does not exist" containerID="b9d86717b2d7d77e016fe2dd36718f0ec7933702806aebc94b90a26baa277ccf"
Aug 04 17:51:50.888990 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:50.888944    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9d86717b2d7d77e016fe2dd36718f0ec7933702806aebc94b90a26baa277ccf"} err="failed to get container status \"b9d86717b2d7d77e016fe2dd36718f0ec7933702806aebc94b90a26baa277ccf\": rpc error: code = NotFound desc = could not find container \"b9d86717b2d7d77e016fe2dd36718f0ec7933702806aebc94b90a26baa277ccf\": container with ID starting with b9d86717b2d7d77e016fe2dd36718f0ec7933702806aebc94b90a26baa277ccf not found: ID does not exist"
Aug 04 17:51:50.899626 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:50.899607    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-594fdf9495-66w8b"]
Aug 04 17:51:50.903264 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:50.903247    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-594fdf9495-66w8b"]
Aug 04 17:51:51.878090 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:51:51.878065    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff200bb2-9a58-43af-9369-3c300edacd50" path="/var/lib/kubelet/pods/ff200bb2-9a58-43af-9369-3c300edacd50/volumes"
Aug 04 17:52:36.567538 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:52:36.567489    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cec46231-ba14-4b07-b2b1-df119f58db12-metrics-certs\") pod \"network-metrics-daemon-bqph9\" (UID: \"cec46231-ba14-4b07-b2b1-df119f58db12\") " pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:52:36.569670 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:52:36.569652    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cec46231-ba14-4b07-b2b1-df119f58db12-metrics-certs\") pod \"network-metrics-daemon-bqph9\" (UID: \"cec46231-ba14-4b07-b2b1-df119f58db12\") " pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:52:36.577868 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:52:36.577843    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5wlqn\""
Aug 04 17:52:36.586585 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:52:36.586566    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqph9"
Aug 04 17:52:36.702189 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:52:36.702163    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bqph9"]
Aug 04 17:52:36.705224 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:52:36.705197    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcec46231_ba14_4b07_b2b1_df119f58db12.slice/crio-f8ed3d33223ec02b5e0f2a7040612b8d30c2bdde2611558791d2294e97a1f21b WatchSource:0}: Error finding container f8ed3d33223ec02b5e0f2a7040612b8d30c2bdde2611558791d2294e97a1f21b: Status 404 returned error can't find the container with id f8ed3d33223ec02b5e0f2a7040612b8d30c2bdde2611558791d2294e97a1f21b
Aug 04 17:52:36.707676 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:52:36.707659    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 17:52:37.015430 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:52:37.015373    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bqph9" event={"ID":"cec46231-ba14-4b07-b2b1-df119f58db12","Type":"ContainerStarted","Data":"f8ed3d33223ec02b5e0f2a7040612b8d30c2bdde2611558791d2294e97a1f21b"}
Aug 04 17:52:38.021076 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:52:38.021052    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bqph9" event={"ID":"cec46231-ba14-4b07-b2b1-df119f58db12","Type":"ContainerStarted","Data":"ffadd2a654636c92a0b4686e9d5f8e9a0b3dccc35d1f29565806afe4520820b7"}
Aug 04 17:52:39.026159 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:52:39.026125    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bqph9" event={"ID":"cec46231-ba14-4b07-b2b1-df119f58db12","Type":"ContainerStarted","Data":"6f265c2029fc87978f347c8099b556540291e677b654751d9582b60d9f320954"}
Aug 04 17:52:39.046340 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:52:39.046295    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bqph9" podStartSLOduration=373.900361973 podStartE2EDuration="6m15.046283319s" totalImagesPullingTime="1.145921346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:46:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:52:39.044305459 +0000 UTC m=+375.845441784" watchObservedRunningTime="2026-08-04 17:52:39.046283319 +0000 UTC m=+375.847419645"
Aug 04 17:55:16.540735 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:16.540653    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ds5xn"]
Aug 04 17:55:16.541237 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:16.540966    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff200bb2-9a58-43af-9369-3c300edacd50" containerName="registry"
Aug 04 17:55:16.541237 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:16.540984    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff200bb2-9a58-43af-9369-3c300edacd50" containerName="registry"
Aug 04 17:55:16.541237 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:16.541051    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff200bb2-9a58-43af-9369-3c300edacd50" containerName="registry"
Aug 04 17:55:16.543805 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:16.543785    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ds5xn"
Aug 04 17:55:16.546341 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:16.546318    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Aug 04 17:55:16.546448 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:16.546364    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Aug 04 17:55:16.546946 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:16.546931    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-qwsf2\""
Aug 04 17:55:16.551171 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:16.551150    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ds5xn"]
Aug 04 17:55:16.638353 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:16.638334    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldj9t\" (UniqueName: \"kubernetes.io/projected/03b59ee4-df33-48e0-9991-9cd988234ab6-kube-api-access-ldj9t\") pod \"openshift-lws-operator-fd8ccff4c-ds5xn\" (UID: \"03b59ee4-df33-48e0-9991-9cd988234ab6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ds5xn"
Aug 04 17:55:16.638448 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:16.638371    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03b59ee4-df33-48e0-9991-9cd988234ab6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ds5xn\" (UID: \"03b59ee4-df33-48e0-9991-9cd988234ab6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ds5xn"
Aug 04 17:55:16.739618 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:16.739599    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldj9t\" (UniqueName: \"kubernetes.io/projected/03b59ee4-df33-48e0-9991-9cd988234ab6-kube-api-access-ldj9t\") pod \"openshift-lws-operator-fd8ccff4c-ds5xn\" (UID: \"03b59ee4-df33-48e0-9991-9cd988234ab6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ds5xn"
Aug 04 17:55:16.739693 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:16.739629    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03b59ee4-df33-48e0-9991-9cd988234ab6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ds5xn\" (UID: \"03b59ee4-df33-48e0-9991-9cd988234ab6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ds5xn"
Aug 04 17:55:16.739903 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:16.739889    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03b59ee4-df33-48e0-9991-9cd988234ab6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ds5xn\" (UID: \"03b59ee4-df33-48e0-9991-9cd988234ab6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ds5xn"
Aug 04 17:55:16.747610 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:16.747588    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldj9t\" (UniqueName: \"kubernetes.io/projected/03b59ee4-df33-48e0-9991-9cd988234ab6-kube-api-access-ldj9t\") pod \"openshift-lws-operator-fd8ccff4c-ds5xn\" (UID: \"03b59ee4-df33-48e0-9991-9cd988234ab6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ds5xn"
Aug 04 17:55:16.853869 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:16.853820    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ds5xn"
Aug 04 17:55:16.972194 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:16.972160    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ds5xn"]
Aug 04 17:55:16.980647 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:55:16.980610    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03b59ee4_df33_48e0_9991_9cd988234ab6.slice/crio-ac3101d07f7926e1e810b0d1533a76721f055ec99a772343e860d552afabc1a3 WatchSource:0}: Error finding container ac3101d07f7926e1e810b0d1533a76721f055ec99a772343e860d552afabc1a3: Status 404 returned error can't find the container with id ac3101d07f7926e1e810b0d1533a76721f055ec99a772343e860d552afabc1a3
Aug 04 17:55:17.497458 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:17.497427    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ds5xn" event={"ID":"03b59ee4-df33-48e0-9991-9cd988234ab6","Type":"ContainerStarted","Data":"ac3101d07f7926e1e810b0d1533a76721f055ec99a772343e860d552afabc1a3"}
Aug 04 17:55:20.510224 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:20.510187    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ds5xn" event={"ID":"03b59ee4-df33-48e0-9991-9cd988234ab6","Type":"ContainerStarted","Data":"d8b18db3f03c63c9a30445f8817e53e738894b5ff223c6628ead72e8d0e97097"}
Aug 04 17:55:20.525948 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:20.525904    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ds5xn" podStartSLOduration=2.000386854 podStartE2EDuration="4.52589196s" totalImagesPullingTime="2.525505106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:55:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:55:20.524492535 +0000 UTC m=+537.325628863" watchObservedRunningTime="2026-08-04 17:55:20.52589196 +0000 UTC m=+537.327028287"
Aug 04 17:55:36.107125 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:36.107089    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-wmlpw"]
Aug 04 17:55:36.110366 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:36.110345    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-wmlpw"
Aug 04 17:55:36.114708 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:36.114688    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Aug 04 17:55:36.114979 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:36.114967    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Aug 04 17:55:36.115335 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:36.115193    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Aug 04 17:55:36.115335 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:36.115193    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Aug 04 17:55:36.115335 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:36.115328    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6m798\""
Aug 04 17:55:36.149437 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:36.149415    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-wmlpw"]
Aug 04 17:55:36.258513 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:36.258491    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ccbeea1c-9e31-4224-aeee-546b2ea781cd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-wmlpw\" (UID: \"ccbeea1c-9e31-4224-aeee-546b2ea781cd\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-wmlpw"
Aug 04 17:55:36.258614 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:36.258537    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccbeea1c-9e31-4224-aeee-546b2ea781cd-tmp\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-wmlpw\" (UID: \"ccbeea1c-9e31-4224-aeee-546b2ea781cd\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-wmlpw"
Aug 04 17:55:36.258614 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:36.258572    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ccbeea1c-9e31-4224-aeee-546b2ea781cd-webhook-cert\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-wmlpw\" (UID: \"ccbeea1c-9e31-4224-aeee-546b2ea781cd\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-wmlpw"
Aug 04 17:55:36.258689 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:36.258615    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ccbeea1c-9e31-4224-aeee-546b2ea781cd-manifests\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-wmlpw\" (UID: \"ccbeea1c-9e31-4224-aeee-546b2ea781cd\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-wmlpw"
Aug 04 17:55:36.258689 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:36.258644    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9gbl\" (UniqueName: \"kubernetes.io/projected/ccbeea1c-9e31-4224-aeee-546b2ea781cd-kube-api-access-z9gbl\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-wmlpw\" (UID: \"ccbeea1c-9e31-4224-aeee-546b2ea781cd\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-wmlpw"
Aug 04 17:55:36.359375 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:36.359323    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ccbeea1c-9e31-4224-aeee-546b2ea781cd-webhook-cert\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-wmlpw\" (UID: \"ccbeea1c-9e31-4224-aeee-546b2ea781cd\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-wmlpw"
Aug 04 17:55:36.359375 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:36.359355    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ccbeea1c-9e31-4224-aeee-546b2ea781cd-manifests\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-wmlpw\" (UID: \"ccbeea1c-9e31-4224-aeee-546b2ea781cd\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-wmlpw"
Aug 04 17:55:36.359375 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:36.359376    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9gbl\" (UniqueName: \"kubernetes.io/projected/ccbeea1c-9e31-4224-aeee-546b2ea781cd-kube-api-access-z9gbl\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-wmlpw\" (UID: \"ccbeea1c-9e31-4224-aeee-546b2ea781cd\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-wmlpw"
Aug 04 17:55:36.359581 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:36.359538    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ccbeea1c-9e31-4224-aeee-546b2ea781cd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-wmlpw\" (UID: \"ccbeea1c-9e31-4224-aeee-546b2ea781cd\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-wmlpw"
Aug 04 17:55:36.359657 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:36.359639    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccbeea1c-9e31-4224-aeee-546b2ea781cd-tmp\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-wmlpw\" (UID: \"ccbeea1c-9e31-4224-aeee-546b2ea781cd\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-wmlpw"
Aug 04 17:55:36.359763 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:36.359742    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ccbeea1c-9e31-4224-aeee-546b2ea781cd-manifests\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-wmlpw\" (UID: \"ccbeea1c-9e31-4224-aeee-546b2ea781cd\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-wmlpw"
Aug 04 17:55:36.361653 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:36.361622    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccbeea1c-9e31-4224-aeee-546b2ea781cd-tmp\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-wmlpw\" (UID: \"ccbeea1c-9e31-4224-aeee-546b2ea781cd\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-wmlpw"
Aug 04 17:55:36.361751 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:36.361730    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ccbeea1c-9e31-4224-aeee-546b2ea781cd-webhook-cert\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-wmlpw\" (UID: \"ccbeea1c-9e31-4224-aeee-546b2ea781cd\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-wmlpw"
Aug 04 17:55:36.361851 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:36.361835    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ccbeea1c-9e31-4224-aeee-546b2ea781cd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-wmlpw\" (UID: \"ccbeea1c-9e31-4224-aeee-546b2ea781cd\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-wmlpw"
Aug 04 17:55:36.366795 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:36.366774    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9gbl\" (UniqueName: \"kubernetes.io/projected/ccbeea1c-9e31-4224-aeee-546b2ea781cd-kube-api-access-z9gbl\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-wmlpw\" (UID: \"ccbeea1c-9e31-4224-aeee-546b2ea781cd\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-wmlpw"
Aug 04 17:55:36.420247 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:36.420226    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-wmlpw"
Aug 04 17:55:36.546663 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:36.546642    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-wmlpw"]
Aug 04 17:55:36.549742 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:55:36.549714    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccbeea1c_9e31_4224_aeee_546b2ea781cd.slice/crio-4a044128bb9aacf9279ed22452bc592099686ad4a13834aeb478cb12e3ebda84 WatchSource:0}: Error finding container 4a044128bb9aacf9279ed22452bc592099686ad4a13834aeb478cb12e3ebda84: Status 404 returned error can't find the container with id 4a044128bb9aacf9279ed22452bc592099686ad4a13834aeb478cb12e3ebda84
Aug 04 17:55:36.564659 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:36.564638    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-wmlpw" event={"ID":"ccbeea1c-9e31-4224-aeee-546b2ea781cd","Type":"ContainerStarted","Data":"4a044128bb9aacf9279ed22452bc592099686ad4a13834aeb478cb12e3ebda84"}
Aug 04 17:55:40.580786 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:40.580753    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-wmlpw" event={"ID":"ccbeea1c-9e31-4224-aeee-546b2ea781cd","Type":"ContainerStarted","Data":"26c3a136daa08e8077f67a3189c85a24230213741de46068400003b3f5ee7531"}
Aug 04 17:55:41.586310 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:41.586276    2571 generic.go:356] "Generic (PLEG): container finished" podID="ccbeea1c-9e31-4224-aeee-546b2ea781cd" containerID="26c3a136daa08e8077f67a3189c85a24230213741de46068400003b3f5ee7531" exitCode=0
Aug 04 17:55:41.586677 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:41.586361    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-wmlpw" event={"ID":"ccbeea1c-9e31-4224-aeee-546b2ea781cd","Type":"ContainerDied","Data":"26c3a136daa08e8077f67a3189c85a24230213741de46068400003b3f5ee7531"}
Aug 04 17:55:42.591321 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:42.591285    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-wmlpw" event={"ID":"ccbeea1c-9e31-4224-aeee-546b2ea781cd","Type":"ContainerStarted","Data":"1e5f34de0b9469ffa1ecdc807cc67ff088ccaff79069a08b95977a4ea1ec1260"}
Aug 04 17:55:42.591771 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:42.591421    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-wmlpw"
Aug 04 17:55:42.613044 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:42.613001    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-wmlpw" podStartSLOduration=2.118280492 podStartE2EDuration="6.612988207s" totalImagesPullingTime="3.574202794s" totalInitContainerRuntime="920.504921ms" isStatefulPod=false podCreationTimestamp="2026-08-04 17:55:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:55:42.611358168 +0000 UTC m=+559.412494514" watchObservedRunningTime="2026-08-04 17:55:42.612988207 +0000 UTC m=+559.414124531"
Aug 04 17:55:53.597860 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:53.597832    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-wmlpw"
Aug 04 17:55:57.760309 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:57.760280    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-99b5d7fdc-84grw"]
Aug 04 17:55:57.763276 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:57.763258    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-99b5d7fdc-84grw"
Aug 04 17:55:57.765687 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:57.765661    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Aug 04 17:55:57.765859 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:57.765846    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Aug 04 17:55:57.766286 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:57.766269    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Aug 04 17:55:57.766460 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:57.766448    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Aug 04 17:55:57.787251 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:57.787227    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-99b5d7fdc-84grw"]
Aug 04 17:55:57.903196 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:57.903174    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcd30a0d-bc39-4769-9861-9e5f65d7edb4-tmp\") pod \"kube-auth-proxy-99b5d7fdc-84grw\" (UID: \"bcd30a0d-bc39-4769-9861-9e5f65d7edb4\") " pod="openshift-ingress/kube-auth-proxy-99b5d7fdc-84grw"
Aug 04 17:55:57.903303 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:57.903202    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tst9r\" (UniqueName: \"kubernetes.io/projected/bcd30a0d-bc39-4769-9861-9e5f65d7edb4-kube-api-access-tst9r\") pod \"kube-auth-proxy-99b5d7fdc-84grw\" (UID: \"bcd30a0d-bc39-4769-9861-9e5f65d7edb4\") " pod="openshift-ingress/kube-auth-proxy-99b5d7fdc-84grw"
Aug 04 17:55:57.903303 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:57.903221    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcd30a0d-bc39-4769-9861-9e5f65d7edb4-tls-certs\") pod \"kube-auth-proxy-99b5d7fdc-84grw\" (UID: \"bcd30a0d-bc39-4769-9861-9e5f65d7edb4\") " pod="openshift-ingress/kube-auth-proxy-99b5d7fdc-84grw"
Aug 04 17:55:58.003778 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:58.003754    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcd30a0d-bc39-4769-9861-9e5f65d7edb4-tmp\") pod \"kube-auth-proxy-99b5d7fdc-84grw\" (UID: \"bcd30a0d-bc39-4769-9861-9e5f65d7edb4\") " pod="openshift-ingress/kube-auth-proxy-99b5d7fdc-84grw"
Aug 04 17:55:58.003875 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:58.003784    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tst9r\" (UniqueName: \"kubernetes.io/projected/bcd30a0d-bc39-4769-9861-9e5f65d7edb4-kube-api-access-tst9r\") pod \"kube-auth-proxy-99b5d7fdc-84grw\" (UID: \"bcd30a0d-bc39-4769-9861-9e5f65d7edb4\") " pod="openshift-ingress/kube-auth-proxy-99b5d7fdc-84grw"
Aug 04 17:55:58.003875 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:58.003815    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcd30a0d-bc39-4769-9861-9e5f65d7edb4-tls-certs\") pod \"kube-auth-proxy-99b5d7fdc-84grw\" (UID: \"bcd30a0d-bc39-4769-9861-9e5f65d7edb4\") " pod="openshift-ingress/kube-auth-proxy-99b5d7fdc-84grw"
Aug 04 17:55:58.006020 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:58.005999    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcd30a0d-bc39-4769-9861-9e5f65d7edb4-tmp\") pod \"kube-auth-proxy-99b5d7fdc-84grw\" (UID: \"bcd30a0d-bc39-4769-9861-9e5f65d7edb4\") " pod="openshift-ingress/kube-auth-proxy-99b5d7fdc-84grw"
Aug 04 17:55:58.006111 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:58.006081    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcd30a0d-bc39-4769-9861-9e5f65d7edb4-tls-certs\") pod \"kube-auth-proxy-99b5d7fdc-84grw\" (UID: \"bcd30a0d-bc39-4769-9861-9e5f65d7edb4\") " pod="openshift-ingress/kube-auth-proxy-99b5d7fdc-84grw"
Aug 04 17:55:58.012701 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:58.012646    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tst9r\" (UniqueName: \"kubernetes.io/projected/bcd30a0d-bc39-4769-9861-9e5f65d7edb4-kube-api-access-tst9r\") pod \"kube-auth-proxy-99b5d7fdc-84grw\" (UID: \"bcd30a0d-bc39-4769-9861-9e5f65d7edb4\") " pod="openshift-ingress/kube-auth-proxy-99b5d7fdc-84grw"
Aug 04 17:55:58.071689 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:58.071668    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-99b5d7fdc-84grw"
Aug 04 17:55:58.084628 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:58.084609    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mt7x5"]
Aug 04 17:55:58.087628 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:58.087609    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-mt7x5"
Aug 04 17:55:58.092252 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:58.092233    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-xggtr\""
Aug 04 17:55:58.092357 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:58.092270    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Aug 04 17:55:58.098580 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:58.098543    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mt7x5"]
Aug 04 17:55:58.205132 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:58.205106    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d73003bb-823c-445a-a591-007b9f1f9ca9-cert\") pod \"odh-model-controller-7998c67dc4-mt7x5\" (UID: \"d73003bb-823c-445a-a591-007b9f1f9ca9\") " pod="opendatahub/odh-model-controller-7998c67dc4-mt7x5"
Aug 04 17:55:58.205238 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:58.205163    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2ls6\" (UniqueName: \"kubernetes.io/projected/d73003bb-823c-445a-a591-007b9f1f9ca9-kube-api-access-c2ls6\") pod \"odh-model-controller-7998c67dc4-mt7x5\" (UID: \"d73003bb-823c-445a-a591-007b9f1f9ca9\") " pod="opendatahub/odh-model-controller-7998c67dc4-mt7x5"
Aug 04 17:55:58.211517 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:58.211491    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-99b5d7fdc-84grw"]
Aug 04 17:55:58.214355 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:55:58.214330    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcd30a0d_bc39_4769_9861_9e5f65d7edb4.slice/crio-58925d57659bac6882bfa343411c9946faec0ebafda458d0107db9d6f62d5629 WatchSource:0}: Error finding container 58925d57659bac6882bfa343411c9946faec0ebafda458d0107db9d6f62d5629: Status 404 returned error can't find the container with id 58925d57659bac6882bfa343411c9946faec0ebafda458d0107db9d6f62d5629
Aug 04 17:55:58.305508 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:58.305487    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2ls6\" (UniqueName: \"kubernetes.io/projected/d73003bb-823c-445a-a591-007b9f1f9ca9-kube-api-access-c2ls6\") pod \"odh-model-controller-7998c67dc4-mt7x5\" (UID: \"d73003bb-823c-445a-a591-007b9f1f9ca9\") " pod="opendatahub/odh-model-controller-7998c67dc4-mt7x5"
Aug 04 17:55:58.305617 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:58.305536    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d73003bb-823c-445a-a591-007b9f1f9ca9-cert\") pod \"odh-model-controller-7998c67dc4-mt7x5\" (UID: \"d73003bb-823c-445a-a591-007b9f1f9ca9\") " pod="opendatahub/odh-model-controller-7998c67dc4-mt7x5"
Aug 04 17:55:58.307630 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:58.307613    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d73003bb-823c-445a-a591-007b9f1f9ca9-cert\") pod \"odh-model-controller-7998c67dc4-mt7x5\" (UID: \"d73003bb-823c-445a-a591-007b9f1f9ca9\") " pod="opendatahub/odh-model-controller-7998c67dc4-mt7x5"
Aug 04 17:55:58.318396 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:58.318370    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2ls6\" (UniqueName: \"kubernetes.io/projected/d73003bb-823c-445a-a591-007b9f1f9ca9-kube-api-access-c2ls6\") pod \"odh-model-controller-7998c67dc4-mt7x5\" (UID: \"d73003bb-823c-445a-a591-007b9f1f9ca9\") " pod="opendatahub/odh-model-controller-7998c67dc4-mt7x5"
Aug 04 17:55:58.398105 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:58.398077    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-mt7x5"
Aug 04 17:55:58.539206 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:58.539170    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mt7x5"]
Aug 04 17:55:58.542810 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:55:58.542783    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd73003bb_823c_445a_a591_007b9f1f9ca9.slice/crio-b052cea8b6b9a86ae48e8e4eada1df0db825a024ec6c2694d7a3de46f6c11e81 WatchSource:0}: Error finding container b052cea8b6b9a86ae48e8e4eada1df0db825a024ec6c2694d7a3de46f6c11e81: Status 404 returned error can't find the container with id b052cea8b6b9a86ae48e8e4eada1df0db825a024ec6c2694d7a3de46f6c11e81
Aug 04 17:55:58.645110 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:58.645044    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-99b5d7fdc-84grw" event={"ID":"bcd30a0d-bc39-4769-9861-9e5f65d7edb4","Type":"ContainerStarted","Data":"58925d57659bac6882bfa343411c9946faec0ebafda458d0107db9d6f62d5629"}
Aug 04 17:55:58.646211 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:55:58.646184    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-mt7x5" event={"ID":"d73003bb-823c-445a-a591-007b9f1f9ca9","Type":"ContainerStarted","Data":"b052cea8b6b9a86ae48e8e4eada1df0db825a024ec6c2694d7a3de46f6c11e81"}
Aug 04 17:56:02.660652 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:02.660621    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-mt7x5" event={"ID":"d73003bb-823c-445a-a591-007b9f1f9ca9","Type":"ContainerStarted","Data":"cd4a19405b397f28e3fbeef8cbfa7d838f7ab809e18418818db4ac2a40717e96"}
Aug 04 17:56:02.661004 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:02.660688    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-mt7x5"
Aug 04 17:56:02.662070 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:02.662051    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-99b5d7fdc-84grw" event={"ID":"bcd30a0d-bc39-4769-9861-9e5f65d7edb4","Type":"ContainerStarted","Data":"dbe0e8d46cdb2194cadf0dfbbd4572b0283e1d4e017cb0169a50d6a7145f7657"}
Aug 04 17:56:02.675078 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:02.675027    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-mt7x5" podStartSLOduration=0.617802972 podStartE2EDuration="4.675009808s" totalImagesPullingTime="4.057206836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:55:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:56:02.674810514 +0000 UTC m=+579.475946832" watchObservedRunningTime="2026-08-04 17:56:02.675009808 +0000 UTC m=+579.476146168"
Aug 04 17:56:02.689694 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:02.689645    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-99b5d7fdc-84grw" podStartSLOduration=1.343746219 podStartE2EDuration="5.689632387s" totalImagesPullingTime="4.345886168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:55:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:56:02.689433165 +0000 UTC m=+579.490569489" watchObservedRunningTime="2026-08-04 17:56:02.689632387 +0000 UTC m=+579.490768713"
Aug 04 17:56:04.656173 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:04.656140    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t"]
Aug 04 17:56:04.659191 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:04.659174    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t"
Aug 04 17:56:04.661451 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:04.661430    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-hkgbt\""
Aug 04 17:56:04.661595 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:04.661573    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Aug 04 17:56:04.692781 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:04.692757    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t"]
Aug 04 17:56:04.753957 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:04.753931    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67403d95-d95b-429d-a77d-3ee880403375-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t\" (UID: \"67403d95-d95b-429d-a77d-3ee880403375\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t"
Aug 04 17:56:04.754050 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:04.753959    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67403d95-d95b-429d-a77d-3ee880403375-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t\" (UID: \"67403d95-d95b-429d-a77d-3ee880403375\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t"
Aug 04 17:56:04.754050 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:04.753984    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67403d95-d95b-429d-a77d-3ee880403375-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t\" (UID: \"67403d95-d95b-429d-a77d-3ee880403375\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t"
Aug 04 17:56:04.754113 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:04.754066    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67403d95-d95b-429d-a77d-3ee880403375-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t\" (UID: \"67403d95-d95b-429d-a77d-3ee880403375\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t"
Aug 04 17:56:04.754113 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:04.754088    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67403d95-d95b-429d-a77d-3ee880403375-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t\" (UID: \"67403d95-d95b-429d-a77d-3ee880403375\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t"
Aug 04 17:56:04.754183 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:04.754135    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kp9j\" (UniqueName: \"kubernetes.io/projected/67403d95-d95b-429d-a77d-3ee880403375-kube-api-access-6kp9j\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t\" (UID: \"67403d95-d95b-429d-a77d-3ee880403375\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t"
Aug 04 17:56:04.754183 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:04.754155    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67403d95-d95b-429d-a77d-3ee880403375-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t\" (UID: \"67403d95-d95b-429d-a77d-3ee880403375\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t"
Aug 04 17:56:04.754245 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:04.754189    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67403d95-d95b-429d-a77d-3ee880403375-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t\" (UID: \"67403d95-d95b-429d-a77d-3ee880403375\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t"
Aug 04 17:56:04.754281 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:04.754250    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67403d95-d95b-429d-a77d-3ee880403375-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t\" (UID: \"67403d95-d95b-429d-a77d-3ee880403375\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t"
Aug 04 17:56:04.854650 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:04.854622    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67403d95-d95b-429d-a77d-3ee880403375-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t\" (UID: \"67403d95-d95b-429d-a77d-3ee880403375\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t"
Aug 04 17:56:04.854751 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:04.854656    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kp9j\" (UniqueName: \"kubernetes.io/projected/67403d95-d95b-429d-a77d-3ee880403375-kube-api-access-6kp9j\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t\" (UID: \"67403d95-d95b-429d-a77d-3ee880403375\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t"
Aug 04 17:56:04.854751 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:04.854676    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67403d95-d95b-429d-a77d-3ee880403375-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t\" (UID: \"67403d95-d95b-429d-a77d-3ee880403375\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t"
Aug 04 17:56:04.854751 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:04.854723    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67403d95-d95b-429d-a77d-3ee880403375-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t\" (UID: \"67403d95-d95b-429d-a77d-3ee880403375\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t"
Aug 04 17:56:04.854915 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:04.854761    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67403d95-d95b-429d-a77d-3ee880403375-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t\" (UID: \"67403d95-d95b-429d-a77d-3ee880403375\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t"
Aug 04 17:56:04.854915 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:04.854788    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67403d95-d95b-429d-a77d-3ee880403375-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t\" (UID: \"67403d95-d95b-429d-a77d-3ee880403375\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t"
Aug 04 17:56:04.854915 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:04.854809    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67403d95-d95b-429d-a77d-3ee880403375-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t\" (UID: \"67403d95-d95b-429d-a77d-3ee880403375\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t"
Aug 04 17:56:04.854915 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:04.854902    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67403d95-d95b-429d-a77d-3ee880403375-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t\" (UID: \"67403d95-d95b-429d-a77d-3ee880403375\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t"
Aug 04 17:56:04.855120 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:04.855015    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67403d95-d95b-429d-a77d-3ee880403375-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t\" (UID: \"67403d95-d95b-429d-a77d-3ee880403375\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t"
Aug 04 17:56:04.855120 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:04.855038    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67403d95-d95b-429d-a77d-3ee880403375-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t\" (UID: \"67403d95-d95b-429d-a77d-3ee880403375\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t"
Aug 04 17:56:04.855210 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:04.855187    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67403d95-d95b-429d-a77d-3ee880403375-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t\" (UID: \"67403d95-d95b-429d-a77d-3ee880403375\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t"
Aug 04 17:56:04.855309 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:04.855268    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67403d95-d95b-429d-a77d-3ee880403375-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t\" (UID: \"67403d95-d95b-429d-a77d-3ee880403375\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t"
Aug 04 17:56:04.855431 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:04.855414    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67403d95-d95b-429d-a77d-3ee880403375-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t\" (UID: \"67403d95-d95b-429d-a77d-3ee880403375\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t"
Aug 04 17:56:04.855554 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:04.855534    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67403d95-d95b-429d-a77d-3ee880403375-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t\" (UID: \"67403d95-d95b-429d-a77d-3ee880403375\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t"
Aug 04 17:56:04.857120 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:04.857102    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67403d95-d95b-429d-a77d-3ee880403375-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t\" (UID: \"67403d95-d95b-429d-a77d-3ee880403375\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t"
Aug 04 17:56:04.857261 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:04.857245    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67403d95-d95b-429d-a77d-3ee880403375-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t\" (UID: \"67403d95-d95b-429d-a77d-3ee880403375\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t"
Aug 04 17:56:04.866376 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:04.866353    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kp9j\" (UniqueName: \"kubernetes.io/projected/67403d95-d95b-429d-a77d-3ee880403375-kube-api-access-6kp9j\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t\" (UID: \"67403d95-d95b-429d-a77d-3ee880403375\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t"
Aug 04 17:56:04.866946 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:04.866930    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67403d95-d95b-429d-a77d-3ee880403375-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t\" (UID: \"67403d95-d95b-429d-a77d-3ee880403375\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t"
Aug 04 17:56:04.969028 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:04.968975    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t"
Aug 04 17:56:05.094293 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:05.094263    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t"]
Aug 04 17:56:05.097195 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:56:05.097163    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67403d95_d95b_429d_a77d_3ee880403375.slice/crio-70b374e4e2cdfddd3d343487acc184afdf1f4a7c8704148a782fcb9ce57d1990 WatchSource:0}: Error finding container 70b374e4e2cdfddd3d343487acc184afdf1f4a7c8704148a782fcb9ce57d1990: Status 404 returned error can't find the container with id 70b374e4e2cdfddd3d343487acc184afdf1f4a7c8704148a782fcb9ce57d1990
Aug 04 17:56:05.674558 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:05.674511    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t" event={"ID":"67403d95-d95b-429d-a77d-3ee880403375","Type":"ContainerStarted","Data":"70b374e4e2cdfddd3d343487acc184afdf1f4a7c8704148a782fcb9ce57d1990"}
Aug 04 17:56:06.029293 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:06.029265    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-564c4ff8f7-r9lfv"]
Aug 04 17:56:06.033195 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:06.033179    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-r9lfv"
Aug 04 17:56:06.036564 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:06.036546    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jbk9j\""
Aug 04 17:56:06.036564 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:06.036558    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Aug 04 17:56:06.036708 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:06.036604    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Aug 04 17:56:06.036812 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:06.036800    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Aug 04 17:56:06.042559 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:06.042536    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-564c4ff8f7-r9lfv"]
Aug 04 17:56:06.165093 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:06.165071    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2c158356-a5c8-4647-ba41-89f481c78f2a-metrics-cert\") pod \"lws-controller-manager-564c4ff8f7-r9lfv\" (UID: \"2c158356-a5c8-4647-ba41-89f481c78f2a\") " pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-r9lfv"
Aug 04 17:56:06.165198 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:06.165109    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p64td\" (UniqueName: \"kubernetes.io/projected/2c158356-a5c8-4647-ba41-89f481c78f2a-kube-api-access-p64td\") pod \"lws-controller-manager-564c4ff8f7-r9lfv\" (UID: \"2c158356-a5c8-4647-ba41-89f481c78f2a\") " pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-r9lfv"
Aug 04 17:56:06.165198 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:06.165136    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2c158356-a5c8-4647-ba41-89f481c78f2a-manager-config\") pod \"lws-controller-manager-564c4ff8f7-r9lfv\" (UID: \"2c158356-a5c8-4647-ba41-89f481c78f2a\") " pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-r9lfv"
Aug 04 17:56:06.165275 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:06.165199    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c158356-a5c8-4647-ba41-89f481c78f2a-cert\") pod \"lws-controller-manager-564c4ff8f7-r9lfv\" (UID: \"2c158356-a5c8-4647-ba41-89f481c78f2a\") " pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-r9lfv"
Aug 04 17:56:06.266074 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:06.266050    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p64td\" (UniqueName: \"kubernetes.io/projected/2c158356-a5c8-4647-ba41-89f481c78f2a-kube-api-access-p64td\") pod \"lws-controller-manager-564c4ff8f7-r9lfv\" (UID: \"2c158356-a5c8-4647-ba41-89f481c78f2a\") " pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-r9lfv"
Aug 04 17:56:06.266161 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:06.266100    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2c158356-a5c8-4647-ba41-89f481c78f2a-manager-config\") pod \"lws-controller-manager-564c4ff8f7-r9lfv\" (UID: \"2c158356-a5c8-4647-ba41-89f481c78f2a\") " pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-r9lfv"
Aug 04 17:56:06.266161 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:06.266139    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c158356-a5c8-4647-ba41-89f481c78f2a-cert\") pod \"lws-controller-manager-564c4ff8f7-r9lfv\" (UID: \"2c158356-a5c8-4647-ba41-89f481c78f2a\") " pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-r9lfv"
Aug 04 17:56:06.266268 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:06.266205    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2c158356-a5c8-4647-ba41-89f481c78f2a-metrics-cert\") pod \"lws-controller-manager-564c4ff8f7-r9lfv\" (UID: \"2c158356-a5c8-4647-ba41-89f481c78f2a\") " pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-r9lfv"
Aug 04 17:56:06.266955 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:06.266923    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2c158356-a5c8-4647-ba41-89f481c78f2a-manager-config\") pod \"lws-controller-manager-564c4ff8f7-r9lfv\" (UID: \"2c158356-a5c8-4647-ba41-89f481c78f2a\") " pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-r9lfv"
Aug 04 17:56:06.269411 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:06.269359    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2c158356-a5c8-4647-ba41-89f481c78f2a-metrics-cert\") pod \"lws-controller-manager-564c4ff8f7-r9lfv\" (UID: \"2c158356-a5c8-4647-ba41-89f481c78f2a\") " pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-r9lfv"
Aug 04 17:56:06.269877 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:06.269858    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c158356-a5c8-4647-ba41-89f481c78f2a-cert\") pod \"lws-controller-manager-564c4ff8f7-r9lfv\" (UID: \"2c158356-a5c8-4647-ba41-89f481c78f2a\") " pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-r9lfv"
Aug 04 17:56:06.281084 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:06.281031    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p64td\" (UniqueName: \"kubernetes.io/projected/2c158356-a5c8-4647-ba41-89f481c78f2a-kube-api-access-p64td\") pod \"lws-controller-manager-564c4ff8f7-r9lfv\" (UID: \"2c158356-a5c8-4647-ba41-89f481c78f2a\") " pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-r9lfv"
Aug 04 17:56:06.342745 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:06.342722    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-r9lfv"
Aug 04 17:56:06.494292 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:06.494240    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-564c4ff8f7-r9lfv"]
Aug 04 17:56:06.688315 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:56:06.688219    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c158356_a5c8_4647_ba41_89f481c78f2a.slice/crio-2c188258e5d1bcf24831046b8b20efba90e9662038a4304d9b6e4579469641f7 WatchSource:0}: Error finding container 2c188258e5d1bcf24831046b8b20efba90e9662038a4304d9b6e4579469641f7: Status 404 returned error can't find the container with id 2c188258e5d1bcf24831046b8b20efba90e9662038a4304d9b6e4579469641f7
Aug 04 17:56:07.683988 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:07.683958    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-r9lfv" event={"ID":"2c158356-a5c8-4647-ba41-89f481c78f2a","Type":"ContainerStarted","Data":"2c188258e5d1bcf24831046b8b20efba90e9662038a4304d9b6e4579469641f7"}
Aug 04 17:56:08.694601 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:08.694565    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 17:56:08.694958 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:08.694634    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 17:56:08.694958 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:08.694663    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 17:56:09.692951 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:09.692919    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t" event={"ID":"67403d95-d95b-429d-a77d-3ee880403375","Type":"ContainerStarted","Data":"6ea7d18f48e6b4b0befc9b73b398686378b6695a782b1defbabb52590821a9b4"}
Aug 04 17:56:09.694444 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:09.694419    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-r9lfv" event={"ID":"2c158356-a5c8-4647-ba41-89f481c78f2a","Type":"ContainerStarted","Data":"d8ed2b92d93348b4c4789f46acccf93cb52a505f4bdb894260b321e3668dc5e7"}
Aug 04 17:56:09.694586 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:09.694472    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-r9lfv"
Aug 04 17:56:09.715530 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:09.715477    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t" podStartSLOduration=2.120224699 podStartE2EDuration="5.71546412s" totalImagesPullingTime="3.595239421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:56:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:56:09.714421465 +0000 UTC m=+586.515557796" watchObservedRunningTime="2026-08-04 17:56:09.71546412 +0000 UTC m=+586.516600496"
Aug 04 17:56:09.732273 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:09.732230    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-r9lfv" podStartSLOduration=1.727133727 podStartE2EDuration="3.732217163s" totalImagesPullingTime="2.005083436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:56:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:56:09.730953589 +0000 UTC m=+586.532089999" watchObservedRunningTime="2026-08-04 17:56:09.732217163 +0000 UTC m=+586.533353489"
Aug 04 17:56:09.970041 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:09.969968    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t"
Aug 04 17:56:09.974357 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:09.974336    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t"
Aug 04 17:56:10.698576 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:10.698541    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t"
Aug 04 17:56:10.699381 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:10.699363    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t"
Aug 04 17:56:13.667312 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:13.667285    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-mt7x5"
Aug 04 17:56:20.700251 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:56:20.700218    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-r9lfv"
Aug 04 17:58:19.288297 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:19.288208    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"]
Aug 04 17:58:19.291162 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:19.291144    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"
Aug 04 17:58:19.293135 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:19.293117    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-26gkg\""
Aug 04 17:58:19.303751 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:19.303724    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"]
Aug 04 17:58:19.429586 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:19.429559    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa5b1c34-ce88-4f98-9466-80eee08573f5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-62kpw\" (UID: \"fa5b1c34-ce88-4f98-9466-80eee08573f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"
Aug 04 17:58:19.429703 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:19.429601    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa5b1c34-ce88-4f98-9466-80eee08573f5-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-62kpw\" (UID: \"fa5b1c34-ce88-4f98-9466-80eee08573f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"
Aug 04 17:58:19.429703 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:19.429640    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa5b1c34-ce88-4f98-9466-80eee08573f5-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-62kpw\" (UID: \"fa5b1c34-ce88-4f98-9466-80eee08573f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"
Aug 04 17:58:19.429703 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:19.429657    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa5b1c34-ce88-4f98-9466-80eee08573f5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-62kpw\" (UID: \"fa5b1c34-ce88-4f98-9466-80eee08573f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"
Aug 04 17:58:19.429703 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:19.429678    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa5b1c34-ce88-4f98-9466-80eee08573f5-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-62kpw\" (UID: \"fa5b1c34-ce88-4f98-9466-80eee08573f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"
Aug 04 17:58:19.429703 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:19.429699    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa5b1c34-ce88-4f98-9466-80eee08573f5-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-62kpw\" (UID: \"fa5b1c34-ce88-4f98-9466-80eee08573f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"
Aug 04 17:58:19.429867 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:19.429779    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa5b1c34-ce88-4f98-9466-80eee08573f5-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-62kpw\" (UID: \"fa5b1c34-ce88-4f98-9466-80eee08573f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"
Aug 04 17:58:19.429867 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:19.429810    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa5b1c34-ce88-4f98-9466-80eee08573f5-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-62kpw\" (UID: \"fa5b1c34-ce88-4f98-9466-80eee08573f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"
Aug 04 17:58:19.429867 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:19.429828    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87629\" (UniqueName: \"kubernetes.io/projected/fa5b1c34-ce88-4f98-9466-80eee08573f5-kube-api-access-87629\") pod \"maas-default-gateway-openshift-default-78bb78ff78-62kpw\" (UID: \"fa5b1c34-ce88-4f98-9466-80eee08573f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"
Aug 04 17:58:19.531107 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:19.531083    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa5b1c34-ce88-4f98-9466-80eee08573f5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-62kpw\" (UID: \"fa5b1c34-ce88-4f98-9466-80eee08573f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"
Aug 04 17:58:19.531222 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:19.531120    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa5b1c34-ce88-4f98-9466-80eee08573f5-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-62kpw\" (UID: \"fa5b1c34-ce88-4f98-9466-80eee08573f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"
Aug 04 17:58:19.531222 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:19.531144    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa5b1c34-ce88-4f98-9466-80eee08573f5-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-62kpw\" (UID: \"fa5b1c34-ce88-4f98-9466-80eee08573f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"
Aug 04 17:58:19.531222 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:19.531160    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa5b1c34-ce88-4f98-9466-80eee08573f5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-62kpw\" (UID: \"fa5b1c34-ce88-4f98-9466-80eee08573f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"
Aug 04 17:58:19.531222 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:19.531180    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa5b1c34-ce88-4f98-9466-80eee08573f5-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-62kpw\" (UID: \"fa5b1c34-ce88-4f98-9466-80eee08573f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"
Aug 04 17:58:19.531429 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:19.531289    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa5b1c34-ce88-4f98-9466-80eee08573f5-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-62kpw\" (UID: \"fa5b1c34-ce88-4f98-9466-80eee08573f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"
Aug 04 17:58:19.531429 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:19.531353    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa5b1c34-ce88-4f98-9466-80eee08573f5-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-62kpw\" (UID: \"fa5b1c34-ce88-4f98-9466-80eee08573f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"
Aug 04 17:58:19.531429 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:19.531383    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa5b1c34-ce88-4f98-9466-80eee08573f5-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-62kpw\" (UID: \"fa5b1c34-ce88-4f98-9466-80eee08573f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"
Aug 04 17:58:19.531429 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:19.531407    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87629\" (UniqueName: \"kubernetes.io/projected/fa5b1c34-ce88-4f98-9466-80eee08573f5-kube-api-access-87629\") pod \"maas-default-gateway-openshift-default-78bb78ff78-62kpw\" (UID: \"fa5b1c34-ce88-4f98-9466-80eee08573f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"
Aug 04 17:58:19.531677 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:19.531510    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa5b1c34-ce88-4f98-9466-80eee08573f5-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-62kpw\" (UID: \"fa5b1c34-ce88-4f98-9466-80eee08573f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"
Aug 04 17:58:19.531735 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:19.531721    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa5b1c34-ce88-4f98-9466-80eee08573f5-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-62kpw\" (UID: \"fa5b1c34-ce88-4f98-9466-80eee08573f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"
Aug 04 17:58:19.531888 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:19.531871    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa5b1c34-ce88-4f98-9466-80eee08573f5-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-62kpw\" (UID: \"fa5b1c34-ce88-4f98-9466-80eee08573f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"
Aug 04 17:58:19.531937 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:19.531872    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa5b1c34-ce88-4f98-9466-80eee08573f5-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-62kpw\" (UID: \"fa5b1c34-ce88-4f98-9466-80eee08573f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"
Aug 04 17:58:19.531982 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:19.531961    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa5b1c34-ce88-4f98-9466-80eee08573f5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-62kpw\" (UID: \"fa5b1c34-ce88-4f98-9466-80eee08573f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"
Aug 04 17:58:19.533406 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:19.533378    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa5b1c34-ce88-4f98-9466-80eee08573f5-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-62kpw\" (UID: \"fa5b1c34-ce88-4f98-9466-80eee08573f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"
Aug 04 17:58:19.533618 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:19.533603    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa5b1c34-ce88-4f98-9466-80eee08573f5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-62kpw\" (UID: \"fa5b1c34-ce88-4f98-9466-80eee08573f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"
Aug 04 17:58:19.537718 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:19.537695    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa5b1c34-ce88-4f98-9466-80eee08573f5-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-62kpw\" (UID: \"fa5b1c34-ce88-4f98-9466-80eee08573f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"
Aug 04 17:58:19.538254 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:19.538235    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87629\" (UniqueName: \"kubernetes.io/projected/fa5b1c34-ce88-4f98-9466-80eee08573f5-kube-api-access-87629\") pod \"maas-default-gateway-openshift-default-78bb78ff78-62kpw\" (UID: \"fa5b1c34-ce88-4f98-9466-80eee08573f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"
Aug 04 17:58:19.600749 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:19.600698    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"
Aug 04 17:58:19.724756 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:19.724734    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"]
Aug 04 17:58:19.726847 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:58:19.726821    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa5b1c34_ce88_4f98_9466_80eee08573f5.slice/crio-b41cd5dd2c3d3a11eef907552466d57e97eabac43677238c3f511acc0bd62aaf WatchSource:0}: Error finding container b41cd5dd2c3d3a11eef907552466d57e97eabac43677238c3f511acc0bd62aaf: Status 404 returned error can't find the container with id b41cd5dd2c3d3a11eef907552466d57e97eabac43677238c3f511acc0bd62aaf
Aug 04 17:58:19.728894 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:19.728865    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 17:58:19.728975 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:19.728927    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 17:58:19.728975 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:19.728955    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 17:58:20.166728 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:20.166696    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw" event={"ID":"fa5b1c34-ce88-4f98-9466-80eee08573f5","Type":"ContainerStarted","Data":"7b354893202729f3f5897ff50af0eeea6d8864004ea9245223e3039aaf9fdd0c"}
Aug 04 17:58:20.166880 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:20.166741    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw" event={"ID":"fa5b1c34-ce88-4f98-9466-80eee08573f5","Type":"ContainerStarted","Data":"b41cd5dd2c3d3a11eef907552466d57e97eabac43677238c3f511acc0bd62aaf"}
Aug 04 17:58:20.186497 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:20.186451    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw" podStartSLOduration=1.186437677 podStartE2EDuration="1.186437677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:58:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:58:20.186198534 +0000 UTC m=+716.987334872" watchObservedRunningTime="2026-08-04 17:58:20.186437677 +0000 UTC m=+716.987574004"
Aug 04 17:58:20.601570 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:20.601546    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"
Aug 04 17:58:20.605964 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:20.605945    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"
Aug 04 17:58:21.170759 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:21.170737    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"
Aug 04 17:58:21.171584 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:21.171564    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"
Aug 04 17:58:35.847541 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:35.847496    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c548b5d7d-4zfzf"]
Aug 04 17:58:35.850862 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:35.850845    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-4zfzf"
Aug 04 17:58:35.855112 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:35.855091    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Aug 04 17:58:35.855980 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:35.855963    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-cjfjt\""
Aug 04 17:58:35.856072 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:35.856014    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Aug 04 17:58:35.879531 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:35.879499    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-4zfzf"]
Aug 04 17:58:36.045465 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:36.045444    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdsmw\" (UniqueName: \"kubernetes.io/projected/2e5deec5-379e-45be-81d2-8b35d61189d2-kube-api-access-bdsmw\") pod \"authorino-c548b5d7d-4zfzf\" (UID: \"2e5deec5-379e-45be-81d2-8b35d61189d2\") " pod="kuadrant-system/authorino-c548b5d7d-4zfzf"
Aug 04 17:58:36.146547 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:36.146479    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdsmw\" (UniqueName: \"kubernetes.io/projected/2e5deec5-379e-45be-81d2-8b35d61189d2-kube-api-access-bdsmw\") pod \"authorino-c548b5d7d-4zfzf\" (UID: \"2e5deec5-379e-45be-81d2-8b35d61189d2\") " pod="kuadrant-system/authorino-c548b5d7d-4zfzf"
Aug 04 17:58:36.154401 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:36.154380    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdsmw\" (UniqueName: \"kubernetes.io/projected/2e5deec5-379e-45be-81d2-8b35d61189d2-kube-api-access-bdsmw\") pod \"authorino-c548b5d7d-4zfzf\" (UID: \"2e5deec5-379e-45be-81d2-8b35d61189d2\") " pod="kuadrant-system/authorino-c548b5d7d-4zfzf"
Aug 04 17:58:36.159978 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:36.159962    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-4zfzf"
Aug 04 17:58:36.279680 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:36.279516    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-4zfzf"]
Aug 04 17:58:36.282291 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:58:36.282266    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e5deec5_379e_45be_81d2_8b35d61189d2.slice/crio-9ec335200554e1a0e135d571dea0efc2da3511e5f54429b62a45e404f0c644e5 WatchSource:0}: Error finding container 9ec335200554e1a0e135d571dea0efc2da3511e5f54429b62a45e404f0c644e5: Status 404 returned error can't find the container with id 9ec335200554e1a0e135d571dea0efc2da3511e5f54429b62a45e404f0c644e5
Aug 04 17:58:36.284124 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:36.284106    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 17:58:37.231721 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:37.231689    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-4zfzf" event={"ID":"2e5deec5-379e-45be-81d2-8b35d61189d2","Type":"ContainerStarted","Data":"9ec335200554e1a0e135d571dea0efc2da3511e5f54429b62a45e404f0c644e5"}
Aug 04 17:58:40.244608 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:40.244576    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-4zfzf" event={"ID":"2e5deec5-379e-45be-81d2-8b35d61189d2","Type":"ContainerStarted","Data":"fec0d255cec9879d6456fb6400b9aeec82904ec02c5a3a3ab0caada0d68e4de9"}
Aug 04 17:58:40.271537 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:58:40.268109    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c548b5d7d-4zfzf" podStartSLOduration=2.346861574 podStartE2EDuration="5.268089853s" totalImagesPullingTime="2.921228279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:58:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:58:40.265450424 +0000 UTC m=+737.066586750" watchObservedRunningTime="2026-08-04 17:58:40.268089853 +0000 UTC m=+737.069226183"
Aug 04 17:59:05.991993 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:59:05.991963    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57b7795cf9-cpsm9"]
Aug 04 17:59:06.000134 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:59:06.000111    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57b7795cf9-cpsm9"
Aug 04 17:59:06.002382 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:59:06.002366    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Aug 04 17:59:06.005227 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:59:06.005204    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57b7795cf9-cpsm9"]
Aug 04 17:59:06.051709 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:59:06.051685    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6zr2\" (UniqueName: \"kubernetes.io/projected/c17928aa-fe48-4784-a82a-4e22ad6cef57-kube-api-access-k6zr2\") pod \"authorino-57b7795cf9-cpsm9\" (UID: \"c17928aa-fe48-4784-a82a-4e22ad6cef57\") " pod="kuadrant-system/authorino-57b7795cf9-cpsm9"
Aug 04 17:59:06.051793 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:59:06.051712    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c17928aa-fe48-4784-a82a-4e22ad6cef57-tls-cert\") pod \"authorino-57b7795cf9-cpsm9\" (UID: \"c17928aa-fe48-4784-a82a-4e22ad6cef57\") " pod="kuadrant-system/authorino-57b7795cf9-cpsm9"
Aug 04 17:59:06.152319 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:59:06.152295    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6zr2\" (UniqueName: \"kubernetes.io/projected/c17928aa-fe48-4784-a82a-4e22ad6cef57-kube-api-access-k6zr2\") pod \"authorino-57b7795cf9-cpsm9\" (UID: \"c17928aa-fe48-4784-a82a-4e22ad6cef57\") " pod="kuadrant-system/authorino-57b7795cf9-cpsm9"
Aug 04 17:59:06.152406 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:59:06.152326    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c17928aa-fe48-4784-a82a-4e22ad6cef57-tls-cert\") pod \"authorino-57b7795cf9-cpsm9\" (UID: \"c17928aa-fe48-4784-a82a-4e22ad6cef57\") " pod="kuadrant-system/authorino-57b7795cf9-cpsm9"
Aug 04 17:59:06.154670 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:59:06.154650    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c17928aa-fe48-4784-a82a-4e22ad6cef57-tls-cert\") pod \"authorino-57b7795cf9-cpsm9\" (UID: \"c17928aa-fe48-4784-a82a-4e22ad6cef57\") " pod="kuadrant-system/authorino-57b7795cf9-cpsm9"
Aug 04 17:59:06.159155 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:59:06.159133    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6zr2\" (UniqueName: \"kubernetes.io/projected/c17928aa-fe48-4784-a82a-4e22ad6cef57-kube-api-access-k6zr2\") pod \"authorino-57b7795cf9-cpsm9\" (UID: \"c17928aa-fe48-4784-a82a-4e22ad6cef57\") " pod="kuadrant-system/authorino-57b7795cf9-cpsm9"
Aug 04 17:59:06.309857 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:59:06.309841    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57b7795cf9-cpsm9"
Aug 04 17:59:06.430013 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:59:06.429989    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57b7795cf9-cpsm9"]
Aug 04 17:59:06.432768 ip-10-0-141-220 kubenswrapper[2571]: W0804 17:59:06.432744    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc17928aa_fe48_4784_a82a_4e22ad6cef57.slice/crio-1934cd3d605cd599a515650a77fbeaa43278200228656693c7d475fbfc228d0a WatchSource:0}: Error finding container 1934cd3d605cd599a515650a77fbeaa43278200228656693c7d475fbfc228d0a: Status 404 returned error can't find the container with id 1934cd3d605cd599a515650a77fbeaa43278200228656693c7d475fbfc228d0a
Aug 04 17:59:07.346999 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:59:07.346967    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57b7795cf9-cpsm9" event={"ID":"c17928aa-fe48-4784-a82a-4e22ad6cef57","Type":"ContainerStarted","Data":"56988125d0985eb6d101e0f4c211d092369e022d8e834c5396536e633ed71780"}
Aug 04 17:59:07.347387 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:59:07.347007    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57b7795cf9-cpsm9" event={"ID":"c17928aa-fe48-4784-a82a-4e22ad6cef57","Type":"ContainerStarted","Data":"1934cd3d605cd599a515650a77fbeaa43278200228656693c7d475fbfc228d0a"}
Aug 04 17:59:07.360950 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:59:07.360881    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-57b7795cf9-cpsm9" podStartSLOduration=1.913678717 podStartE2EDuration="2.360861579s" totalImagesPullingTime="447.182862ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:59:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:59:07.360598118 +0000 UTC m=+764.161734458" watchObservedRunningTime="2026-08-04 17:59:07.360861579 +0000 UTC m=+764.161997909"
Aug 04 17:59:07.386827 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:59:07.386801    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-4zfzf"]
Aug 04 17:59:07.386984 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:59:07.386963    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-c548b5d7d-4zfzf" podUID="2e5deec5-379e-45be-81d2-8b35d61189d2" containerName="authorino" containerID="cri-o://fec0d255cec9879d6456fb6400b9aeec82904ec02c5a3a3ab0caada0d68e4de9" gracePeriod=30
Aug 04 17:59:07.619143 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:59:07.619122    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-4zfzf"
Aug 04 17:59:07.661644 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:59:07.661619    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdsmw\" (UniqueName: \"kubernetes.io/projected/2e5deec5-379e-45be-81d2-8b35d61189d2-kube-api-access-bdsmw\") pod \"2e5deec5-379e-45be-81d2-8b35d61189d2\" (UID: \"2e5deec5-379e-45be-81d2-8b35d61189d2\") "
Aug 04 17:59:07.663625 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:59:07.663599    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e5deec5-379e-45be-81d2-8b35d61189d2-kube-api-access-bdsmw" (OuterVolumeSpecName: "kube-api-access-bdsmw") pod "2e5deec5-379e-45be-81d2-8b35d61189d2" (UID: "2e5deec5-379e-45be-81d2-8b35d61189d2"). InnerVolumeSpecName "kube-api-access-bdsmw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:59:07.762655 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:59:07.762630    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdsmw\" (UniqueName: \"kubernetes.io/projected/2e5deec5-379e-45be-81d2-8b35d61189d2-kube-api-access-bdsmw\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 17:59:08.352114 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:59:08.352088    2571 generic.go:356] "Generic (PLEG): container finished" podID="2e5deec5-379e-45be-81d2-8b35d61189d2" containerID="fec0d255cec9879d6456fb6400b9aeec82904ec02c5a3a3ab0caada0d68e4de9" exitCode=0
Aug 04 17:59:08.352415 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:59:08.352125    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-4zfzf"
Aug 04 17:59:08.352415 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:59:08.352171    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-4zfzf" event={"ID":"2e5deec5-379e-45be-81d2-8b35d61189d2","Type":"ContainerDied","Data":"fec0d255cec9879d6456fb6400b9aeec82904ec02c5a3a3ab0caada0d68e4de9"}
Aug 04 17:59:08.352415 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:59:08.352205    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-4zfzf" event={"ID":"2e5deec5-379e-45be-81d2-8b35d61189d2","Type":"ContainerDied","Data":"9ec335200554e1a0e135d571dea0efc2da3511e5f54429b62a45e404f0c644e5"}
Aug 04 17:59:08.352415 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:59:08.352222    2571 scope.go:117] "RemoveContainer" containerID="fec0d255cec9879d6456fb6400b9aeec82904ec02c5a3a3ab0caada0d68e4de9"
Aug 04 17:59:08.359951 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:59:08.359937    2571 scope.go:117] "RemoveContainer" containerID="fec0d255cec9879d6456fb6400b9aeec82904ec02c5a3a3ab0caada0d68e4de9"
Aug 04 17:59:08.360189 ip-10-0-141-220 kubenswrapper[2571]: E0804 17:59:08.360172    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fec0d255cec9879d6456fb6400b9aeec82904ec02c5a3a3ab0caada0d68e4de9\": container with ID starting with fec0d255cec9879d6456fb6400b9aeec82904ec02c5a3a3ab0caada0d68e4de9 not found: ID does not exist" containerID="fec0d255cec9879d6456fb6400b9aeec82904ec02c5a3a3ab0caada0d68e4de9"
Aug 04 17:59:08.360249 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:59:08.360199    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fec0d255cec9879d6456fb6400b9aeec82904ec02c5a3a3ab0caada0d68e4de9"} err="failed to get container status \"fec0d255cec9879d6456fb6400b9aeec82904ec02c5a3a3ab0caada0d68e4de9\": rpc error: code = NotFound desc = could not find container \"fec0d255cec9879d6456fb6400b9aeec82904ec02c5a3a3ab0caada0d68e4de9\": container with ID starting with fec0d255cec9879d6456fb6400b9aeec82904ec02c5a3a3ab0caada0d68e4de9 not found: ID does not exist"
Aug 04 17:59:08.366641 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:59:08.366623    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-4zfzf"]
Aug 04 17:59:08.370415 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:59:08.370397    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-4zfzf"]
Aug 04 17:59:09.878607 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:59:09.878581    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e5deec5-379e-45be-81d2-8b35d61189d2" path="/var/lib/kubelet/pods/2e5deec5-379e-45be-81d2-8b35d61189d2/volumes"
Aug 04 17:59:59.554753 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:59:59.554725    2571 generic.go:356] "Generic (PLEG): container finished" podID="fa5b1c34-ce88-4f98-9466-80eee08573f5" containerID="7b354893202729f3f5897ff50af0eeea6d8864004ea9245223e3039aaf9fdd0c" exitCode=0
Aug 04 17:59:59.555096 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:59:59.554765    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw" event={"ID":"fa5b1c34-ce88-4f98-9466-80eee08573f5","Type":"ContainerDied","Data":"7b354893202729f3f5897ff50af0eeea6d8864004ea9245223e3039aaf9fdd0c"}
Aug 04 17:59:59.555096 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:59:59.555055    2571 scope.go:117] "RemoveContainer" containerID="7b354893202729f3f5897ff50af0eeea6d8864004ea9245223e3039aaf9fdd0c"
Aug 04 17:59:59.556013 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:59:59.555983    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 17:59:59.556086 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:59:59.556068    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 17:59:59.556132 ip-10-0-141-220 kubenswrapper[2571]: I0804 17:59:59.556116    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:00:00.560506 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:00:00.560470    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw" event={"ID":"fa5b1c34-ce88-4f98-9466-80eee08573f5","Type":"ContainerStarted","Data":"c2e20a4fae166e4e515b85a43e202206df196fbc0431318cc49d6ac52ee1027a"}
Aug 04 18:00:00.601745 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:00:00.601721    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"
Aug 04 18:00:00.601917 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:00:00.601899    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-62kpw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.20:15021/healthz/ready\": dial tcp 10.132.0.20:15021: connect: connection refused" start-of-body=
Aug 04 18:00:00.601961 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:00:00.601940    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw" podUID="fa5b1c34-ce88-4f98-9466-80eee08573f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.20:15021/healthz/ready\": dial tcp 10.132.0.20:15021: connect: connection refused"
Aug 04 18:00:01.601996 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:00:01.601962    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-62kpw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.20:15021/healthz/ready\": dial tcp 10.132.0.20:15021: connect: connection refused" start-of-body=
Aug 04 18:00:01.602371 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:00:01.602020    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw" podUID="fa5b1c34-ce88-4f98-9466-80eee08573f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.20:15021/healthz/ready\": dial tcp 10.132.0.20:15021: connect: connection refused"
Aug 04 18:00:02.601985 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:00:02.601951    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-62kpw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.20:15021/healthz/ready\": dial tcp 10.132.0.20:15021: connect: connection refused" start-of-body=
Aug 04 18:00:02.602148 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:00:02.602001    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw" podUID="fa5b1c34-ce88-4f98-9466-80eee08573f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.20:15021/healthz/ready\": dial tcp 10.132.0.20:15021: connect: connection refused"
Aug 04 18:00:03.601802 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:00:03.601768    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-62kpw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.20:15021/healthz/ready\": dial tcp 10.132.0.20:15021: connect: connection refused" start-of-body=
Aug 04 18:00:03.601970 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:00:03.601827    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw" podUID="fa5b1c34-ce88-4f98-9466-80eee08573f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.20:15021/healthz/ready\": dial tcp 10.132.0.20:15021: connect: connection refused"
Aug 04 18:00:04.602013 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:00:04.601979    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-62kpw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.20:15021/healthz/ready\": dial tcp 10.132.0.20:15021: connect: connection refused" start-of-body=
Aug 04 18:00:04.602390 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:00:04.602028    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw" podUID="fa5b1c34-ce88-4f98-9466-80eee08573f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.20:15021/healthz/ready\": dial tcp 10.132.0.20:15021: connect: connection refused"
Aug 04 18:00:05.758022 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:00:05.757981    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"
Aug 04 18:00:05.758495 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:00:05.758392    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"
Aug 04 18:00:05.759700 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:00:05.759674    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-62kpw"
Aug 04 18:01:07.979214 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:01:07.979177    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k"]
Aug 04 18:01:07.979768 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:01:07.979448    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e5deec5-379e-45be-81d2-8b35d61189d2" containerName="authorino"
Aug 04 18:01:07.979768 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:01:07.979458    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e5deec5-379e-45be-81d2-8b35d61189d2" containerName="authorino"
Aug 04 18:01:07.979768 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:01:07.979501    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e5deec5-379e-45be-81d2-8b35d61189d2" containerName="authorino"
Aug 04 18:01:07.982288 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:01:07.982259    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k"
Aug 04 18:01:07.984725 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:01:07.984703    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Aug 04 18:01:07.985586 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:01:07.985563    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Aug 04 18:01:07.985711 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:01:07.985601    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Aug 04 18:01:07.985711 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:01:07.985640    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-b4f56\""
Aug 04 18:01:07.991929 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:01:07.991910    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k"]
Aug 04 18:01:08.097506 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:01:08.097443    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/268d2541-5ec5-414d-b98a-6ed5a0975177-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k\" (UID: \"268d2541-5ec5-414d-b98a-6ed5a0975177\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k"
Aug 04 18:01:08.097713 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:01:08.097575    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/268d2541-5ec5-414d-b98a-6ed5a0975177-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k\" (UID: \"268d2541-5ec5-414d-b98a-6ed5a0975177\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k"
Aug 04 18:01:08.097713 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:01:08.097629    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpsvs\" (UniqueName: \"kubernetes.io/projected/268d2541-5ec5-414d-b98a-6ed5a0975177-kube-api-access-fpsvs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k\" (UID: \"268d2541-5ec5-414d-b98a-6ed5a0975177\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k"
Aug 04 18:01:08.097713 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:01:08.097667    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/268d2541-5ec5-414d-b98a-6ed5a0975177-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k\" (UID: \"268d2541-5ec5-414d-b98a-6ed5a0975177\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k"
Aug 04 18:01:08.097713 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:01:08.097705    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/268d2541-5ec5-414d-b98a-6ed5a0975177-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k\" (UID: \"268d2541-5ec5-414d-b98a-6ed5a0975177\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k"
Aug 04 18:01:08.097971 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:01:08.097743    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/268d2541-5ec5-414d-b98a-6ed5a0975177-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k\" (UID: \"268d2541-5ec5-414d-b98a-6ed5a0975177\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k"
Aug 04 18:01:08.198313 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:01:08.198281    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/268d2541-5ec5-414d-b98a-6ed5a0975177-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k\" (UID: \"268d2541-5ec5-414d-b98a-6ed5a0975177\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k"
Aug 04 18:01:08.198511 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:01:08.198318    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/268d2541-5ec5-414d-b98a-6ed5a0975177-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k\" (UID: \"268d2541-5ec5-414d-b98a-6ed5a0975177\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k"
Aug 04 18:01:08.198511 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:01:08.198345    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpsvs\" (UniqueName: \"kubernetes.io/projected/268d2541-5ec5-414d-b98a-6ed5a0975177-kube-api-access-fpsvs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k\" (UID: \"268d2541-5ec5-414d-b98a-6ed5a0975177\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k"
Aug 04 18:01:08.198511 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:01:08.198373    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/268d2541-5ec5-414d-b98a-6ed5a0975177-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k\" (UID: \"268d2541-5ec5-414d-b98a-6ed5a0975177\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k"
Aug 04 18:01:08.198511 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:01:08.198399    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/268d2541-5ec5-414d-b98a-6ed5a0975177-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k\" (UID: \"268d2541-5ec5-414d-b98a-6ed5a0975177\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k"
Aug 04 18:01:08.198511 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:01:08.198431    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/268d2541-5ec5-414d-b98a-6ed5a0975177-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k\" (UID: \"268d2541-5ec5-414d-b98a-6ed5a0975177\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k"
Aug 04 18:01:08.198814 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:01:08.198701    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/268d2541-5ec5-414d-b98a-6ed5a0975177-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k\" (UID: \"268d2541-5ec5-414d-b98a-6ed5a0975177\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k"
Aug 04 18:01:08.198814 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:01:08.198753    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/268d2541-5ec5-414d-b98a-6ed5a0975177-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k\" (UID: \"268d2541-5ec5-414d-b98a-6ed5a0975177\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k"
Aug 04 18:01:08.198904 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:01:08.198829    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/268d2541-5ec5-414d-b98a-6ed5a0975177-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k\" (UID: \"268d2541-5ec5-414d-b98a-6ed5a0975177\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k"
Aug 04 18:01:08.200757 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:01:08.200732    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/268d2541-5ec5-414d-b98a-6ed5a0975177-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k\" (UID: \"268d2541-5ec5-414d-b98a-6ed5a0975177\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k"
Aug 04 18:01:08.200954 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:01:08.200935    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/268d2541-5ec5-414d-b98a-6ed5a0975177-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k\" (UID: \"268d2541-5ec5-414d-b98a-6ed5a0975177\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k"
Aug 04 18:01:08.205661 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:01:08.205643    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpsvs\" (UniqueName: \"kubernetes.io/projected/268d2541-5ec5-414d-b98a-6ed5a0975177-kube-api-access-fpsvs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k\" (UID: \"268d2541-5ec5-414d-b98a-6ed5a0975177\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k"
Aug 04 18:01:08.291746 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:01:08.291712    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k"
Aug 04 18:01:08.441990 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:01:08.441952    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k"]
Aug 04 18:01:08.444736 ip-10-0-141-220 kubenswrapper[2571]: W0804 18:01:08.444708    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod268d2541_5ec5_414d_b98a_6ed5a0975177.slice/crio-560515173f0653bbc4e2a12e2ace624a6da3c8ea1097d69eff5a2804a24f4a35 WatchSource:0}: Error finding container 560515173f0653bbc4e2a12e2ace624a6da3c8ea1097d69eff5a2804a24f4a35: Status 404 returned error can't find the container with id 560515173f0653bbc4e2a12e2ace624a6da3c8ea1097d69eff5a2804a24f4a35
Aug 04 18:01:08.823391 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:01:08.823353    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k" event={"ID":"268d2541-5ec5-414d-b98a-6ed5a0975177","Type":"ContainerStarted","Data":"560515173f0653bbc4e2a12e2ace624a6da3c8ea1097d69eff5a2804a24f4a35"}
Aug 04 18:01:09.828536 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:01:09.828498    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k" event={"ID":"268d2541-5ec5-414d-b98a-6ed5a0975177","Type":"ContainerStarted","Data":"7f9a58d08a8b1ed33f387fb798fcafb15a9ffed3f15e0454f8639659686d464a"}
Aug 04 18:01:09.845196 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:01:09.845149    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k" podStartSLOduration=1.6602563959999999 podStartE2EDuration="2.845133266s" totalImagesPullingTime="1.18487687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:01:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:01:09.844705364 +0000 UTC m=+886.645841695" watchObservedRunningTime="2026-08-04 18:01:09.845133266 +0000 UTC m=+886.646269592"
Aug 04 18:01:18.292266 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:01:18.292193    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k"
Aug 04 18:01:18.292266 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:01:18.292246    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k"
Aug 04 18:01:18.306497 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:01:18.306476    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k"
Aug 04 18:01:18.875132 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:01:18.875106    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k"
Aug 04 18:02:14.852693 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:02:14.852658    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-66c6fcbcc8-l5qfb"]
Aug 04 18:02:14.855878 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:02:14.855858    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66c6fcbcc8-l5qfb"
Aug 04 18:02:14.862509 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:02:14.862291    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66c6fcbcc8-l5qfb"]
Aug 04 18:02:15.045675 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:02:15.045645    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/67772a4e-1731-433d-9ad0-50073afd3f25-tls-cert\") pod \"authorino-66c6fcbcc8-l5qfb\" (UID: \"67772a4e-1731-433d-9ad0-50073afd3f25\") " pod="kuadrant-system/authorino-66c6fcbcc8-l5qfb"
Aug 04 18:02:15.045819 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:02:15.045716    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2qzx\" (UniqueName: \"kubernetes.io/projected/67772a4e-1731-433d-9ad0-50073afd3f25-kube-api-access-q2qzx\") pod \"authorino-66c6fcbcc8-l5qfb\" (UID: \"67772a4e-1731-433d-9ad0-50073afd3f25\") " pod="kuadrant-system/authorino-66c6fcbcc8-l5qfb"
Aug 04 18:02:15.146733 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:02:15.146655    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/67772a4e-1731-433d-9ad0-50073afd3f25-tls-cert\") pod \"authorino-66c6fcbcc8-l5qfb\" (UID: \"67772a4e-1731-433d-9ad0-50073afd3f25\") " pod="kuadrant-system/authorino-66c6fcbcc8-l5qfb"
Aug 04 18:02:15.146733 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:02:15.146724    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2qzx\" (UniqueName: \"kubernetes.io/projected/67772a4e-1731-433d-9ad0-50073afd3f25-kube-api-access-q2qzx\") pod \"authorino-66c6fcbcc8-l5qfb\" (UID: \"67772a4e-1731-433d-9ad0-50073afd3f25\") " pod="kuadrant-system/authorino-66c6fcbcc8-l5qfb"
Aug 04 18:02:15.149047 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:02:15.149022    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/67772a4e-1731-433d-9ad0-50073afd3f25-tls-cert\") pod \"authorino-66c6fcbcc8-l5qfb\" (UID: \"67772a4e-1731-433d-9ad0-50073afd3f25\") " pod="kuadrant-system/authorino-66c6fcbcc8-l5qfb"
Aug 04 18:02:15.153841 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:02:15.153820    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2qzx\" (UniqueName: \"kubernetes.io/projected/67772a4e-1731-433d-9ad0-50073afd3f25-kube-api-access-q2qzx\") pod \"authorino-66c6fcbcc8-l5qfb\" (UID: \"67772a4e-1731-433d-9ad0-50073afd3f25\") " pod="kuadrant-system/authorino-66c6fcbcc8-l5qfb"
Aug 04 18:02:15.165291 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:02:15.165270    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66c6fcbcc8-l5qfb"
Aug 04 18:02:15.282978 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:02:15.282952    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66c6fcbcc8-l5qfb"]
Aug 04 18:02:15.286268 ip-10-0-141-220 kubenswrapper[2571]: W0804 18:02:15.286235    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod67772a4e_1731_433d_9ad0_50073afd3f25.slice/crio-6aa06026585c5b4b297ad0a07a485dd0612dcdc2415b986aa7acd77e7464f2f0 WatchSource:0}: Error finding container 6aa06026585c5b4b297ad0a07a485dd0612dcdc2415b986aa7acd77e7464f2f0: Status 404 returned error can't find the container with id 6aa06026585c5b4b297ad0a07a485dd0612dcdc2415b986aa7acd77e7464f2f0
Aug 04 18:02:16.078635 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:02:16.078606    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66c6fcbcc8-l5qfb" event={"ID":"67772a4e-1731-433d-9ad0-50073afd3f25","Type":"ContainerStarted","Data":"6aa06026585c5b4b297ad0a07a485dd0612dcdc2415b986aa7acd77e7464f2f0"}
Aug 04 18:02:17.086119 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:02:17.086076    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66c6fcbcc8-l5qfb" event={"ID":"67772a4e-1731-433d-9ad0-50073afd3f25","Type":"ContainerStarted","Data":"b880f8b33ccb3f45273426a8a770dcdb18d496622167fe12117a2c9eed2cb03d"}
Aug 04 18:02:17.105053 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:02:17.104993    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-66c6fcbcc8-l5qfb" podStartSLOduration=2.164239607 podStartE2EDuration="3.104970007s" totalImagesPullingTime="940.7304ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:02:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:02:17.103444585 +0000 UTC m=+953.904580940" watchObservedRunningTime="2026-08-04 18:02:17.104970007 +0000 UTC m=+953.906106401"
Aug 04 18:02:17.137408 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:02:17.137377    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57b7795cf9-cpsm9"]
Aug 04 18:02:17.137890 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:02:17.137851    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-57b7795cf9-cpsm9" podUID="c17928aa-fe48-4784-a82a-4e22ad6cef57" containerName="authorino" containerID="cri-o://56988125d0985eb6d101e0f4c211d092369e022d8e834c5396536e633ed71780" gracePeriod=30
Aug 04 18:02:17.393648 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:02:17.393622    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57b7795cf9-cpsm9"
Aug 04 18:02:17.465366 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:02:17.465326    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c17928aa-fe48-4784-a82a-4e22ad6cef57-tls-cert\") pod \"c17928aa-fe48-4784-a82a-4e22ad6cef57\" (UID: \"c17928aa-fe48-4784-a82a-4e22ad6cef57\") "
Aug 04 18:02:17.465560 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:02:17.465412    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6zr2\" (UniqueName: \"kubernetes.io/projected/c17928aa-fe48-4784-a82a-4e22ad6cef57-kube-api-access-k6zr2\") pod \"c17928aa-fe48-4784-a82a-4e22ad6cef57\" (UID: \"c17928aa-fe48-4784-a82a-4e22ad6cef57\") "
Aug 04 18:02:17.467482 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:02:17.467446    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c17928aa-fe48-4784-a82a-4e22ad6cef57-kube-api-access-k6zr2" (OuterVolumeSpecName: "kube-api-access-k6zr2") pod "c17928aa-fe48-4784-a82a-4e22ad6cef57" (UID: "c17928aa-fe48-4784-a82a-4e22ad6cef57"). InnerVolumeSpecName "kube-api-access-k6zr2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:02:17.474505 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:02:17.474471    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c17928aa-fe48-4784-a82a-4e22ad6cef57-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "c17928aa-fe48-4784-a82a-4e22ad6cef57" (UID: "c17928aa-fe48-4784-a82a-4e22ad6cef57"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:02:17.566600 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:02:17.566567    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6zr2\" (UniqueName: \"kubernetes.io/projected/c17928aa-fe48-4784-a82a-4e22ad6cef57-kube-api-access-k6zr2\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:02:17.566600 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:02:17.566592    2571 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c17928aa-fe48-4784-a82a-4e22ad6cef57-tls-cert\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:02:18.092621 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:02:18.092584    2571 generic.go:356] "Generic (PLEG): container finished" podID="c17928aa-fe48-4784-a82a-4e22ad6cef57" containerID="56988125d0985eb6d101e0f4c211d092369e022d8e834c5396536e633ed71780" exitCode=0
Aug 04 18:02:18.093074 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:02:18.092642    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57b7795cf9-cpsm9"
Aug 04 18:02:18.093074 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:02:18.092652    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57b7795cf9-cpsm9" event={"ID":"c17928aa-fe48-4784-a82a-4e22ad6cef57","Type":"ContainerDied","Data":"56988125d0985eb6d101e0f4c211d092369e022d8e834c5396536e633ed71780"}
Aug 04 18:02:18.093074 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:02:18.092693    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57b7795cf9-cpsm9" event={"ID":"c17928aa-fe48-4784-a82a-4e22ad6cef57","Type":"ContainerDied","Data":"1934cd3d605cd599a515650a77fbeaa43278200228656693c7d475fbfc228d0a"}
Aug 04 18:02:18.093074 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:02:18.092713    2571 scope.go:117] "RemoveContainer" containerID="56988125d0985eb6d101e0f4c211d092369e022d8e834c5396536e633ed71780"
Aug 04 18:02:18.102916 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:02:18.102890    2571 scope.go:117] "RemoveContainer" containerID="56988125d0985eb6d101e0f4c211d092369e022d8e834c5396536e633ed71780"
Aug 04 18:02:18.103199 ip-10-0-141-220 kubenswrapper[2571]: E0804 18:02:18.103177    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56988125d0985eb6d101e0f4c211d092369e022d8e834c5396536e633ed71780\": container with ID starting with 56988125d0985eb6d101e0f4c211d092369e022d8e834c5396536e633ed71780 not found: ID does not exist" containerID="56988125d0985eb6d101e0f4c211d092369e022d8e834c5396536e633ed71780"
Aug 04 18:02:18.103249 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:02:18.103213    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56988125d0985eb6d101e0f4c211d092369e022d8e834c5396536e633ed71780"} err="failed to get container status \"56988125d0985eb6d101e0f4c211d092369e022d8e834c5396536e633ed71780\": rpc error: code = NotFound desc = could not find container \"56988125d0985eb6d101e0f4c211d092369e022d8e834c5396536e633ed71780\": container with ID starting with 56988125d0985eb6d101e0f4c211d092369e022d8e834c5396536e633ed71780 not found: ID does not exist"
Aug 04 18:02:18.110276 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:02:18.110252    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57b7795cf9-cpsm9"]
Aug 04 18:02:18.113154 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:02:18.113129    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57b7795cf9-cpsm9"]
Aug 04 18:02:19.880992 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:02:19.880949    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c17928aa-fe48-4784-a82a-4e22ad6cef57" path="/var/lib/kubelet/pods/c17928aa-fe48-4784-a82a-4e22ad6cef57/volumes"
Aug 04 18:15:00.139560 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:00.139457    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764455-r6g5c"]
Aug 04 18:15:00.140034 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:00.139737    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c17928aa-fe48-4784-a82a-4e22ad6cef57" containerName="authorino"
Aug 04 18:15:00.140034 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:00.139749    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c17928aa-fe48-4784-a82a-4e22ad6cef57" containerName="authorino"
Aug 04 18:15:00.140034 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:00.139826    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c17928aa-fe48-4784-a82a-4e22ad6cef57" containerName="authorino"
Aug 04 18:15:00.142738 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:00.142719    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764455-r6g5c"
Aug 04 18:15:00.144804 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:00.144787    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6xvms\""
Aug 04 18:15:00.152090 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:00.152074    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764455-r6g5c"
Aug 04 18:15:00.156199 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:00.156171    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764455-r6g5c"]
Aug 04 18:15:00.276513 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:00.276391    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764455-r6g5c"]
Aug 04 18:15:00.278814 ip-10-0-141-220 kubenswrapper[2571]: W0804 18:15:00.278784    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53fd64dd_dfcf_49d6_92ef_71d6fa298645.slice/crio-de5d7854dc969d6442a73977667a0f9cfd8e7fffb249862dd452a88b2888e70f WatchSource:0}: Error finding container de5d7854dc969d6442a73977667a0f9cfd8e7fffb249862dd452a88b2888e70f: Status 404 returned error can't find the container with id de5d7854dc969d6442a73977667a0f9cfd8e7fffb249862dd452a88b2888e70f
Aug 04 18:15:00.280618 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:00.280601    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 18:15:01.038132 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:01.038099    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764455-r6g5c" event={"ID":"53fd64dd-dfcf-49d6-92ef-71d6fa298645","Type":"ContainerStarted","Data":"de5d7854dc969d6442a73977667a0f9cfd8e7fffb249862dd452a88b2888e70f"}
Aug 04 18:15:04.053879 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:04.053851    2571 generic.go:356] "Generic (PLEG): container finished" podID="53fd64dd-dfcf-49d6-92ef-71d6fa298645" containerID="31ec88c2ccb6928c1e3e26167bc268ed89002a71566117778d78d6cb0fb69728" exitCode=0
Aug 04 18:15:04.054218 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:04.053898    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764455-r6g5c" event={"ID":"53fd64dd-dfcf-49d6-92ef-71d6fa298645","Type":"ContainerDied","Data":"31ec88c2ccb6928c1e3e26167bc268ed89002a71566117778d78d6cb0fb69728"}
Aug 04 18:15:05.179114 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:05.179090    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764455-r6g5c"
Aug 04 18:15:06.062586 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:06.062563    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764455-r6g5c"
Aug 04 18:15:06.062586 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:06.062576    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764455-r6g5c" event={"ID":"53fd64dd-dfcf-49d6-92ef-71d6fa298645","Type":"ContainerDied","Data":"de5d7854dc969d6442a73977667a0f9cfd8e7fffb249862dd452a88b2888e70f"}
Aug 04 18:15:06.062772 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:06.062624    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de5d7854dc969d6442a73977667a0f9cfd8e7fffb249862dd452a88b2888e70f"
Aug 04 18:15:19.175714 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:19.175685    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j"]
Aug 04 18:15:19.176069 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:19.175965    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53fd64dd-dfcf-49d6-92ef-71d6fa298645" containerName="cleanup"
Aug 04 18:15:19.176069 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:19.175979    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="53fd64dd-dfcf-49d6-92ef-71d6fa298645" containerName="cleanup"
Aug 04 18:15:19.176069 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:19.176030    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="53fd64dd-dfcf-49d6-92ef-71d6fa298645" containerName="cleanup"
Aug 04 18:15:19.183651 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:19.183630    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j"
Aug 04 18:15:19.185683 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:19.185658    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-8c44b95f-kserve-self-signed-certs\""
Aug 04 18:15:19.189769 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:19.189742    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j"]
Aug 04 18:15:19.267075 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:19.267055    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc5ffab9-78ca-4db6-b48c-799cd530f2dc-tmp-dir\") pod \"e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j\" (UID: \"cc5ffab9-78ca-4db6-b48c-799cd530f2dc\") " pod="llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j"
Aug 04 18:15:19.267181 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:19.267085    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc5ffab9-78ca-4db6-b48c-799cd530f2dc-model-cache\") pod \"e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j\" (UID: \"cc5ffab9-78ca-4db6-b48c-799cd530f2dc\") " pod="llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j"
Aug 04 18:15:19.267181 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:19.267108    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc5ffab9-78ca-4db6-b48c-799cd530f2dc-dshm\") pod \"e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j\" (UID: \"cc5ffab9-78ca-4db6-b48c-799cd530f2dc\") " pod="llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j"
Aug 04 18:15:19.267181 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:19.267130    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5trss\" (UniqueName: \"kubernetes.io/projected/cc5ffab9-78ca-4db6-b48c-799cd530f2dc-kube-api-access-5trss\") pod \"e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j\" (UID: \"cc5ffab9-78ca-4db6-b48c-799cd530f2dc\") " pod="llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j"
Aug 04 18:15:19.267314 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:19.267195    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc5ffab9-78ca-4db6-b48c-799cd530f2dc-home\") pod \"e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j\" (UID: \"cc5ffab9-78ca-4db6-b48c-799cd530f2dc\") " pod="llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j"
Aug 04 18:15:19.267314 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:19.267224    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc5ffab9-78ca-4db6-b48c-799cd530f2dc-tls-certs\") pod \"e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j\" (UID: \"cc5ffab9-78ca-4db6-b48c-799cd530f2dc\") " pod="llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j"
Aug 04 18:15:19.368038 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:19.368011    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc5ffab9-78ca-4db6-b48c-799cd530f2dc-home\") pod \"e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j\" (UID: \"cc5ffab9-78ca-4db6-b48c-799cd530f2dc\") " pod="llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j"
Aug 04 18:15:19.368206 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:19.368042    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc5ffab9-78ca-4db6-b48c-799cd530f2dc-tls-certs\") pod \"e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j\" (UID: \"cc5ffab9-78ca-4db6-b48c-799cd530f2dc\") " pod="llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j"
Aug 04 18:15:19.368206 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:19.368076    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc5ffab9-78ca-4db6-b48c-799cd530f2dc-tmp-dir\") pod \"e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j\" (UID: \"cc5ffab9-78ca-4db6-b48c-799cd530f2dc\") " pod="llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j"
Aug 04 18:15:19.368206 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:19.368186    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc5ffab9-78ca-4db6-b48c-799cd530f2dc-model-cache\") pod \"e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j\" (UID: \"cc5ffab9-78ca-4db6-b48c-799cd530f2dc\") " pod="llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j"
Aug 04 18:15:19.368379 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:19.368239    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc5ffab9-78ca-4db6-b48c-799cd530f2dc-dshm\") pod \"e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j\" (UID: \"cc5ffab9-78ca-4db6-b48c-799cd530f2dc\") " pod="llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j"
Aug 04 18:15:19.368379 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:19.368275    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5trss\" (UniqueName: \"kubernetes.io/projected/cc5ffab9-78ca-4db6-b48c-799cd530f2dc-kube-api-access-5trss\") pod \"e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j\" (UID: \"cc5ffab9-78ca-4db6-b48c-799cd530f2dc\") " pod="llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j"
Aug 04 18:15:19.368499 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:19.368447    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc5ffab9-78ca-4db6-b48c-799cd530f2dc-tmp-dir\") pod \"e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j\" (UID: \"cc5ffab9-78ca-4db6-b48c-799cd530f2dc\") " pod="llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j"
Aug 04 18:15:19.368499 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:19.368447    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc5ffab9-78ca-4db6-b48c-799cd530f2dc-home\") pod \"e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j\" (UID: \"cc5ffab9-78ca-4db6-b48c-799cd530f2dc\") " pod="llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j"
Aug 04 18:15:19.368716 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:19.368698    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc5ffab9-78ca-4db6-b48c-799cd530f2dc-model-cache\") pod \"e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j\" (UID: \"cc5ffab9-78ca-4db6-b48c-799cd530f2dc\") " pod="llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j"
Aug 04 18:15:19.370542 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:19.370501    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc5ffab9-78ca-4db6-b48c-799cd530f2dc-dshm\") pod \"e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j\" (UID: \"cc5ffab9-78ca-4db6-b48c-799cd530f2dc\") " pod="llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j"
Aug 04 18:15:19.370687 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:19.370669    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc5ffab9-78ca-4db6-b48c-799cd530f2dc-tls-certs\") pod \"e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j\" (UID: \"cc5ffab9-78ca-4db6-b48c-799cd530f2dc\") " pod="llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j"
Aug 04 18:15:19.387704 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:19.387685    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5trss\" (UniqueName: \"kubernetes.io/projected/cc5ffab9-78ca-4db6-b48c-799cd530f2dc-kube-api-access-5trss\") pod \"e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j\" (UID: \"cc5ffab9-78ca-4db6-b48c-799cd530f2dc\") " pod="llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j"
Aug 04 18:15:19.493664 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:19.493615    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j"
Aug 04 18:15:19.614279 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:19.614249    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j"]
Aug 04 18:15:19.617168 ip-10-0-141-220 kubenswrapper[2571]: W0804 18:15:19.617147    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc5ffab9_78ca_4db6_b48c_799cd530f2dc.slice/crio-fd96cc46db2b42e2f60081f13abed23d4a927f12ff6f1d975ce6a232251f5a5c WatchSource:0}: Error finding container fd96cc46db2b42e2f60081f13abed23d4a927f12ff6f1d975ce6a232251f5a5c: Status 404 returned error can't find the container with id fd96cc46db2b42e2f60081f13abed23d4a927f12ff6f1d975ce6a232251f5a5c
Aug 04 18:15:20.118789 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:20.118759    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j" event={"ID":"cc5ffab9-78ca-4db6-b48c-799cd530f2dc","Type":"ContainerStarted","Data":"846f1678755bd83b8529209334f98afc9433334d077095591a89324f7c7a75ac"}
Aug 04 18:15:20.118947 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:20.118795    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j" event={"ID":"cc5ffab9-78ca-4db6-b48c-799cd530f2dc","Type":"ContainerStarted","Data":"fd96cc46db2b42e2f60081f13abed23d4a927f12ff6f1d975ce6a232251f5a5c"}
Aug 04 18:15:20.134475 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:20.134430    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j" podStartSLOduration=1.134414854 podStartE2EDuration="1.134414854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:15:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:15:20.133237505 +0000 UTC m=+1736.934373833" watchObservedRunningTime="2026-08-04 18:15:20.134414854 +0000 UTC m=+1736.935551181"
Aug 04 18:15:29.494483 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:29.494455    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j"
Aug 04 18:15:29.494483 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:29.494491    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j"
Aug 04 18:15:29.506869 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:29.506849    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j"
Aug 04 18:15:30.169599 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:30.169575    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j"
Aug 04 18:15:33.681033 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:33.681003    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq"]
Aug 04 18:15:33.684065 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:33.684050    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq"
Aug 04 18:15:33.686194 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:33.686164    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-8c44b95f-kserve-self-signed-certs\""
Aug 04 18:15:33.693969 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:33.693949    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq"]
Aug 04 18:15:33.867531 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:33.867498    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5919ecf-ce96-443c-9600-7bc26a7b540b-tmp-dir\") pod \"e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq\" (UID: \"b5919ecf-ce96-443c-9600-7bc26a7b540b\") " pod="llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq"
Aug 04 18:15:33.867656 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:33.867565    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5919ecf-ce96-443c-9600-7bc26a7b540b-tls-certs\") pod \"e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq\" (UID: \"b5919ecf-ce96-443c-9600-7bc26a7b540b\") " pod="llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq"
Aug 04 18:15:33.867656 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:33.867597    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfxtm\" (UniqueName: \"kubernetes.io/projected/b5919ecf-ce96-443c-9600-7bc26a7b540b-kube-api-access-tfxtm\") pod \"e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq\" (UID: \"b5919ecf-ce96-443c-9600-7bc26a7b540b\") " pod="llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq"
Aug 04 18:15:33.867656 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:33.867627    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5919ecf-ce96-443c-9600-7bc26a7b540b-dshm\") pod \"e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq\" (UID: \"b5919ecf-ce96-443c-9600-7bc26a7b540b\") " pod="llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq"
Aug 04 18:15:33.867800 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:33.867659    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5919ecf-ce96-443c-9600-7bc26a7b540b-home\") pod \"e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq\" (UID: \"b5919ecf-ce96-443c-9600-7bc26a7b540b\") " pod="llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq"
Aug 04 18:15:33.867800 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:33.867692    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5919ecf-ce96-443c-9600-7bc26a7b540b-model-cache\") pod \"e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq\" (UID: \"b5919ecf-ce96-443c-9600-7bc26a7b540b\") " pod="llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq"
Aug 04 18:15:33.968759 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:33.968700    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5919ecf-ce96-443c-9600-7bc26a7b540b-dshm\") pod \"e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq\" (UID: \"b5919ecf-ce96-443c-9600-7bc26a7b540b\") " pod="llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq"
Aug 04 18:15:33.968759 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:33.968733    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5919ecf-ce96-443c-9600-7bc26a7b540b-home\") pod \"e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq\" (UID: \"b5919ecf-ce96-443c-9600-7bc26a7b540b\") " pod="llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq"
Aug 04 18:15:33.968759 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:33.968753    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5919ecf-ce96-443c-9600-7bc26a7b540b-model-cache\") pod \"e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq\" (UID: \"b5919ecf-ce96-443c-9600-7bc26a7b540b\") " pod="llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq"
Aug 04 18:15:33.968962 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:33.968859    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5919ecf-ce96-443c-9600-7bc26a7b540b-tmp-dir\") pod \"e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq\" (UID: \"b5919ecf-ce96-443c-9600-7bc26a7b540b\") " pod="llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq"
Aug 04 18:15:33.968962 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:33.968911    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5919ecf-ce96-443c-9600-7bc26a7b540b-tls-certs\") pod \"e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq\" (UID: \"b5919ecf-ce96-443c-9600-7bc26a7b540b\") " pod="llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq"
Aug 04 18:15:33.968962 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:33.968955    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfxtm\" (UniqueName: \"kubernetes.io/projected/b5919ecf-ce96-443c-9600-7bc26a7b540b-kube-api-access-tfxtm\") pod \"e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq\" (UID: \"b5919ecf-ce96-443c-9600-7bc26a7b540b\") " pod="llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq"
Aug 04 18:15:33.969113 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:33.969030    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5919ecf-ce96-443c-9600-7bc26a7b540b-home\") pod \"e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq\" (UID: \"b5919ecf-ce96-443c-9600-7bc26a7b540b\") " pod="llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq"
Aug 04 18:15:33.969182 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:33.969164    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5919ecf-ce96-443c-9600-7bc26a7b540b-tmp-dir\") pod \"e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq\" (UID: \"b5919ecf-ce96-443c-9600-7bc26a7b540b\") " pod="llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq"
Aug 04 18:15:33.969240 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:33.969217    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5919ecf-ce96-443c-9600-7bc26a7b540b-model-cache\") pod \"e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq\" (UID: \"b5919ecf-ce96-443c-9600-7bc26a7b540b\") " pod="llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq"
Aug 04 18:15:33.970932 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:33.970913    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5919ecf-ce96-443c-9600-7bc26a7b540b-dshm\") pod \"e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq\" (UID: \"b5919ecf-ce96-443c-9600-7bc26a7b540b\") " pod="llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq"
Aug 04 18:15:33.971385 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:33.971362    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5919ecf-ce96-443c-9600-7bc26a7b540b-tls-certs\") pod \"e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq\" (UID: \"b5919ecf-ce96-443c-9600-7bc26a7b540b\") " pod="llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq"
Aug 04 18:15:33.976469 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:33.976451    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfxtm\" (UniqueName: \"kubernetes.io/projected/b5919ecf-ce96-443c-9600-7bc26a7b540b-kube-api-access-tfxtm\") pod \"e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq\" (UID: \"b5919ecf-ce96-443c-9600-7bc26a7b540b\") " pod="llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq"
Aug 04 18:15:33.992478 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:33.992454    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq"
Aug 04 18:15:34.115435 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:34.115412    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq"]
Aug 04 18:15:34.117588 ip-10-0-141-220 kubenswrapper[2571]: W0804 18:15:34.117557    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb5919ecf_ce96_443c_9600_7bc26a7b540b.slice/crio-77de2cc80cb4f448ddbf65d39346285099db80e0f94ba4eee570669a2dbb5c94 WatchSource:0}: Error finding container 77de2cc80cb4f448ddbf65d39346285099db80e0f94ba4eee570669a2dbb5c94: Status 404 returned error can't find the container with id 77de2cc80cb4f448ddbf65d39346285099db80e0f94ba4eee570669a2dbb5c94
Aug 04 18:15:34.174655 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:34.174629    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq" event={"ID":"b5919ecf-ce96-443c-9600-7bc26a7b540b","Type":"ContainerStarted","Data":"77de2cc80cb4f448ddbf65d39346285099db80e0f94ba4eee570669a2dbb5c94"}
Aug 04 18:15:35.180013 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:35.179975    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq" event={"ID":"b5919ecf-ce96-443c-9600-7bc26a7b540b","Type":"ContainerStarted","Data":"aaae73ef6393ad7cf67e47f1e214de565d105cb18b0b3fe393c53a9690c61695"}
Aug 04 18:15:35.195904 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:35.195860    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq" podStartSLOduration=2.195843878 podStartE2EDuration="2.195843878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:15:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:15:35.193887832 +0000 UTC m=+1751.995024159" watchObservedRunningTime="2026-08-04 18:15:35.195843878 +0000 UTC m=+1751.996980245"
Aug 04 18:15:43.993494 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:43.993461    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq"
Aug 04 18:15:43.993889 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:43.993507    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq"
Aug 04 18:15:44.005309 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:44.005286    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq"
Aug 04 18:15:44.231923 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:15:44.231899    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq"
Aug 04 18:16:12.885288 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:12.885260    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j"]
Aug 04 18:16:13.988137 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:13.988109    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq"]
Aug 04 18:16:27.903272 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:27.903215    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j" podUID="cc5ffab9-78ca-4db6-b48c-799cd530f2dc" containerName="main" containerID="cri-o://846f1678755bd83b8529209334f98afc9433334d077095591a89324f7c7a75ac" gracePeriod=45
Aug 04 18:16:28.144750 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:28.144728    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j"
Aug 04 18:16:28.250051 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:28.249990    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc5ffab9-78ca-4db6-b48c-799cd530f2dc-model-cache\") pod \"cc5ffab9-78ca-4db6-b48c-799cd530f2dc\" (UID: \"cc5ffab9-78ca-4db6-b48c-799cd530f2dc\") "
Aug 04 18:16:28.250051 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:28.250048    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc5ffab9-78ca-4db6-b48c-799cd530f2dc-home\") pod \"cc5ffab9-78ca-4db6-b48c-799cd530f2dc\" (UID: \"cc5ffab9-78ca-4db6-b48c-799cd530f2dc\") "
Aug 04 18:16:28.250226 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:28.250078    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc5ffab9-78ca-4db6-b48c-799cd530f2dc-tls-certs\") pod \"cc5ffab9-78ca-4db6-b48c-799cd530f2dc\" (UID: \"cc5ffab9-78ca-4db6-b48c-799cd530f2dc\") "
Aug 04 18:16:28.250226 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:28.250110    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc5ffab9-78ca-4db6-b48c-799cd530f2dc-dshm\") pod \"cc5ffab9-78ca-4db6-b48c-799cd530f2dc\" (UID: \"cc5ffab9-78ca-4db6-b48c-799cd530f2dc\") "
Aug 04 18:16:28.250226 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:28.250145    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc5ffab9-78ca-4db6-b48c-799cd530f2dc-tmp-dir\") pod \"cc5ffab9-78ca-4db6-b48c-799cd530f2dc\" (UID: \"cc5ffab9-78ca-4db6-b48c-799cd530f2dc\") "
Aug 04 18:16:28.250226 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:28.250197    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5trss\" (UniqueName: \"kubernetes.io/projected/cc5ffab9-78ca-4db6-b48c-799cd530f2dc-kube-api-access-5trss\") pod \"cc5ffab9-78ca-4db6-b48c-799cd530f2dc\" (UID: \"cc5ffab9-78ca-4db6-b48c-799cd530f2dc\") "
Aug 04 18:16:28.250226 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:28.250210    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc5ffab9-78ca-4db6-b48c-799cd530f2dc-model-cache" (OuterVolumeSpecName: "model-cache") pod "cc5ffab9-78ca-4db6-b48c-799cd530f2dc" (UID: "cc5ffab9-78ca-4db6-b48c-799cd530f2dc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:16:28.250444 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:28.250337    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc5ffab9-78ca-4db6-b48c-799cd530f2dc-home" (OuterVolumeSpecName: "home") pod "cc5ffab9-78ca-4db6-b48c-799cd530f2dc" (UID: "cc5ffab9-78ca-4db6-b48c-799cd530f2dc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:16:28.250444 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:28.250419    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc5ffab9-78ca-4db6-b48c-799cd530f2dc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cc5ffab9-78ca-4db6-b48c-799cd530f2dc" (UID: "cc5ffab9-78ca-4db6-b48c-799cd530f2dc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:16:28.250518 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:28.250481    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc5ffab9-78ca-4db6-b48c-799cd530f2dc-model-cache\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:16:28.250518 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:28.250505    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc5ffab9-78ca-4db6-b48c-799cd530f2dc-home\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:16:28.252242 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:28.252217    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc5ffab9-78ca-4db6-b48c-799cd530f2dc-kube-api-access-5trss" (OuterVolumeSpecName: "kube-api-access-5trss") pod "cc5ffab9-78ca-4db6-b48c-799cd530f2dc" (UID: "cc5ffab9-78ca-4db6-b48c-799cd530f2dc"). InnerVolumeSpecName "kube-api-access-5trss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:16:28.252242 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:28.252231    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc5ffab9-78ca-4db6-b48c-799cd530f2dc-dshm" (OuterVolumeSpecName: "dshm") pod "cc5ffab9-78ca-4db6-b48c-799cd530f2dc" (UID: "cc5ffab9-78ca-4db6-b48c-799cd530f2dc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:16:28.252388 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:28.252252    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc5ffab9-78ca-4db6-b48c-799cd530f2dc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cc5ffab9-78ca-4db6-b48c-799cd530f2dc" (UID: "cc5ffab9-78ca-4db6-b48c-799cd530f2dc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:16:28.351598 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:28.351577    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc5ffab9-78ca-4db6-b48c-799cd530f2dc-dshm\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:16:28.351685 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:28.351613    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc5ffab9-78ca-4db6-b48c-799cd530f2dc-tmp-dir\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:16:28.351685 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:28.351625    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5trss\" (UniqueName: \"kubernetes.io/projected/cc5ffab9-78ca-4db6-b48c-799cd530f2dc-kube-api-access-5trss\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:16:28.351685 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:28.351634    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc5ffab9-78ca-4db6-b48c-799cd530f2dc-tls-certs\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:16:28.399792 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:28.399759    2571 generic.go:356] "Generic (PLEG): container finished" podID="cc5ffab9-78ca-4db6-b48c-799cd530f2dc" containerID="846f1678755bd83b8529209334f98afc9433334d077095591a89324f7c7a75ac" exitCode=0
Aug 04 18:16:28.399884 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:28.399801    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j"
Aug 04 18:16:28.399884 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:28.399847    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j" event={"ID":"cc5ffab9-78ca-4db6-b48c-799cd530f2dc","Type":"ContainerDied","Data":"846f1678755bd83b8529209334f98afc9433334d077095591a89324f7c7a75ac"}
Aug 04 18:16:28.399966 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:28.399889    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j" event={"ID":"cc5ffab9-78ca-4db6-b48c-799cd530f2dc","Type":"ContainerDied","Data":"fd96cc46db2b42e2f60081f13abed23d4a927f12ff6f1d975ce6a232251f5a5c"}
Aug 04 18:16:28.399966 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:28.399910    2571 scope.go:117] "RemoveContainer" containerID="846f1678755bd83b8529209334f98afc9433334d077095591a89324f7c7a75ac"
Aug 04 18:16:28.407691 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:28.407675    2571 scope.go:117] "RemoveContainer" containerID="846f1678755bd83b8529209334f98afc9433334d077095591a89324f7c7a75ac"
Aug 04 18:16:28.407946 ip-10-0-141-220 kubenswrapper[2571]: E0804 18:16:28.407927    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"846f1678755bd83b8529209334f98afc9433334d077095591a89324f7c7a75ac\": container with ID starting with 846f1678755bd83b8529209334f98afc9433334d077095591a89324f7c7a75ac not found: ID does not exist" containerID="846f1678755bd83b8529209334f98afc9433334d077095591a89324f7c7a75ac"
Aug 04 18:16:28.408008 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:28.407954    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"846f1678755bd83b8529209334f98afc9433334d077095591a89324f7c7a75ac"} err="failed to get container status \"846f1678755bd83b8529209334f98afc9433334d077095591a89324f7c7a75ac\": rpc error: code = NotFound desc = could not find container \"846f1678755bd83b8529209334f98afc9433334d077095591a89324f7c7a75ac\": container with ID starting with 846f1678755bd83b8529209334f98afc9433334d077095591a89324f7c7a75ac not found: ID does not exist"
Aug 04 18:16:28.419568 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:28.419535    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j"]
Aug 04 18:16:28.424993 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:28.424975    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-8c44b95f-kserve-7b7944d767-w6k2j"]
Aug 04 18:16:29.006683 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:29.006654    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq" podUID="b5919ecf-ce96-443c-9600-7bc26a7b540b" containerName="main" containerID="cri-o://aaae73ef6393ad7cf67e47f1e214de565d105cb18b0b3fe393c53a9690c61695" gracePeriod=45
Aug 04 18:16:29.247758 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:29.247731    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq"
Aug 04 18:16:29.358428 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:29.358394    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5919ecf-ce96-443c-9600-7bc26a7b540b-dshm\") pod \"b5919ecf-ce96-443c-9600-7bc26a7b540b\" (UID: \"b5919ecf-ce96-443c-9600-7bc26a7b540b\") "
Aug 04 18:16:29.358572 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:29.358457    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5919ecf-ce96-443c-9600-7bc26a7b540b-tls-certs\") pod \"b5919ecf-ce96-443c-9600-7bc26a7b540b\" (UID: \"b5919ecf-ce96-443c-9600-7bc26a7b540b\") "
Aug 04 18:16:29.358572 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:29.358483    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfxtm\" (UniqueName: \"kubernetes.io/projected/b5919ecf-ce96-443c-9600-7bc26a7b540b-kube-api-access-tfxtm\") pod \"b5919ecf-ce96-443c-9600-7bc26a7b540b\" (UID: \"b5919ecf-ce96-443c-9600-7bc26a7b540b\") "
Aug 04 18:16:29.358668 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:29.358578    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5919ecf-ce96-443c-9600-7bc26a7b540b-home\") pod \"b5919ecf-ce96-443c-9600-7bc26a7b540b\" (UID: \"b5919ecf-ce96-443c-9600-7bc26a7b540b\") "
Aug 04 18:16:29.358668 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:29.358641    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5919ecf-ce96-443c-9600-7bc26a7b540b-model-cache\") pod \"b5919ecf-ce96-443c-9600-7bc26a7b540b\" (UID: \"b5919ecf-ce96-443c-9600-7bc26a7b540b\") "
Aug 04 18:16:29.358668 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:29.358664    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5919ecf-ce96-443c-9600-7bc26a7b540b-tmp-dir\") pod \"b5919ecf-ce96-443c-9600-7bc26a7b540b\" (UID: \"b5919ecf-ce96-443c-9600-7bc26a7b540b\") "
Aug 04 18:16:29.358909 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:29.358847    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5919ecf-ce96-443c-9600-7bc26a7b540b-home" (OuterVolumeSpecName: "home") pod "b5919ecf-ce96-443c-9600-7bc26a7b540b" (UID: "b5919ecf-ce96-443c-9600-7bc26a7b540b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:16:29.359009 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:29.358914    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5919ecf-ce96-443c-9600-7bc26a7b540b-model-cache" (OuterVolumeSpecName: "model-cache") pod "b5919ecf-ce96-443c-9600-7bc26a7b540b" (UID: "b5919ecf-ce96-443c-9600-7bc26a7b540b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:16:29.359009 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:29.358969    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5919ecf-ce96-443c-9600-7bc26a7b540b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b5919ecf-ce96-443c-9600-7bc26a7b540b" (UID: "b5919ecf-ce96-443c-9600-7bc26a7b540b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:16:29.360454 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:29.360435    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5919ecf-ce96-443c-9600-7bc26a7b540b-kube-api-access-tfxtm" (OuterVolumeSpecName: "kube-api-access-tfxtm") pod "b5919ecf-ce96-443c-9600-7bc26a7b540b" (UID: "b5919ecf-ce96-443c-9600-7bc26a7b540b"). InnerVolumeSpecName "kube-api-access-tfxtm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:16:29.360904 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:29.360879    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5919ecf-ce96-443c-9600-7bc26a7b540b-dshm" (OuterVolumeSpecName: "dshm") pod "b5919ecf-ce96-443c-9600-7bc26a7b540b" (UID: "b5919ecf-ce96-443c-9600-7bc26a7b540b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:16:29.360904 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:29.360890    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5919ecf-ce96-443c-9600-7bc26a7b540b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b5919ecf-ce96-443c-9600-7bc26a7b540b" (UID: "b5919ecf-ce96-443c-9600-7bc26a7b540b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:16:29.405852 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:29.405830    2571 generic.go:356] "Generic (PLEG): container finished" podID="b5919ecf-ce96-443c-9600-7bc26a7b540b" containerID="aaae73ef6393ad7cf67e47f1e214de565d105cb18b0b3fe393c53a9690c61695" exitCode=0
Aug 04 18:16:29.405923 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:29.405873    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq"
Aug 04 18:16:29.405923 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:29.405884    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq" event={"ID":"b5919ecf-ce96-443c-9600-7bc26a7b540b","Type":"ContainerDied","Data":"aaae73ef6393ad7cf67e47f1e214de565d105cb18b0b3fe393c53a9690c61695"}
Aug 04 18:16:29.405923 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:29.405912    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq" event={"ID":"b5919ecf-ce96-443c-9600-7bc26a7b540b","Type":"ContainerDied","Data":"77de2cc80cb4f448ddbf65d39346285099db80e0f94ba4eee570669a2dbb5c94"}
Aug 04 18:16:29.406043 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:29.405928    2571 scope.go:117] "RemoveContainer" containerID="aaae73ef6393ad7cf67e47f1e214de565d105cb18b0b3fe393c53a9690c61695"
Aug 04 18:16:29.413849 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:29.413811    2571 scope.go:117] "RemoveContainer" containerID="aaae73ef6393ad7cf67e47f1e214de565d105cb18b0b3fe393c53a9690c61695"
Aug 04 18:16:29.414160 ip-10-0-141-220 kubenswrapper[2571]: E0804 18:16:29.414137    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aaae73ef6393ad7cf67e47f1e214de565d105cb18b0b3fe393c53a9690c61695\": container with ID starting with aaae73ef6393ad7cf67e47f1e214de565d105cb18b0b3fe393c53a9690c61695 not found: ID does not exist" containerID="aaae73ef6393ad7cf67e47f1e214de565d105cb18b0b3fe393c53a9690c61695"
Aug 04 18:16:29.414217 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:29.414171    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aaae73ef6393ad7cf67e47f1e214de565d105cb18b0b3fe393c53a9690c61695"} err="failed to get container status \"aaae73ef6393ad7cf67e47f1e214de565d105cb18b0b3fe393c53a9690c61695\": rpc error: code = NotFound desc = could not find container \"aaae73ef6393ad7cf67e47f1e214de565d105cb18b0b3fe393c53a9690c61695\": container with ID starting with aaae73ef6393ad7cf67e47f1e214de565d105cb18b0b3fe393c53a9690c61695 not found: ID does not exist"
Aug 04 18:16:29.426124 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:29.426104    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq"]
Aug 04 18:16:29.428450 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:29.428433    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-8c44b95f-kserve-75fc64fb9f-b6lbq"]
Aug 04 18:16:29.459614 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:29.459584    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5919ecf-ce96-443c-9600-7bc26a7b540b-tls-certs\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:16:29.459614 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:29.459612    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfxtm\" (UniqueName: \"kubernetes.io/projected/b5919ecf-ce96-443c-9600-7bc26a7b540b-kube-api-access-tfxtm\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:16:29.459614 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:29.459622    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5919ecf-ce96-443c-9600-7bc26a7b540b-home\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:16:29.459760 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:29.459631    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5919ecf-ce96-443c-9600-7bc26a7b540b-model-cache\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:16:29.459760 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:29.459641    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5919ecf-ce96-443c-9600-7bc26a7b540b-tmp-dir\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:16:29.459760 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:29.459649    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5919ecf-ce96-443c-9600-7bc26a7b540b-dshm\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:16:29.879560 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:29.879539    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5919ecf-ce96-443c-9600-7bc26a7b540b" path="/var/lib/kubelet/pods/b5919ecf-ce96-443c-9600-7bc26a7b540b/volumes"
Aug 04 18:16:29.879896 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:16:29.879883    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc5ffab9-78ca-4db6-b48c-799cd530f2dc" path="/var/lib/kubelet/pods/cc5ffab9-78ca-4db6-b48c-799cd530f2dc/volumes"
Aug 04 18:20:12.929113 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:12.929078    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"]
Aug 04 18:20:12.929594 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:12.929375    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5919ecf-ce96-443c-9600-7bc26a7b540b" containerName="main"
Aug 04 18:20:12.929594 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:12.929387    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5919ecf-ce96-443c-9600-7bc26a7b540b" containerName="main"
Aug 04 18:20:12.929594 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:12.929399    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc5ffab9-78ca-4db6-b48c-799cd530f2dc" containerName="main"
Aug 04 18:20:12.929594 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:12.929404    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc5ffab9-78ca-4db6-b48c-799cd530f2dc" containerName="main"
Aug 04 18:20:12.929594 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:12.929450    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5919ecf-ce96-443c-9600-7bc26a7b540b" containerName="main"
Aug 04 18:20:12.929594 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:12.929456    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc5ffab9-78ca-4db6-b48c-799cd530f2dc" containerName="main"
Aug 04 18:20:12.932273 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:12.932257    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:12.934489 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:12.934468    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a208c700-openshift-default-dockercfg-zvf8w\""
Aug 04 18:20:12.949573 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:12.949550    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"]
Aug 04 18:20:13.062396 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:13.062368    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-istio-token\") pod \"e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s\" (UID: \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\") " pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:13.062591 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:13.062406    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw68n\" (UniqueName: \"kubernetes.io/projected/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-kube-api-access-dw68n\") pod \"e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s\" (UID: \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\") " pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:13.062591 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:13.062440    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-credential-socket\") pod \"e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s\" (UID: \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\") " pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:13.062591 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:13.062510    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-istio-envoy\") pod \"e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s\" (UID: \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\") " pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:13.062591 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:13.062558    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-istiod-ca-cert\") pod \"e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s\" (UID: \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\") " pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:13.062591 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:13.062584    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-istio-data\") pod \"e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s\" (UID: \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\") " pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:13.062764 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:13.062599    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-workload-socket\") pod \"e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s\" (UID: \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\") " pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:13.062764 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:13.062616    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-istio-podinfo\") pod \"e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s\" (UID: \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\") " pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:13.062764 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:13.062658    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-workload-certs\") pod \"e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s\" (UID: \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\") " pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:13.163884 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:13.163864    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-istio-envoy\") pod \"e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s\" (UID: \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\") " pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:13.164010 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:13.163892    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-istiod-ca-cert\") pod \"e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s\" (UID: \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\") " pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:13.164010 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:13.163913    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-istio-data\") pod \"e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s\" (UID: \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\") " pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:13.164010 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:13.163929    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-workload-socket\") pod \"e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s\" (UID: \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\") " pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:13.164010 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:13.163946    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-istio-podinfo\") pod \"e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s\" (UID: \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\") " pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:13.164010 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:13.163979    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-workload-certs\") pod \"e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s\" (UID: \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\") " pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:13.164247 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:13.164011    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-istio-token\") pod \"e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s\" (UID: \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\") " pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:13.164247 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:13.164043    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw68n\" (UniqueName: \"kubernetes.io/projected/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-kube-api-access-dw68n\") pod \"e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s\" (UID: \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\") " pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:13.164247 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:13.164083    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-credential-socket\") pod \"e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s\" (UID: \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\") " pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:13.164615 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:13.164591    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-workload-socket\") pod \"e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s\" (UID: \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\") " pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:13.164711 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:13.164620    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-workload-certs\") pod \"e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s\" (UID: \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\") " pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:13.164774 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:13.164753    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-istiod-ca-cert\") pod \"e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s\" (UID: \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\") " pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:13.164774 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:13.164759    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-credential-socket\") pod \"e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s\" (UID: \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\") " pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:13.164888 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:13.164863    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-istio-data\") pod \"e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s\" (UID: \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\") " pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:13.166349 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:13.166332    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-istio-envoy\") pod \"e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s\" (UID: \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\") " pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:13.166611 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:13.166593    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-istio-podinfo\") pod \"e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s\" (UID: \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\") " pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:13.172185 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:13.172162    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-istio-token\") pod \"e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s\" (UID: \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\") " pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:13.172459 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:13.172440    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw68n\" (UniqueName: \"kubernetes.io/projected/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-kube-api-access-dw68n\") pod \"e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s\" (UID: \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\") " pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:13.241704 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:13.241647    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:13.370319 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:13.370296    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"]
Aug 04 18:20:13.372453 ip-10-0-141-220 kubenswrapper[2571]: W0804 18:20:13.372419    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcbe36f3_29ee_4223_9e85_c4dd8e72b5ce.slice/crio-810ea3463c6f49e7e024616237f28370c1383e0988169746093da8f5ee50e11c WatchSource:0}: Error finding container 810ea3463c6f49e7e024616237f28370c1383e0988169746093da8f5ee50e11c: Status 404 returned error can't find the container with id 810ea3463c6f49e7e024616237f28370c1383e0988169746093da8f5ee50e11c
Aug 04 18:20:13.374998 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:13.374955    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:20:13.375093 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:13.375028    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:20:13.375093 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:13.375076    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:20:14.314477 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:14.314444    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s" event={"ID":"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce","Type":"ContainerStarted","Data":"74f8213bfb769b1f91aba993db44009f086f72bc31271c45d069279959731556"}
Aug 04 18:20:14.314947 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:14.314502    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s" event={"ID":"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce","Type":"ContainerStarted","Data":"810ea3463c6f49e7e024616237f28370c1383e0988169746093da8f5ee50e11c"}
Aug 04 18:20:14.333423 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:14.333378    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s" podStartSLOduration=2.333361899 podStartE2EDuration="2.333361899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:20:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:20:14.332190046 +0000 UTC m=+2031.133326373" watchObservedRunningTime="2026-08-04 18:20:14.333361899 +0000 UTC m=+2031.134498226"
Aug 04 18:20:15.242729 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:15.242697    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:15.247140 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:15.247116    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:15.318947 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:15.318912    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:15.319691 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:15.319675    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:30.320830 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:30.320799    2571 patch_prober.go:28] interesting pod/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body=
Aug 04 18:20:30.321245 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:30.320867    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s" podUID="fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused"
Aug 04 18:20:30.384540 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:30.384493    2571 generic.go:356] "Generic (PLEG): container finished" podID="fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce" containerID="74f8213bfb769b1f91aba993db44009f086f72bc31271c45d069279959731556" exitCode=0
Aug 04 18:20:30.384646 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:30.384562    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s" event={"ID":"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce","Type":"ContainerDied","Data":"74f8213bfb769b1f91aba993db44009f086f72bc31271c45d069279959731556"}
Aug 04 18:20:30.384895 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:30.384877    2571 scope.go:117] "RemoveContainer" containerID="74f8213bfb769b1f91aba993db44009f086f72bc31271c45d069279959731556"
Aug 04 18:20:30.385812 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:30.385781    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:20:30.385900 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:30.385847    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:20:30.385900 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:30.385876    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:20:31.391502 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:31.391460    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s" event={"ID":"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce","Type":"ContainerStarted","Data":"5d29e71f1ee4488489d0e4323faa8e2db041cbe819430b32c7868ba274a7bac2"}
Aug 04 18:20:32.243017 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:32.242567    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:32.243017 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:32.242688    2571 patch_prober.go:28] interesting pod/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body=
Aug 04 18:20:32.243017 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:32.242740    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s" podUID="fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused"
Aug 04 18:20:33.242077 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:33.242037    2571 patch_prober.go:28] interesting pod/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body=
Aug 04 18:20:33.242669 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:33.242636    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s" podUID="fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused"
Aug 04 18:20:34.242299 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:34.242256    2571 patch_prober.go:28] interesting pod/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body=
Aug 04 18:20:34.242802 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:34.242322    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s" podUID="fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused"
Aug 04 18:20:35.242611 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:35.242573    2571 patch_prober.go:28] interesting pod/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body=
Aug 04 18:20:35.243092 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:35.242652    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s" podUID="fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused"
Aug 04 18:20:36.246747 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:36.246714    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:36.247239 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:36.247195    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:36.247998 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:36.247979    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:47.601884 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:47.601810    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"]
Aug 04 18:20:47.602384 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:47.602032    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s" podUID="fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce" containerName="istio-proxy" containerID="cri-o://5d29e71f1ee4488489d0e4323faa8e2db041cbe819430b32c7868ba274a7bac2" gracePeriod=30
Aug 04 18:20:48.520068 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:48.520025    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"]
Aug 04 18:20:48.523184 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:48.523163    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:20:48.525198 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:48.525179    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-06d91391-gw-openshift-default-dockercfg-ml86h\""
Aug 04 18:20:48.535516 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:48.535497    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"]
Aug 04 18:20:48.630428 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:48.630398    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e9b7fcc-3751-4e11-9e3e-593327681027-istio-envoy\") pod \"e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk\" (UID: \"0e9b7fcc-3751-4e11-9e3e-593327681027\") " pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:20:48.630791 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:48.630433    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e9b7fcc-3751-4e11-9e3e-593327681027-istio-token\") pod \"e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk\" (UID: \"0e9b7fcc-3751-4e11-9e3e-593327681027\") " pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:20:48.630791 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:48.630455    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e9b7fcc-3751-4e11-9e3e-593327681027-workload-certs\") pod \"e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk\" (UID: \"0e9b7fcc-3751-4e11-9e3e-593327681027\") " pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:20:48.630791 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:48.630559    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e9b7fcc-3751-4e11-9e3e-593327681027-workload-socket\") pod \"e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk\" (UID: \"0e9b7fcc-3751-4e11-9e3e-593327681027\") " pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:20:48.630791 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:48.630605    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e9b7fcc-3751-4e11-9e3e-593327681027-istio-data\") pod \"e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk\" (UID: \"0e9b7fcc-3751-4e11-9e3e-593327681027\") " pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:20:48.630791 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:48.630659    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e9b7fcc-3751-4e11-9e3e-593327681027-istio-podinfo\") pod \"e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk\" (UID: \"0e9b7fcc-3751-4e11-9e3e-593327681027\") " pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:20:48.630791 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:48.630682    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e9b7fcc-3751-4e11-9e3e-593327681027-istiod-ca-cert\") pod \"e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk\" (UID: \"0e9b7fcc-3751-4e11-9e3e-593327681027\") " pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:20:48.630791 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:48.630717    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r55j\" (UniqueName: \"kubernetes.io/projected/0e9b7fcc-3751-4e11-9e3e-593327681027-kube-api-access-2r55j\") pod \"e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk\" (UID: \"0e9b7fcc-3751-4e11-9e3e-593327681027\") " pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:20:48.630791 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:48.630750    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e9b7fcc-3751-4e11-9e3e-593327681027-credential-socket\") pod \"e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk\" (UID: \"0e9b7fcc-3751-4e11-9e3e-593327681027\") " pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:20:48.731358 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:48.731332    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e9b7fcc-3751-4e11-9e3e-593327681027-workload-certs\") pod \"e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk\" (UID: \"0e9b7fcc-3751-4e11-9e3e-593327681027\") " pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:20:48.731496 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:48.731371    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e9b7fcc-3751-4e11-9e3e-593327681027-workload-socket\") pod \"e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk\" (UID: \"0e9b7fcc-3751-4e11-9e3e-593327681027\") " pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:20:48.731496 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:48.731394    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e9b7fcc-3751-4e11-9e3e-593327681027-istio-data\") pod \"e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk\" (UID: \"0e9b7fcc-3751-4e11-9e3e-593327681027\") " pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:20:48.731496 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:48.731423    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e9b7fcc-3751-4e11-9e3e-593327681027-istio-podinfo\") pod \"e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk\" (UID: \"0e9b7fcc-3751-4e11-9e3e-593327681027\") " pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:20:48.731496 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:48.731454    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e9b7fcc-3751-4e11-9e3e-593327681027-istiod-ca-cert\") pod \"e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk\" (UID: \"0e9b7fcc-3751-4e11-9e3e-593327681027\") " pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:20:48.731496 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:48.731480    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r55j\" (UniqueName: \"kubernetes.io/projected/0e9b7fcc-3751-4e11-9e3e-593327681027-kube-api-access-2r55j\") pod \"e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk\" (UID: \"0e9b7fcc-3751-4e11-9e3e-593327681027\") " pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:20:48.731769 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:48.731504    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e9b7fcc-3751-4e11-9e3e-593327681027-credential-socket\") pod \"e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk\" (UID: \"0e9b7fcc-3751-4e11-9e3e-593327681027\") " pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:20:48.731769 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:48.731572    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e9b7fcc-3751-4e11-9e3e-593327681027-istio-envoy\") pod \"e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk\" (UID: \"0e9b7fcc-3751-4e11-9e3e-593327681027\") " pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:20:48.731769 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:48.731601    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e9b7fcc-3751-4e11-9e3e-593327681027-istio-token\") pod \"e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk\" (UID: \"0e9b7fcc-3751-4e11-9e3e-593327681027\") " pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:20:48.731925 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:48.731783    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e9b7fcc-3751-4e11-9e3e-593327681027-workload-certs\") pod \"e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk\" (UID: \"0e9b7fcc-3751-4e11-9e3e-593327681027\") " pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:20:48.731925 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:48.731855    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e9b7fcc-3751-4e11-9e3e-593327681027-workload-socket\") pod \"e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk\" (UID: \"0e9b7fcc-3751-4e11-9e3e-593327681027\") " pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:20:48.732027 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:48.732013    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e9b7fcc-3751-4e11-9e3e-593327681027-istio-data\") pod \"e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk\" (UID: \"0e9b7fcc-3751-4e11-9e3e-593327681027\") " pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:20:48.732160 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:48.732139    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e9b7fcc-3751-4e11-9e3e-593327681027-credential-socket\") pod \"e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk\" (UID: \"0e9b7fcc-3751-4e11-9e3e-593327681027\") " pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:20:48.732223 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:48.732144    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e9b7fcc-3751-4e11-9e3e-593327681027-istiod-ca-cert\") pod \"e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk\" (UID: \"0e9b7fcc-3751-4e11-9e3e-593327681027\") " pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:20:48.733933 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:48.733912    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e9b7fcc-3751-4e11-9e3e-593327681027-istio-envoy\") pod \"e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk\" (UID: \"0e9b7fcc-3751-4e11-9e3e-593327681027\") " pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:20:48.734046 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:48.733950    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e9b7fcc-3751-4e11-9e3e-593327681027-istio-podinfo\") pod \"e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk\" (UID: \"0e9b7fcc-3751-4e11-9e3e-593327681027\") " pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:20:48.739275 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:48.739245    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e9b7fcc-3751-4e11-9e3e-593327681027-istio-token\") pod \"e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk\" (UID: \"0e9b7fcc-3751-4e11-9e3e-593327681027\") " pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:20:48.739938 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:48.739918    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r55j\" (UniqueName: \"kubernetes.io/projected/0e9b7fcc-3751-4e11-9e3e-593327681027-kube-api-access-2r55j\") pod \"e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk\" (UID: \"0e9b7fcc-3751-4e11-9e3e-593327681027\") " pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:20:48.832559 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:48.832510    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:20:48.969470 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:48.969437    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"]
Aug 04 18:20:48.972855 ip-10-0-141-220 kubenswrapper[2571]: W0804 18:20:48.972827    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e9b7fcc_3751_4e11_9e3e_593327681027.slice/crio-e9de4807ab8b5d3d2df1f64521f8d7071065bd40c3422c8a94830baf8fee3b51 WatchSource:0}: Error finding container e9de4807ab8b5d3d2df1f64521f8d7071065bd40c3422c8a94830baf8fee3b51: Status 404 returned error can't find the container with id e9de4807ab8b5d3d2df1f64521f8d7071065bd40c3422c8a94830baf8fee3b51
Aug 04 18:20:48.975368 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:48.975334    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:20:48.975465 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:48.975412    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:20:48.975465 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:48.975458    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:20:49.465376 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:49.465337    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk" event={"ID":"0e9b7fcc-3751-4e11-9e3e-593327681027","Type":"ContainerStarted","Data":"86df1d5c433924920eaef83580aaeee8170c2d8180d24372ec2f344244f352cc"}
Aug 04 18:20:49.465556 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:49.465433    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk" event={"ID":"0e9b7fcc-3751-4e11-9e3e-593327681027","Type":"ContainerStarted","Data":"e9de4807ab8b5d3d2df1f64521f8d7071065bd40c3422c8a94830baf8fee3b51"}
Aug 04 18:20:49.483575 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:49.483515    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk" podStartSLOduration=1.483501436 podStartE2EDuration="1.483501436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:20:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:20:49.482331369 +0000 UTC m=+2066.283467695" watchObservedRunningTime="2026-08-04 18:20:49.483501436 +0000 UTC m=+2066.284637763"
Aug 04 18:20:49.833437 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:49.833411    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:20:50.837354 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:50.837322    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:20:51.249864 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:51.249788    2571 patch_prober.go:28] interesting pod/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 18:20:51.249864 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:51.249846    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s" podUID="fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:20:51.473793 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:51.473763    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:20:51.474674 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:51.474655    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:20:52.846964 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:52.846943    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:52.965309 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:52.965250    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-istio-token\") pod \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\" (UID: \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\") "
Aug 04 18:20:52.965309 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:52.965280    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-istio-envoy\") pod \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\" (UID: \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\") "
Aug 04 18:20:52.965309 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:52.965301    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-credential-socket\") pod \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\" (UID: \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\") "
Aug 04 18:20:52.965513 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:52.965341    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-workload-socket\") pod \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\" (UID: \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\") "
Aug 04 18:20:52.965513 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:52.965366    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-workload-certs\") pod \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\" (UID: \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\") "
Aug 04 18:20:52.965513 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:52.965396    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dw68n\" (UniqueName: \"kubernetes.io/projected/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-kube-api-access-dw68n\") pod \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\" (UID: \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\") "
Aug 04 18:20:52.965513 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:52.965434    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-istio-podinfo\") pod \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\" (UID: \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\") "
Aug 04 18:20:52.965513 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:52.965466    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-istio-data\") pod \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\" (UID: \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\") "
Aug 04 18:20:52.965794 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:52.965548    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-istiod-ca-cert\") pod \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\" (UID: \"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce\") "
Aug 04 18:20:52.965794 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:52.965614    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce" (UID: "fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:20:52.965794 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:52.965628    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce" (UID: "fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:20:52.965794 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:52.965728    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce" (UID: "fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:20:52.966006 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:52.965857    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-istio-data" (OuterVolumeSpecName: "istio-data") pod "fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce" (UID: "fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:20:52.966006 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:52.965867    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-workload-socket\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:20:52.966006 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:52.965887    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-workload-certs\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:20:52.966006 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:52.965900    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-credential-socket\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:20:52.966006 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:52.965946    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce" (UID: "fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:20:52.967613 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:52.967557    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce" (UID: "fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:20:52.967703 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:52.967655    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-kube-api-access-dw68n" (OuterVolumeSpecName: "kube-api-access-dw68n") pod "fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce" (UID: "fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce"). InnerVolumeSpecName "kube-api-access-dw68n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:20:52.967797 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:52.967780    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-istio-token" (OuterVolumeSpecName: "istio-token") pod "fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce" (UID: "fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:20:52.967856 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:52.967833    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce" (UID: "fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 18:20:53.066475 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:53.066454    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-istio-token\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:20:53.066475 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:53.066473    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-istio-envoy\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:20:53.066627 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:53.066482    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dw68n\" (UniqueName: \"kubernetes.io/projected/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-kube-api-access-dw68n\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:20:53.066627 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:53.066491    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-istio-podinfo\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:20:53.066627 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:53.066499    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-istio-data\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:20:53.066627 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:53.066506    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce-istiod-ca-cert\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:20:53.484551 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:53.484507    2571 generic.go:356] "Generic (PLEG): container finished" podID="fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce" containerID="5d29e71f1ee4488489d0e4323faa8e2db041cbe819430b32c7868ba274a7bac2" exitCode=0
Aug 04 18:20:53.484697 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:53.484560    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s" event={"ID":"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce","Type":"ContainerDied","Data":"5d29e71f1ee4488489d0e4323faa8e2db041cbe819430b32c7868ba274a7bac2"}
Aug 04 18:20:53.484697 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:53.484610    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"
Aug 04 18:20:53.484697 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:53.484624    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s" event={"ID":"fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce","Type":"ContainerDied","Data":"810ea3463c6f49e7e024616237f28370c1383e0988169746093da8f5ee50e11c"}
Aug 04 18:20:53.484697 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:53.484650    2571 scope.go:117] "RemoveContainer" containerID="5d29e71f1ee4488489d0e4323faa8e2db041cbe819430b32c7868ba274a7bac2"
Aug 04 18:20:53.493775 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:53.493757    2571 scope.go:117] "RemoveContainer" containerID="74f8213bfb769b1f91aba993db44009f086f72bc31271c45d069279959731556"
Aug 04 18:20:53.500971 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:53.500955    2571 scope.go:117] "RemoveContainer" containerID="5d29e71f1ee4488489d0e4323faa8e2db041cbe819430b32c7868ba274a7bac2"
Aug 04 18:20:53.501210 ip-10-0-141-220 kubenswrapper[2571]: E0804 18:20:53.501191    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d29e71f1ee4488489d0e4323faa8e2db041cbe819430b32c7868ba274a7bac2\": container with ID starting with 5d29e71f1ee4488489d0e4323faa8e2db041cbe819430b32c7868ba274a7bac2 not found: ID does not exist" containerID="5d29e71f1ee4488489d0e4323faa8e2db041cbe819430b32c7868ba274a7bac2"
Aug 04 18:20:53.501262 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:53.501218    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d29e71f1ee4488489d0e4323faa8e2db041cbe819430b32c7868ba274a7bac2"} err="failed to get container status \"5d29e71f1ee4488489d0e4323faa8e2db041cbe819430b32c7868ba274a7bac2\": rpc error: code = NotFound desc = could not find container \"5d29e71f1ee4488489d0e4323faa8e2db041cbe819430b32c7868ba274a7bac2\": container with ID starting with 5d29e71f1ee4488489d0e4323faa8e2db041cbe819430b32c7868ba274a7bac2 not found: ID does not exist"
Aug 04 18:20:53.501262 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:53.501236    2571 scope.go:117] "RemoveContainer" containerID="74f8213bfb769b1f91aba993db44009f086f72bc31271c45d069279959731556"
Aug 04 18:20:53.501469 ip-10-0-141-220 kubenswrapper[2571]: E0804 18:20:53.501452    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74f8213bfb769b1f91aba993db44009f086f72bc31271c45d069279959731556\": container with ID starting with 74f8213bfb769b1f91aba993db44009f086f72bc31271c45d069279959731556 not found: ID does not exist" containerID="74f8213bfb769b1f91aba993db44009f086f72bc31271c45d069279959731556"
Aug 04 18:20:53.501512 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:53.501476    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74f8213bfb769b1f91aba993db44009f086f72bc31271c45d069279959731556"} err="failed to get container status \"74f8213bfb769b1f91aba993db44009f086f72bc31271c45d069279959731556\": rpc error: code = NotFound desc = could not find container \"74f8213bfb769b1f91aba993db44009f086f72bc31271c45d069279959731556\": container with ID starting with 74f8213bfb769b1f91aba993db44009f086f72bc31271c45d069279959731556 not found: ID does not exist"
Aug 04 18:20:53.505860 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:53.505839    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"]
Aug 04 18:20:53.509670 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:53.509643    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a208c700-openshift-default-68b9dd9bfd-5zw7s"]
Aug 04 18:20:53.878693 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:20:53.878673    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce" path="/var/lib/kubelet/pods/fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce/volumes"
Aug 04 18:21:03.533078 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:03.533049    2571 generic.go:356] "Generic (PLEG): container finished" podID="0e9b7fcc-3751-4e11-9e3e-593327681027" containerID="86df1d5c433924920eaef83580aaeee8170c2d8180d24372ec2f344244f352cc" exitCode=0
Aug 04 18:21:03.533384 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:03.533125    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk" event={"ID":"0e9b7fcc-3751-4e11-9e3e-593327681027","Type":"ContainerDied","Data":"86df1d5c433924920eaef83580aaeee8170c2d8180d24372ec2f344244f352cc"}
Aug 04 18:21:03.533488 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:03.533474    2571 scope.go:117] "RemoveContainer" containerID="86df1d5c433924920eaef83580aaeee8170c2d8180d24372ec2f344244f352cc"
Aug 04 18:21:03.534472 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:03.534443    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:21:03.534566 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:03.534547    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:21:03.534609 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:03.534600    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:21:04.542039 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:04.541994    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk" event={"ID":"0e9b7fcc-3751-4e11-9e3e-593327681027","Type":"ContainerStarted","Data":"25f9e3564d5cbfbe76b29fdb79bf7691e99c8a817eb8a723cad19482af62ff5c"}
Aug 04 18:21:04.834424 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:04.834336    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:21:04.834799 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:04.834778    2571 patch_prober.go:28] interesting pod/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Aug 04 18:21:04.834959 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:04.834937    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk" podUID="0e9b7fcc-3751-4e11-9e3e-593327681027" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Aug 04 18:21:05.832884 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:05.832850    2571 patch_prober.go:28] interesting pod/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Aug 04 18:21:05.833459 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:05.833431    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk" podUID="0e9b7fcc-3751-4e11-9e3e-593327681027" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Aug 04 18:21:06.474561 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:06.474512    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:21:06.833803 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:06.833766    2571 patch_prober.go:28] interesting pod/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Aug 04 18:21:06.834288 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:06.833868    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk" podUID="0e9b7fcc-3751-4e11-9e3e-593327681027" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Aug 04 18:21:07.833294 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:07.833259    2571 patch_prober.go:28] interesting pod/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Aug 04 18:21:07.833588 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:07.833557    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk" podUID="0e9b7fcc-3751-4e11-9e3e-593327681027" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Aug 04 18:21:08.833456 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:08.833415    2571 patch_prober.go:28] interesting pod/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Aug 04 18:21:08.833965 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:08.833475    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk" podUID="0e9b7fcc-3751-4e11-9e3e-593327681027" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Aug 04 18:21:09.837143 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:09.837113    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:21:09.837954 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:09.837938    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:21:21.978183 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:21.978149    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"]
Aug 04 18:21:21.978741 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:21.978432    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk" podUID="0e9b7fcc-3751-4e11-9e3e-593327681027" containerName="istio-proxy" containerID="cri-o://25f9e3564d5cbfbe76b29fdb79bf7691e99c8a817eb8a723cad19482af62ff5c" gracePeriod=30
Aug 04 18:21:22.697733 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:22.697690    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"]
Aug 04 18:21:22.697979 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:22.697967    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce" containerName="istio-proxy"
Aug 04 18:21:22.698029 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:22.697981    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce" containerName="istio-proxy"
Aug 04 18:21:22.698029 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:22.697996    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce" containerName="istio-proxy"
Aug 04 18:21:22.698029 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:22.698001    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce" containerName="istio-proxy"
Aug 04 18:21:22.698119 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:22.698045    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce" containerName="istio-proxy"
Aug 04 18:21:22.701106 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:22.701089    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:22.703438 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:22.703411    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a081e149-openshift-default-dockercfg-hdk5j\""
Aug 04 18:21:22.711175 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:22.711152    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"]
Aug 04 18:21:22.779159 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:22.779134    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85781cde-2b16-42d4-8113-da1cbfa1c84f-credential-socket\") pod \"e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz\" (UID: \"85781cde-2b16-42d4-8113-da1cbfa1c84f\") " pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:22.779276 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:22.779172    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85781cde-2b16-42d4-8113-da1cbfa1c84f-workload-socket\") pod \"e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz\" (UID: \"85781cde-2b16-42d4-8113-da1cbfa1c84f\") " pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:22.779276 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:22.779193    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85781cde-2b16-42d4-8113-da1cbfa1c84f-istio-podinfo\") pod \"e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz\" (UID: \"85781cde-2b16-42d4-8113-da1cbfa1c84f\") " pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:22.779276 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:22.779245    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85781cde-2b16-42d4-8113-da1cbfa1c84f-istio-envoy\") pod \"e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz\" (UID: \"85781cde-2b16-42d4-8113-da1cbfa1c84f\") " pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:22.779394 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:22.779274    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85781cde-2b16-42d4-8113-da1cbfa1c84f-istio-data\") pod \"e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz\" (UID: \"85781cde-2b16-42d4-8113-da1cbfa1c84f\") " pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:22.779394 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:22.779302    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85781cde-2b16-42d4-8113-da1cbfa1c84f-istio-token\") pod \"e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz\" (UID: \"85781cde-2b16-42d4-8113-da1cbfa1c84f\") " pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:22.779394 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:22.779325    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85781cde-2b16-42d4-8113-da1cbfa1c84f-istiod-ca-cert\") pod \"e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz\" (UID: \"85781cde-2b16-42d4-8113-da1cbfa1c84f\") " pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:22.779394 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:22.779345    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85781cde-2b16-42d4-8113-da1cbfa1c84f-workload-certs\") pod \"e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz\" (UID: \"85781cde-2b16-42d4-8113-da1cbfa1c84f\") " pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:22.779394 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:22.779383    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j44g\" (UniqueName: \"kubernetes.io/projected/85781cde-2b16-42d4-8113-da1cbfa1c84f-kube-api-access-2j44g\") pod \"e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz\" (UID: \"85781cde-2b16-42d4-8113-da1cbfa1c84f\") " pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:22.880707 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:22.880677    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j44g\" (UniqueName: \"kubernetes.io/projected/85781cde-2b16-42d4-8113-da1cbfa1c84f-kube-api-access-2j44g\") pod \"e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz\" (UID: \"85781cde-2b16-42d4-8113-da1cbfa1c84f\") " pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:22.880863 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:22.880733    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85781cde-2b16-42d4-8113-da1cbfa1c84f-credential-socket\") pod \"e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz\" (UID: \"85781cde-2b16-42d4-8113-da1cbfa1c84f\") " pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:22.880863 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:22.880766    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85781cde-2b16-42d4-8113-da1cbfa1c84f-workload-socket\") pod \"e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz\" (UID: \"85781cde-2b16-42d4-8113-da1cbfa1c84f\") " pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:22.880863 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:22.880789    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85781cde-2b16-42d4-8113-da1cbfa1c84f-istio-podinfo\") pod \"e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz\" (UID: \"85781cde-2b16-42d4-8113-da1cbfa1c84f\") " pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:22.880863 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:22.880813    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85781cde-2b16-42d4-8113-da1cbfa1c84f-istio-envoy\") pod \"e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz\" (UID: \"85781cde-2b16-42d4-8113-da1cbfa1c84f\") " pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:22.881055 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:22.880900    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85781cde-2b16-42d4-8113-da1cbfa1c84f-istio-data\") pod \"e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz\" (UID: \"85781cde-2b16-42d4-8113-da1cbfa1c84f\") " pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:22.881055 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:22.880943    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85781cde-2b16-42d4-8113-da1cbfa1c84f-istio-token\") pod \"e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz\" (UID: \"85781cde-2b16-42d4-8113-da1cbfa1c84f\") " pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:22.881055 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:22.880974    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85781cde-2b16-42d4-8113-da1cbfa1c84f-istiod-ca-cert\") pod \"e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz\" (UID: \"85781cde-2b16-42d4-8113-da1cbfa1c84f\") " pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:22.881055 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:22.881007    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85781cde-2b16-42d4-8113-da1cbfa1c84f-workload-certs\") pod \"e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz\" (UID: \"85781cde-2b16-42d4-8113-da1cbfa1c84f\") " pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:22.881260 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:22.881208    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85781cde-2b16-42d4-8113-da1cbfa1c84f-workload-socket\") pod \"e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz\" (UID: \"85781cde-2b16-42d4-8113-da1cbfa1c84f\") " pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:22.881319 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:22.881259    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85781cde-2b16-42d4-8113-da1cbfa1c84f-credential-socket\") pod \"e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz\" (UID: \"85781cde-2b16-42d4-8113-da1cbfa1c84f\") " pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:22.881616 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:22.881594    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85781cde-2b16-42d4-8113-da1cbfa1c84f-workload-certs\") pod \"e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz\" (UID: \"85781cde-2b16-42d4-8113-da1cbfa1c84f\") " pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:22.881787 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:22.881648    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85781cde-2b16-42d4-8113-da1cbfa1c84f-istio-data\") pod \"e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz\" (UID: \"85781cde-2b16-42d4-8113-da1cbfa1c84f\") " pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:22.881787 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:22.881709    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85781cde-2b16-42d4-8113-da1cbfa1c84f-istiod-ca-cert\") pod \"e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz\" (UID: \"85781cde-2b16-42d4-8113-da1cbfa1c84f\") " pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:22.883164 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:22.883143    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85781cde-2b16-42d4-8113-da1cbfa1c84f-istio-envoy\") pod \"e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz\" (UID: \"85781cde-2b16-42d4-8113-da1cbfa1c84f\") " pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:22.883268 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:22.883252    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85781cde-2b16-42d4-8113-da1cbfa1c84f-istio-podinfo\") pod \"e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz\" (UID: \"85781cde-2b16-42d4-8113-da1cbfa1c84f\") " pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:22.889534 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:22.889502    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85781cde-2b16-42d4-8113-da1cbfa1c84f-istio-token\") pod \"e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz\" (UID: \"85781cde-2b16-42d4-8113-da1cbfa1c84f\") " pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:22.889625 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:22.889549    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j44g\" (UniqueName: \"kubernetes.io/projected/85781cde-2b16-42d4-8113-da1cbfa1c84f-kube-api-access-2j44g\") pod \"e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz\" (UID: \"85781cde-2b16-42d4-8113-da1cbfa1c84f\") " pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:23.011701 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:23.011648    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:23.138633 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:23.138609    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"]
Aug 04 18:21:23.140941 ip-10-0-141-220 kubenswrapper[2571]: W0804 18:21:23.140910    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85781cde_2b16_42d4_8113_da1cbfa1c84f.slice/crio-b3b96bf6df88bcf6eda238c0be2ddc1413d52304a9837c5090e847a43c96350c WatchSource:0}: Error finding container b3b96bf6df88bcf6eda238c0be2ddc1413d52304a9837c5090e847a43c96350c: Status 404 returned error can't find the container with id b3b96bf6df88bcf6eda238c0be2ddc1413d52304a9837c5090e847a43c96350c
Aug 04 18:21:23.143232 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:23.143192    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:21:23.143325 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:23.143274    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:21:23.143363 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:23.143338    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:21:23.623581 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:23.623545    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz" event={"ID":"85781cde-2b16-42d4-8113-da1cbfa1c84f","Type":"ContainerStarted","Data":"b446b0c0b4336f47f2d9d3d783c54ef47194e0ae626d5d857f73dc82f3493d03"}
Aug 04 18:21:23.623769 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:23.623603    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz" event={"ID":"85781cde-2b16-42d4-8113-da1cbfa1c84f","Type":"ContainerStarted","Data":"b3b96bf6df88bcf6eda238c0be2ddc1413d52304a9837c5090e847a43c96350c"}
Aug 04 18:21:23.642091 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:23.642052    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz" podStartSLOduration=1.642031946 podStartE2EDuration="1.642031946s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:21:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:21:23.640380271 +0000 UTC m=+2100.441516597" watchObservedRunningTime="2026-08-04 18:21:23.642031946 +0000 UTC m=+2100.443168275"
Aug 04 18:21:24.011995 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:24.011938    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:24.016499 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:24.016474    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:24.628048 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:24.628020    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:24.628884 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:24.628864    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:24.839462 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:24.839423    2571 patch_prober.go:28] interesting pod/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 18:21:24.839612 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:24.839484    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk" podUID="0e9b7fcc-3751-4e11-9e3e-593327681027" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:21:27.225833 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.225807    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:21:27.310765 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.310709    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e9b7fcc-3751-4e11-9e3e-593327681027-istio-envoy\") pod \"0e9b7fcc-3751-4e11-9e3e-593327681027\" (UID: \"0e9b7fcc-3751-4e11-9e3e-593327681027\") "
Aug 04 18:21:27.310765 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.310739    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e9b7fcc-3751-4e11-9e3e-593327681027-credential-socket\") pod \"0e9b7fcc-3751-4e11-9e3e-593327681027\" (UID: \"0e9b7fcc-3751-4e11-9e3e-593327681027\") "
Aug 04 18:21:27.310765 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.310760    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e9b7fcc-3751-4e11-9e3e-593327681027-workload-certs\") pod \"0e9b7fcc-3751-4e11-9e3e-593327681027\" (UID: \"0e9b7fcc-3751-4e11-9e3e-593327681027\") "
Aug 04 18:21:27.310988 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.310780    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e9b7fcc-3751-4e11-9e3e-593327681027-istio-podinfo\") pod \"0e9b7fcc-3751-4e11-9e3e-593327681027\" (UID: \"0e9b7fcc-3751-4e11-9e3e-593327681027\") "
Aug 04 18:21:27.310988 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.310806    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e9b7fcc-3751-4e11-9e3e-593327681027-istio-token\") pod \"0e9b7fcc-3751-4e11-9e3e-593327681027\" (UID: \"0e9b7fcc-3751-4e11-9e3e-593327681027\") "
Aug 04 18:21:27.310988 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.310839    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e9b7fcc-3751-4e11-9e3e-593327681027-workload-socket\") pod \"0e9b7fcc-3751-4e11-9e3e-593327681027\" (UID: \"0e9b7fcc-3751-4e11-9e3e-593327681027\") "
Aug 04 18:21:27.310988 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.310956    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e9b7fcc-3751-4e11-9e3e-593327681027-istio-data\") pod \"0e9b7fcc-3751-4e11-9e3e-593327681027\" (UID: \"0e9b7fcc-3751-4e11-9e3e-593327681027\") "
Aug 04 18:21:27.311190 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.311045    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e9b7fcc-3751-4e11-9e3e-593327681027-istiod-ca-cert\") pod \"0e9b7fcc-3751-4e11-9e3e-593327681027\" (UID: \"0e9b7fcc-3751-4e11-9e3e-593327681027\") "
Aug 04 18:21:27.311190 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.311068    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e9b7fcc-3751-4e11-9e3e-593327681027-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0e9b7fcc-3751-4e11-9e3e-593327681027" (UID: "0e9b7fcc-3751-4e11-9e3e-593327681027"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:21:27.311190 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.311083    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e9b7fcc-3751-4e11-9e3e-593327681027-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0e9b7fcc-3751-4e11-9e3e-593327681027" (UID: "0e9b7fcc-3751-4e11-9e3e-593327681027"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:21:27.311190 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.311093    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2r55j\" (UniqueName: \"kubernetes.io/projected/0e9b7fcc-3751-4e11-9e3e-593327681027-kube-api-access-2r55j\") pod \"0e9b7fcc-3751-4e11-9e3e-593327681027\" (UID: \"0e9b7fcc-3751-4e11-9e3e-593327681027\") "
Aug 04 18:21:27.311190 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.311098    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e9b7fcc-3751-4e11-9e3e-593327681027-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0e9b7fcc-3751-4e11-9e3e-593327681027" (UID: "0e9b7fcc-3751-4e11-9e3e-593327681027"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:21:27.311439 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.311293    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e9b7fcc-3751-4e11-9e3e-593327681027-istio-data" (OuterVolumeSpecName: "istio-data") pod "0e9b7fcc-3751-4e11-9e3e-593327681027" (UID: "0e9b7fcc-3751-4e11-9e3e-593327681027"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:21:27.311439 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.311378    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e9b7fcc-3751-4e11-9e3e-593327681027-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0e9b7fcc-3751-4e11-9e3e-593327681027" (UID: "0e9b7fcc-3751-4e11-9e3e-593327681027"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:21:27.311559 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.311460    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e9b7fcc-3751-4e11-9e3e-593327681027-workload-socket\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:21:27.311559 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.311478    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e9b7fcc-3751-4e11-9e3e-593327681027-istio-data\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:21:27.311559 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.311492    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e9b7fcc-3751-4e11-9e3e-593327681027-istiod-ca-cert\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:21:27.311559 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.311504    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e9b7fcc-3751-4e11-9e3e-593327681027-credential-socket\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:21:27.311559 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.311516    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e9b7fcc-3751-4e11-9e3e-593327681027-workload-certs\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:21:27.312892 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.312869    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e9b7fcc-3751-4e11-9e3e-593327681027-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0e9b7fcc-3751-4e11-9e3e-593327681027" (UID: "0e9b7fcc-3751-4e11-9e3e-593327681027"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:21:27.313018 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.312994    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0e9b7fcc-3751-4e11-9e3e-593327681027-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0e9b7fcc-3751-4e11-9e3e-593327681027" (UID: "0e9b7fcc-3751-4e11-9e3e-593327681027"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 18:21:27.313302 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.313285    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e9b7fcc-3751-4e11-9e3e-593327681027-kube-api-access-2r55j" (OuterVolumeSpecName: "kube-api-access-2r55j") pod "0e9b7fcc-3751-4e11-9e3e-593327681027" (UID: "0e9b7fcc-3751-4e11-9e3e-593327681027"). InnerVolumeSpecName "kube-api-access-2r55j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:21:27.313349 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.313315    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e9b7fcc-3751-4e11-9e3e-593327681027-istio-token" (OuterVolumeSpecName: "istio-token") pod "0e9b7fcc-3751-4e11-9e3e-593327681027" (UID: "0e9b7fcc-3751-4e11-9e3e-593327681027"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:21:27.412429 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.412405    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2r55j\" (UniqueName: \"kubernetes.io/projected/0e9b7fcc-3751-4e11-9e3e-593327681027-kube-api-access-2r55j\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:21:27.412429 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.412425    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e9b7fcc-3751-4e11-9e3e-593327681027-istio-envoy\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:21:27.412571 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.412435    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e9b7fcc-3751-4e11-9e3e-593327681027-istio-podinfo\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:21:27.412571 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.412443    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e9b7fcc-3751-4e11-9e3e-593327681027-istio-token\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:21:27.642417 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.642340    2571 generic.go:356] "Generic (PLEG): container finished" podID="0e9b7fcc-3751-4e11-9e3e-593327681027" containerID="25f9e3564d5cbfbe76b29fdb79bf7691e99c8a817eb8a723cad19482af62ff5c" exitCode=0
Aug 04 18:21:27.642417 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.642386    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk" event={"ID":"0e9b7fcc-3751-4e11-9e3e-593327681027","Type":"ContainerDied","Data":"25f9e3564d5cbfbe76b29fdb79bf7691e99c8a817eb8a723cad19482af62ff5c"}
Aug 04 18:21:27.642417 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.642395    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"
Aug 04 18:21:27.642681 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.642426    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk" event={"ID":"0e9b7fcc-3751-4e11-9e3e-593327681027","Type":"ContainerDied","Data":"e9de4807ab8b5d3d2df1f64521f8d7071065bd40c3422c8a94830baf8fee3b51"}
Aug 04 18:21:27.642681 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.642447    2571 scope.go:117] "RemoveContainer" containerID="25f9e3564d5cbfbe76b29fdb79bf7691e99c8a817eb8a723cad19482af62ff5c"
Aug 04 18:21:27.651070 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.651054    2571 scope.go:117] "RemoveContainer" containerID="86df1d5c433924920eaef83580aaeee8170c2d8180d24372ec2f344244f352cc"
Aug 04 18:21:27.658814 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.658796    2571 scope.go:117] "RemoveContainer" containerID="25f9e3564d5cbfbe76b29fdb79bf7691e99c8a817eb8a723cad19482af62ff5c"
Aug 04 18:21:27.659059 ip-10-0-141-220 kubenswrapper[2571]: E0804 18:21:27.659042    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25f9e3564d5cbfbe76b29fdb79bf7691e99c8a817eb8a723cad19482af62ff5c\": container with ID starting with 25f9e3564d5cbfbe76b29fdb79bf7691e99c8a817eb8a723cad19482af62ff5c not found: ID does not exist" containerID="25f9e3564d5cbfbe76b29fdb79bf7691e99c8a817eb8a723cad19482af62ff5c"
Aug 04 18:21:27.659109 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.659068    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25f9e3564d5cbfbe76b29fdb79bf7691e99c8a817eb8a723cad19482af62ff5c"} err="failed to get container status \"25f9e3564d5cbfbe76b29fdb79bf7691e99c8a817eb8a723cad19482af62ff5c\": rpc error: code = NotFound desc = could not find container \"25f9e3564d5cbfbe76b29fdb79bf7691e99c8a817eb8a723cad19482af62ff5c\": container with ID starting with 25f9e3564d5cbfbe76b29fdb79bf7691e99c8a817eb8a723cad19482af62ff5c not found: ID does not exist"
Aug 04 18:21:27.659109 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.659083    2571 scope.go:117] "RemoveContainer" containerID="86df1d5c433924920eaef83580aaeee8170c2d8180d24372ec2f344244f352cc"
Aug 04 18:21:27.659313 ip-10-0-141-220 kubenswrapper[2571]: E0804 18:21:27.659295    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86df1d5c433924920eaef83580aaeee8170c2d8180d24372ec2f344244f352cc\": container with ID starting with 86df1d5c433924920eaef83580aaeee8170c2d8180d24372ec2f344244f352cc not found: ID does not exist" containerID="86df1d5c433924920eaef83580aaeee8170c2d8180d24372ec2f344244f352cc"
Aug 04 18:21:27.659357 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.659319    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86df1d5c433924920eaef83580aaeee8170c2d8180d24372ec2f344244f352cc"} err="failed to get container status \"86df1d5c433924920eaef83580aaeee8170c2d8180d24372ec2f344244f352cc\": rpc error: code = NotFound desc = could not find container \"86df1d5c433924920eaef83580aaeee8170c2d8180d24372ec2f344244f352cc\": container with ID starting with 86df1d5c433924920eaef83580aaeee8170c2d8180d24372ec2f344244f352cc not found: ID does not exist"
Aug 04 18:21:27.662737 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.662717    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"]
Aug 04 18:21:27.666934 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.666909    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-06d91391-gw-openshift-default-74954849bd-56phk"]
Aug 04 18:21:27.878924 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:27.878903    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e9b7fcc-3751-4e11-9e3e-593327681027" path="/var/lib/kubelet/pods/0e9b7fcc-3751-4e11-9e3e-593327681027/volumes"
Aug 04 18:21:38.695377 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:38.695300    2571 generic.go:356] "Generic (PLEG): container finished" podID="85781cde-2b16-42d4-8113-da1cbfa1c84f" containerID="b446b0c0b4336f47f2d9d3d783c54ef47194e0ae626d5d857f73dc82f3493d03" exitCode=0
Aug 04 18:21:38.695377 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:38.695347    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz" event={"ID":"85781cde-2b16-42d4-8113-da1cbfa1c84f","Type":"ContainerDied","Data":"b446b0c0b4336f47f2d9d3d783c54ef47194e0ae626d5d857f73dc82f3493d03"}
Aug 04 18:21:38.695891 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:38.695663    2571 scope.go:117] "RemoveContainer" containerID="b446b0c0b4336f47f2d9d3d783c54ef47194e0ae626d5d857f73dc82f3493d03"
Aug 04 18:21:38.696560 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:38.696515    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:21:38.696630 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:38.696601    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:21:38.696675 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:38.696634    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:21:39.628361 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:39.628308    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:39.700853 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:39.700818    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz" event={"ID":"85781cde-2b16-42d4-8113-da1cbfa1c84f","Type":"ContainerStarted","Data":"1582d9c123d15ada5e1c4cdaf568a8246acbb82ea1912e426ae0ab827c901877"}
Aug 04 18:21:40.012599 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:40.012504    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:40.013648 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:40.013620    2571 patch_prober.go:28] interesting pod/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Aug 04 18:21:40.013796 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:40.013675    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz" podUID="85781cde-2b16-42d4-8113-da1cbfa1c84f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Aug 04 18:21:41.012457 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:41.012424    2571 patch_prober.go:28] interesting pod/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Aug 04 18:21:41.012852 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:41.012477    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz" podUID="85781cde-2b16-42d4-8113-da1cbfa1c84f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Aug 04 18:21:42.012741 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:42.012713    2571 patch_prober.go:28] interesting pod/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Aug 04 18:21:42.013198 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:42.012771    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz" podUID="85781cde-2b16-42d4-8113-da1cbfa1c84f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Aug 04 18:21:43.012194 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:43.012158    2571 patch_prober.go:28] interesting pod/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Aug 04 18:21:43.012364 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:43.012212    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz" podUID="85781cde-2b16-42d4-8113-da1cbfa1c84f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Aug 04 18:21:44.012629 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:44.012582    2571 patch_prober.go:28] interesting pod/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Aug 04 18:21:44.012997 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:44.012644    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz" podUID="85781cde-2b16-42d4-8113-da1cbfa1c84f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Aug 04 18:21:45.016298 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:45.016268    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:45.016686 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:45.016621    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:45.017415 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:45.017397    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:21:50.721363 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:50.721333    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a081e149-qr5nk"]
Aug 04 18:21:50.721796 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:50.721615    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e9b7fcc-3751-4e11-9e3e-593327681027" containerName="istio-proxy"
Aug 04 18:21:50.721796 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:50.721627    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e9b7fcc-3751-4e11-9e3e-593327681027" containerName="istio-proxy"
Aug 04 18:21:50.721796 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:50.721640    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e9b7fcc-3751-4e11-9e3e-593327681027" containerName="istio-proxy"
Aug 04 18:21:50.721796 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:50.721646    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e9b7fcc-3751-4e11-9e3e-593327681027" containerName="istio-proxy"
Aug 04 18:21:50.721796 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:50.721702    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e9b7fcc-3751-4e11-9e3e-593327681027" containerName="istio-proxy"
Aug 04 18:21:50.721796 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:50.721710    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e9b7fcc-3751-4e11-9e3e-593327681027" containerName="istio-proxy"
Aug 04 18:21:50.721796 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:50.721719    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcbe36f3-29ee-4223-9e85-c4dd8e72b5ce" containerName="istio-proxy"
Aug 04 18:21:50.723482 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:50.723465    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a081e149-qr5nk"
Aug 04 18:21:50.725473 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:50.725451    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 18:21:50.725568 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:50.725499    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6xvms\""
Aug 04 18:21:50.731177 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:50.731157    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a081e149-qr5nk"]
Aug 04 18:21:50.799655 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:50.799628    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72729d6f-478c-4693-a656-485e498cf4af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a081e149-qr5nk\" (UID: \"72729d6f-478c-4693-a656-485e498cf4af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a081e149-qr5nk"
Aug 04 18:21:50.900129 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:50.900106    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72729d6f-478c-4693-a656-485e498cf4af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a081e149-qr5nk\" (UID: \"72729d6f-478c-4693-a656-485e498cf4af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a081e149-qr5nk"
Aug 04 18:21:50.900666 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:50.900651    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72729d6f-478c-4693-a656-485e498cf4af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a081e149-qr5nk\" (UID: \"72729d6f-478c-4693-a656-485e498cf4af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a081e149-qr5nk"
Aug 04 18:21:51.035031 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:51.035014    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a081e149-qr5nk"
Aug 04 18:21:51.155601 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:51.155575    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a081e149-qr5nk"]
Aug 04 18:21:51.158223 ip-10-0-141-220 kubenswrapper[2571]: W0804 18:21:51.158192    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72729d6f_478c_4693_a656_485e498cf4af.slice/crio-b3341d3e91d80f5904dbfc2e19842ac334b1e6bdeb408a03851e13b46fdb0028 WatchSource:0}: Error finding container b3341d3e91d80f5904dbfc2e19842ac334b1e6bdeb408a03851e13b46fdb0028: Status 404 returned error can't find the container with id b3341d3e91d80f5904dbfc2e19842ac334b1e6bdeb408a03851e13b46fdb0028
Aug 04 18:21:51.750969 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:51.750911    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a081e149-qr5nk" event={"ID":"72729d6f-478c-4693-a656-485e498cf4af","Type":"ContainerStarted","Data":"db6e3e67a14915c427c43d488b8f1cf2407b5c298e23ebe17e1b251c80dd4ebf"}
Aug 04 18:21:51.750969 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:51.750957    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a081e149-qr5nk" event={"ID":"72729d6f-478c-4693-a656-485e498cf4af","Type":"ContainerStarted","Data":"b3341d3e91d80f5904dbfc2e19842ac334b1e6bdeb408a03851e13b46fdb0028"}
Aug 04 18:21:51.765611 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:51.765567    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a081e149-qr5nk" podStartSLOduration=1.7655532699999998 podStartE2EDuration="1.76555327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:21:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:21:51.763751441 +0000 UTC m=+2128.564887778" watchObservedRunningTime="2026-08-04 18:21:51.76555327 +0000 UTC m=+2128.566689596"
Aug 04 18:21:52.756975 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:52.756947    2571 generic.go:356] "Generic (PLEG): container finished" podID="72729d6f-478c-4693-a656-485e498cf4af" containerID="db6e3e67a14915c427c43d488b8f1cf2407b5c298e23ebe17e1b251c80dd4ebf" exitCode=0
Aug 04 18:21:52.757406 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:52.756998    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a081e149-qr5nk" event={"ID":"72729d6f-478c-4693-a656-485e498cf4af","Type":"ContainerDied","Data":"db6e3e67a14915c427c43d488b8f1cf2407b5c298e23ebe17e1b251c80dd4ebf"}
Aug 04 18:21:53.884294 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:53.884266    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a081e149-qr5nk"
Aug 04 18:21:54.022453 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:54.022382    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72729d6f-478c-4693-a656-485e498cf4af-maas-api-service-ca\") pod \"72729d6f-478c-4693-a656-485e498cf4af\" (UID: \"72729d6f-478c-4693-a656-485e498cf4af\") "
Aug 04 18:21:54.022722 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:54.022700    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72729d6f-478c-4693-a656-485e498cf4af-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "72729d6f-478c-4693-a656-485e498cf4af" (UID: "72729d6f-478c-4693-a656-485e498cf4af"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:21:54.123137 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:54.123114    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72729d6f-478c-4693-a656-485e498cf4af-maas-api-service-ca\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:21:54.766355 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:54.766330    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a081e149-qr5nk"
Aug 04 18:21:54.766355 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:54.766337    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a081e149-qr5nk" event={"ID":"72729d6f-478c-4693-a656-485e498cf4af","Type":"ContainerDied","Data":"b3341d3e91d80f5904dbfc2e19842ac334b1e6bdeb408a03851e13b46fdb0028"}
Aug 04 18:21:54.766551 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:54.766410    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b3341d3e91d80f5904dbfc2e19842ac334b1e6bdeb408a03851e13b46fdb0028"
Aug 04 18:21:56.765313 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:56.765281    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a081e149-qr5nk"]
Aug 04 18:21:56.767472 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:56.767448    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a081e149-qr5nk"]
Aug 04 18:21:57.879764 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:57.879732    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72729d6f-478c-4693-a656-485e498cf4af" path="/var/lib/kubelet/pods/72729d6f-478c-4693-a656-485e498cf4af/volumes"
Aug 04 18:21:57.880115 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:57.879995    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"]
Aug 04 18:21:57.880169 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:57.880148    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz" podUID="85781cde-2b16-42d4-8113-da1cbfa1c84f" containerName="istio-proxy" containerID="cri-o://1582d9c123d15ada5e1c4cdaf568a8246acbb82ea1912e426ae0ab827c901877" gracePeriod=30
Aug 04 18:21:58.617775 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:58.617740    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"]
Aug 04 18:21:58.618161 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:58.618146    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72729d6f-478c-4693-a656-485e498cf4af" containerName="revoke-keys"
Aug 04 18:21:58.618204 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:58.618164    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="72729d6f-478c-4693-a656-485e498cf4af" containerName="revoke-keys"
Aug 04 18:21:58.618248 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:58.618237    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="72729d6f-478c-4693-a656-485e498cf4af" containerName="revoke-keys"
Aug 04 18:21:58.620264 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:58.620243    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:21:58.622395 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:58.622374    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-024faf48-openshift-default-dockercfg-rcpk2\""
Aug 04 18:21:58.630025 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:58.630004    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"]
Aug 04 18:21:58.757178 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:58.757147    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/276c83e7-27ae-4469-8dfd-aa7c218073f5-istio-data\") pod \"e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc\" (UID: \"276c83e7-27ae-4469-8dfd-aa7c218073f5\") " pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:21:58.757328 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:58.757188    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/276c83e7-27ae-4469-8dfd-aa7c218073f5-credential-socket\") pod \"e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc\" (UID: \"276c83e7-27ae-4469-8dfd-aa7c218073f5\") " pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:21:58.757328 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:58.757209    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/276c83e7-27ae-4469-8dfd-aa7c218073f5-workload-certs\") pod \"e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc\" (UID: \"276c83e7-27ae-4469-8dfd-aa7c218073f5\") " pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:21:58.757328 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:58.757264    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/276c83e7-27ae-4469-8dfd-aa7c218073f5-istio-podinfo\") pod \"e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc\" (UID: \"276c83e7-27ae-4469-8dfd-aa7c218073f5\") " pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:21:58.757328 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:58.757297    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mjgk\" (UniqueName: \"kubernetes.io/projected/276c83e7-27ae-4469-8dfd-aa7c218073f5-kube-api-access-2mjgk\") pod \"e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc\" (UID: \"276c83e7-27ae-4469-8dfd-aa7c218073f5\") " pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:21:58.757463 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:58.757328    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/276c83e7-27ae-4469-8dfd-aa7c218073f5-workload-socket\") pod \"e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc\" (UID: \"276c83e7-27ae-4469-8dfd-aa7c218073f5\") " pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:21:58.757463 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:58.757348    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/276c83e7-27ae-4469-8dfd-aa7c218073f5-istio-envoy\") pod \"e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc\" (UID: \"276c83e7-27ae-4469-8dfd-aa7c218073f5\") " pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:21:58.757463 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:58.757367    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/276c83e7-27ae-4469-8dfd-aa7c218073f5-istio-token\") pod \"e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc\" (UID: \"276c83e7-27ae-4469-8dfd-aa7c218073f5\") " pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:21:58.757463 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:58.757387    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/276c83e7-27ae-4469-8dfd-aa7c218073f5-istiod-ca-cert\") pod \"e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc\" (UID: \"276c83e7-27ae-4469-8dfd-aa7c218073f5\") " pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:21:58.858259 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:58.858220    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/276c83e7-27ae-4469-8dfd-aa7c218073f5-istio-envoy\") pod \"e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc\" (UID: \"276c83e7-27ae-4469-8dfd-aa7c218073f5\") " pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:21:58.858420 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:58.858266    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/276c83e7-27ae-4469-8dfd-aa7c218073f5-istio-token\") pod \"e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc\" (UID: \"276c83e7-27ae-4469-8dfd-aa7c218073f5\") " pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:21:58.858420 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:58.858294    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/276c83e7-27ae-4469-8dfd-aa7c218073f5-istiod-ca-cert\") pod \"e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc\" (UID: \"276c83e7-27ae-4469-8dfd-aa7c218073f5\") " pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:21:58.858420 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:58.858333    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/276c83e7-27ae-4469-8dfd-aa7c218073f5-istio-data\") pod \"e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc\" (UID: \"276c83e7-27ae-4469-8dfd-aa7c218073f5\") " pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:21:58.858420 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:58.858369    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/276c83e7-27ae-4469-8dfd-aa7c218073f5-credential-socket\") pod \"e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc\" (UID: \"276c83e7-27ae-4469-8dfd-aa7c218073f5\") " pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:21:58.858420 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:58.858396    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/276c83e7-27ae-4469-8dfd-aa7c218073f5-workload-certs\") pod \"e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc\" (UID: \"276c83e7-27ae-4469-8dfd-aa7c218073f5\") " pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:21:58.858713 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:58.858442    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/276c83e7-27ae-4469-8dfd-aa7c218073f5-istio-podinfo\") pod \"e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc\" (UID: \"276c83e7-27ae-4469-8dfd-aa7c218073f5\") " pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:21:58.858713 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:58.858490    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mjgk\" (UniqueName: \"kubernetes.io/projected/276c83e7-27ae-4469-8dfd-aa7c218073f5-kube-api-access-2mjgk\") pod \"e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc\" (UID: \"276c83e7-27ae-4469-8dfd-aa7c218073f5\") " pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:21:58.858713 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:58.858554    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/276c83e7-27ae-4469-8dfd-aa7c218073f5-workload-socket\") pod \"e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc\" (UID: \"276c83e7-27ae-4469-8dfd-aa7c218073f5\") " pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:21:58.858875 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:58.858706    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/276c83e7-27ae-4469-8dfd-aa7c218073f5-istio-data\") pod \"e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc\" (UID: \"276c83e7-27ae-4469-8dfd-aa7c218073f5\") " pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:21:58.858875 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:58.858784    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/276c83e7-27ae-4469-8dfd-aa7c218073f5-workload-certs\") pod \"e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc\" (UID: \"276c83e7-27ae-4469-8dfd-aa7c218073f5\") " pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:21:58.858985 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:58.858911    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/276c83e7-27ae-4469-8dfd-aa7c218073f5-workload-socket\") pod \"e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc\" (UID: \"276c83e7-27ae-4469-8dfd-aa7c218073f5\") " pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:21:58.858985 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:58.858932    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/276c83e7-27ae-4469-8dfd-aa7c218073f5-credential-socket\") pod \"e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc\" (UID: \"276c83e7-27ae-4469-8dfd-aa7c218073f5\") " pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:21:58.859054 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:58.859004    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/276c83e7-27ae-4469-8dfd-aa7c218073f5-istiod-ca-cert\") pod \"e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc\" (UID: \"276c83e7-27ae-4469-8dfd-aa7c218073f5\") " pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:21:58.860419 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:58.860399    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/276c83e7-27ae-4469-8dfd-aa7c218073f5-istio-envoy\") pod \"e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc\" (UID: \"276c83e7-27ae-4469-8dfd-aa7c218073f5\") " pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:21:58.860841 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:58.860824    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/276c83e7-27ae-4469-8dfd-aa7c218073f5-istio-podinfo\") pod \"e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc\" (UID: \"276c83e7-27ae-4469-8dfd-aa7c218073f5\") " pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:21:58.865817 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:58.865794    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/276c83e7-27ae-4469-8dfd-aa7c218073f5-istio-token\") pod \"e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc\" (UID: \"276c83e7-27ae-4469-8dfd-aa7c218073f5\") " pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:21:58.865957 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:58.865933    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mjgk\" (UniqueName: \"kubernetes.io/projected/276c83e7-27ae-4469-8dfd-aa7c218073f5-kube-api-access-2mjgk\") pod \"e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc\" (UID: \"276c83e7-27ae-4469-8dfd-aa7c218073f5\") " pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:21:58.930983 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:58.930935    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:21:59.073852 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:59.073824    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"]
Aug 04 18:21:59.075912 ip-10-0-141-220 kubenswrapper[2571]: W0804 18:21:59.075880    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod276c83e7_27ae_4469_8dfd_aa7c218073f5.slice/crio-03b6f045823098901cf74c8bbcb4c9d1093e19e0d9866e635e3780cf68164124 WatchSource:0}: Error finding container 03b6f045823098901cf74c8bbcb4c9d1093e19e0d9866e635e3780cf68164124: Status 404 returned error can't find the container with id 03b6f045823098901cf74c8bbcb4c9d1093e19e0d9866e635e3780cf68164124
Aug 04 18:21:59.077940 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:59.077907    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:21:59.078038 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:59.077966    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:21:59.078038 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:59.077993    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:21:59.788928 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:59.788897    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc" event={"ID":"276c83e7-27ae-4469-8dfd-aa7c218073f5","Type":"ContainerStarted","Data":"916cfaa9fb175f9cf4a10c540f78e8450916df10d355edb4170a4ba8922b3d38"}
Aug 04 18:21:59.789085 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:59.788945    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc" event={"ID":"276c83e7-27ae-4469-8dfd-aa7c218073f5","Type":"ContainerStarted","Data":"03b6f045823098901cf74c8bbcb4c9d1093e19e0d9866e635e3780cf68164124"}
Aug 04 18:21:59.808600 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:59.808551    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc" podStartSLOduration=1.808504385 podStartE2EDuration="1.808504385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:21:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:21:59.806680745 +0000 UTC m=+2136.607817090" watchObservedRunningTime="2026-08-04 18:21:59.808504385 +0000 UTC m=+2136.609640713"
Aug 04 18:21:59.931210 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:21:59.931181    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:22:00.018654 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:00.018618    2571 patch_prober.go:28] interesting pod/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 18:22:00.018794 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:00.018674    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz" podUID="85781cde-2b16-42d4-8113-da1cbfa1c84f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:22:00.936203 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:00.936174    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:22:01.797560 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:01.797517    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:22:01.798281 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:01.798262    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:22:03.125101 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.125079    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:22:03.288087 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.288064    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85781cde-2b16-42d4-8113-da1cbfa1c84f-workload-socket\") pod \"85781cde-2b16-42d4-8113-da1cbfa1c84f\" (UID: \"85781cde-2b16-42d4-8113-da1cbfa1c84f\") "
Aug 04 18:22:03.288236 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.288094    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85781cde-2b16-42d4-8113-da1cbfa1c84f-workload-certs\") pod \"85781cde-2b16-42d4-8113-da1cbfa1c84f\" (UID: \"85781cde-2b16-42d4-8113-da1cbfa1c84f\") "
Aug 04 18:22:03.288236 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.288117    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85781cde-2b16-42d4-8113-da1cbfa1c84f-istio-data\") pod \"85781cde-2b16-42d4-8113-da1cbfa1c84f\" (UID: \"85781cde-2b16-42d4-8113-da1cbfa1c84f\") "
Aug 04 18:22:03.288236 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.288133    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85781cde-2b16-42d4-8113-da1cbfa1c84f-istiod-ca-cert\") pod \"85781cde-2b16-42d4-8113-da1cbfa1c84f\" (UID: \"85781cde-2b16-42d4-8113-da1cbfa1c84f\") "
Aug 04 18:22:03.288236 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.288163    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85781cde-2b16-42d4-8113-da1cbfa1c84f-credential-socket\") pod \"85781cde-2b16-42d4-8113-da1cbfa1c84f\" (UID: \"85781cde-2b16-42d4-8113-da1cbfa1c84f\") "
Aug 04 18:22:03.288236 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.288210    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85781cde-2b16-42d4-8113-da1cbfa1c84f-istio-envoy\") pod \"85781cde-2b16-42d4-8113-da1cbfa1c84f\" (UID: \"85781cde-2b16-42d4-8113-da1cbfa1c84f\") "
Aug 04 18:22:03.288485 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.288302    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85781cde-2b16-42d4-8113-da1cbfa1c84f-istio-token\") pod \"85781cde-2b16-42d4-8113-da1cbfa1c84f\" (UID: \"85781cde-2b16-42d4-8113-da1cbfa1c84f\") "
Aug 04 18:22:03.288485 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.288330    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85781cde-2b16-42d4-8113-da1cbfa1c84f-istio-podinfo\") pod \"85781cde-2b16-42d4-8113-da1cbfa1c84f\" (UID: \"85781cde-2b16-42d4-8113-da1cbfa1c84f\") "
Aug 04 18:22:03.288623 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.288362    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85781cde-2b16-42d4-8113-da1cbfa1c84f-istio-data" (OuterVolumeSpecName: "istio-data") pod "85781cde-2b16-42d4-8113-da1cbfa1c84f" (UID: "85781cde-2b16-42d4-8113-da1cbfa1c84f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:22:03.288623 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.288583    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2j44g\" (UniqueName: \"kubernetes.io/projected/85781cde-2b16-42d4-8113-da1cbfa1c84f-kube-api-access-2j44g\") pod \"85781cde-2b16-42d4-8113-da1cbfa1c84f\" (UID: \"85781cde-2b16-42d4-8113-da1cbfa1c84f\") "
Aug 04 18:22:03.288717 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.288378    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85781cde-2b16-42d4-8113-da1cbfa1c84f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "85781cde-2b16-42d4-8113-da1cbfa1c84f" (UID: "85781cde-2b16-42d4-8113-da1cbfa1c84f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:22:03.288717 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.288395    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85781cde-2b16-42d4-8113-da1cbfa1c84f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "85781cde-2b16-42d4-8113-da1cbfa1c84f" (UID: "85781cde-2b16-42d4-8113-da1cbfa1c84f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:22:03.288717 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.288494    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85781cde-2b16-42d4-8113-da1cbfa1c84f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "85781cde-2b16-42d4-8113-da1cbfa1c84f" (UID: "85781cde-2b16-42d4-8113-da1cbfa1c84f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:22:03.288717 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.288567    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85781cde-2b16-42d4-8113-da1cbfa1c84f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "85781cde-2b16-42d4-8113-da1cbfa1c84f" (UID: "85781cde-2b16-42d4-8113-da1cbfa1c84f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:22:03.288928 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.288903    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85781cde-2b16-42d4-8113-da1cbfa1c84f-credential-socket\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:22:03.289046 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.288930    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85781cde-2b16-42d4-8113-da1cbfa1c84f-workload-socket\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:22:03.289046 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.288947    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85781cde-2b16-42d4-8113-da1cbfa1c84f-workload-certs\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:22:03.289046 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.288960    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85781cde-2b16-42d4-8113-da1cbfa1c84f-istio-data\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:22:03.289046 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.288974    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85781cde-2b16-42d4-8113-da1cbfa1c84f-istiod-ca-cert\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:22:03.290468 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.290443    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85781cde-2b16-42d4-8113-da1cbfa1c84f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "85781cde-2b16-42d4-8113-da1cbfa1c84f" (UID: "85781cde-2b16-42d4-8113-da1cbfa1c84f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:22:03.290601 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.290489    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85781cde-2b16-42d4-8113-da1cbfa1c84f-istio-token" (OuterVolumeSpecName: "istio-token") pod "85781cde-2b16-42d4-8113-da1cbfa1c84f" (UID: "85781cde-2b16-42d4-8113-da1cbfa1c84f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:22:03.290601 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.290542    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/85781cde-2b16-42d4-8113-da1cbfa1c84f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "85781cde-2b16-42d4-8113-da1cbfa1c84f" (UID: "85781cde-2b16-42d4-8113-da1cbfa1c84f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 18:22:03.290689 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.290598    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85781cde-2b16-42d4-8113-da1cbfa1c84f-kube-api-access-2j44g" (OuterVolumeSpecName: "kube-api-access-2j44g") pod "85781cde-2b16-42d4-8113-da1cbfa1c84f" (UID: "85781cde-2b16-42d4-8113-da1cbfa1c84f"). InnerVolumeSpecName "kube-api-access-2j44g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:22:03.390128 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.390106    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85781cde-2b16-42d4-8113-da1cbfa1c84f-istio-envoy\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:22:03.390128 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.390127    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85781cde-2b16-42d4-8113-da1cbfa1c84f-istio-token\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:22:03.390230 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.390135    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85781cde-2b16-42d4-8113-da1cbfa1c84f-istio-podinfo\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:22:03.390230 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.390144    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2j44g\" (UniqueName: \"kubernetes.io/projected/85781cde-2b16-42d4-8113-da1cbfa1c84f-kube-api-access-2j44g\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:22:03.807620 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.807598    2571 generic.go:356] "Generic (PLEG): container finished" podID="85781cde-2b16-42d4-8113-da1cbfa1c84f" containerID="1582d9c123d15ada5e1c4cdaf568a8246acbb82ea1912e426ae0ab827c901877" exitCode=0
Aug 04 18:22:03.807730 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.807643    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"
Aug 04 18:22:03.807730 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.807688    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz" event={"ID":"85781cde-2b16-42d4-8113-da1cbfa1c84f","Type":"ContainerDied","Data":"1582d9c123d15ada5e1c4cdaf568a8246acbb82ea1912e426ae0ab827c901877"}
Aug 04 18:22:03.807806 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.807744    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz" event={"ID":"85781cde-2b16-42d4-8113-da1cbfa1c84f","Type":"ContainerDied","Data":"b3b96bf6df88bcf6eda238c0be2ddc1413d52304a9837c5090e847a43c96350c"}
Aug 04 18:22:03.807806 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.807768    2571 scope.go:117] "RemoveContainer" containerID="1582d9c123d15ada5e1c4cdaf568a8246acbb82ea1912e426ae0ab827c901877"
Aug 04 18:22:03.816192 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.816179    2571 scope.go:117] "RemoveContainer" containerID="b446b0c0b4336f47f2d9d3d783c54ef47194e0ae626d5d857f73dc82f3493d03"
Aug 04 18:22:03.823270 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.823255    2571 scope.go:117] "RemoveContainer" containerID="1582d9c123d15ada5e1c4cdaf568a8246acbb82ea1912e426ae0ab827c901877"
Aug 04 18:22:03.823619 ip-10-0-141-220 kubenswrapper[2571]: E0804 18:22:03.823501    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1582d9c123d15ada5e1c4cdaf568a8246acbb82ea1912e426ae0ab827c901877\": container with ID starting with 1582d9c123d15ada5e1c4cdaf568a8246acbb82ea1912e426ae0ab827c901877 not found: ID does not exist" containerID="1582d9c123d15ada5e1c4cdaf568a8246acbb82ea1912e426ae0ab827c901877"
Aug 04 18:22:03.823619 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.823547    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1582d9c123d15ada5e1c4cdaf568a8246acbb82ea1912e426ae0ab827c901877"} err="failed to get container status \"1582d9c123d15ada5e1c4cdaf568a8246acbb82ea1912e426ae0ab827c901877\": rpc error: code = NotFound desc = could not find container \"1582d9c123d15ada5e1c4cdaf568a8246acbb82ea1912e426ae0ab827c901877\": container with ID starting with 1582d9c123d15ada5e1c4cdaf568a8246acbb82ea1912e426ae0ab827c901877 not found: ID does not exist"
Aug 04 18:22:03.823619 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.823570    2571 scope.go:117] "RemoveContainer" containerID="b446b0c0b4336f47f2d9d3d783c54ef47194e0ae626d5d857f73dc82f3493d03"
Aug 04 18:22:03.823798 ip-10-0-141-220 kubenswrapper[2571]: E0804 18:22:03.823780    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b446b0c0b4336f47f2d9d3d783c54ef47194e0ae626d5d857f73dc82f3493d03\": container with ID starting with b446b0c0b4336f47f2d9d3d783c54ef47194e0ae626d5d857f73dc82f3493d03 not found: ID does not exist" containerID="b446b0c0b4336f47f2d9d3d783c54ef47194e0ae626d5d857f73dc82f3493d03"
Aug 04 18:22:03.823837 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.823804    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b446b0c0b4336f47f2d9d3d783c54ef47194e0ae626d5d857f73dc82f3493d03"} err="failed to get container status \"b446b0c0b4336f47f2d9d3d783c54ef47194e0ae626d5d857f73dc82f3493d03\": rpc error: code = NotFound desc = could not find container \"b446b0c0b4336f47f2d9d3d783c54ef47194e0ae626d5d857f73dc82f3493d03\": container with ID starting with b446b0c0b4336f47f2d9d3d783c54ef47194e0ae626d5d857f73dc82f3493d03 not found: ID does not exist"
Aug 04 18:22:03.828328 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.828307    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"]
Aug 04 18:22:03.834295 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.834275    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a081e149-openshift-default-7cdbdbf474-zdndz"]
Aug 04 18:22:03.882234 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:03.882198    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85781cde-2b16-42d4-8113-da1cbfa1c84f" path="/var/lib/kubelet/pods/85781cde-2b16-42d4-8113-da1cbfa1c84f/volumes"
Aug 04 18:22:13.853779 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:13.853753    2571 generic.go:356] "Generic (PLEG): container finished" podID="276c83e7-27ae-4469-8dfd-aa7c218073f5" containerID="916cfaa9fb175f9cf4a10c540f78e8450916df10d355edb4170a4ba8922b3d38" exitCode=0
Aug 04 18:22:13.854117 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:13.853788    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc" event={"ID":"276c83e7-27ae-4469-8dfd-aa7c218073f5","Type":"ContainerDied","Data":"916cfaa9fb175f9cf4a10c540f78e8450916df10d355edb4170a4ba8922b3d38"}
Aug 04 18:22:13.854117 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:13.854076    2571 scope.go:117] "RemoveContainer" containerID="916cfaa9fb175f9cf4a10c540f78e8450916df10d355edb4170a4ba8922b3d38"
Aug 04 18:22:13.854981 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:13.854950    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:22:13.855068 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:13.855034    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:22:13.855129 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:13.855092    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:22:14.859852 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:14.859813    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc" event={"ID":"276c83e7-27ae-4469-8dfd-aa7c218073f5","Type":"ContainerStarted","Data":"3bf91cb8d9691e3c4186b7dfd9cbc6bb4c9d55e1ade3e79fcedbadc9c59e4e82"}
Aug 04 18:22:14.931567 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:14.931517    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:22:14.932771 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:14.932724    2571 patch_prober.go:28] interesting pod/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Aug 04 18:22:14.932892 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:14.932804    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc" podUID="276c83e7-27ae-4469-8dfd-aa7c218073f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Aug 04 18:22:15.931877 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:15.931830    2571 patch_prober.go:28] interesting pod/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Aug 04 18:22:15.932481 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:15.932436    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc" podUID="276c83e7-27ae-4469-8dfd-aa7c218073f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Aug 04 18:22:16.797870 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:16.797838    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:22:16.932034 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:16.931995    2571 patch_prober.go:28] interesting pod/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Aug 04 18:22:16.932480 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:16.932055    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc" podUID="276c83e7-27ae-4469-8dfd-aa7c218073f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Aug 04 18:22:17.931630 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:17.931587    2571 patch_prober.go:28] interesting pod/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Aug 04 18:22:17.931839 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:17.931663    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc" podUID="276c83e7-27ae-4469-8dfd-aa7c218073f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Aug 04 18:22:18.931724 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:18.931687    2571 patch_prober.go:28] interesting pod/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Aug 04 18:22:18.932304 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:18.932271    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc" podUID="276c83e7-27ae-4469-8dfd-aa7c218073f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Aug 04 18:22:19.935454 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:19.935422    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:22:19.936355 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:19.936334    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:22:33.077609 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:33.077574    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"]
Aug 04 18:22:33.078061 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:33.077809    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc" podUID="276c83e7-27ae-4469-8dfd-aa7c218073f5" containerName="istio-proxy" containerID="cri-o://3bf91cb8d9691e3c4186b7dfd9cbc6bb4c9d55e1ade3e79fcedbadc9c59e4e82" gracePeriod=30
Aug 04 18:22:34.937580 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:34.937551    2571 patch_prober.go:28] interesting pod/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Aug 04 18:22:34.937945 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:34.937608    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc" podUID="276c83e7-27ae-4469-8dfd-aa7c218073f5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:22:38.319071 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.319046    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:22:38.351457 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.351433    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/276c83e7-27ae-4469-8dfd-aa7c218073f5-istiod-ca-cert\") pod \"276c83e7-27ae-4469-8dfd-aa7c218073f5\" (UID: \"276c83e7-27ae-4469-8dfd-aa7c218073f5\") "
Aug 04 18:22:38.351600 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.351473    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/276c83e7-27ae-4469-8dfd-aa7c218073f5-istio-envoy\") pod \"276c83e7-27ae-4469-8dfd-aa7c218073f5\" (UID: \"276c83e7-27ae-4469-8dfd-aa7c218073f5\") "
Aug 04 18:22:38.351600 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.351511    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/276c83e7-27ae-4469-8dfd-aa7c218073f5-workload-socket\") pod \"276c83e7-27ae-4469-8dfd-aa7c218073f5\" (UID: \"276c83e7-27ae-4469-8dfd-aa7c218073f5\") "
Aug 04 18:22:38.351600 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.351559    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/276c83e7-27ae-4469-8dfd-aa7c218073f5-credential-socket\") pod \"276c83e7-27ae-4469-8dfd-aa7c218073f5\" (UID: \"276c83e7-27ae-4469-8dfd-aa7c218073f5\") "
Aug 04 18:22:38.351600 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.351597    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/276c83e7-27ae-4469-8dfd-aa7c218073f5-istio-token\") pod \"276c83e7-27ae-4469-8dfd-aa7c218073f5\" (UID: \"276c83e7-27ae-4469-8dfd-aa7c218073f5\") "
Aug 04 18:22:38.351822 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.351625    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/276c83e7-27ae-4469-8dfd-aa7c218073f5-workload-certs\") pod \"276c83e7-27ae-4469-8dfd-aa7c218073f5\" (UID: \"276c83e7-27ae-4469-8dfd-aa7c218073f5\") "
Aug 04 18:22:38.351822 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.351654    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/276c83e7-27ae-4469-8dfd-aa7c218073f5-istio-data\") pod \"276c83e7-27ae-4469-8dfd-aa7c218073f5\" (UID: \"276c83e7-27ae-4469-8dfd-aa7c218073f5\") "
Aug 04 18:22:38.351822 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.351693    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mjgk\" (UniqueName: \"kubernetes.io/projected/276c83e7-27ae-4469-8dfd-aa7c218073f5-kube-api-access-2mjgk\") pod \"276c83e7-27ae-4469-8dfd-aa7c218073f5\" (UID: \"276c83e7-27ae-4469-8dfd-aa7c218073f5\") "
Aug 04 18:22:38.351822 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.351736    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/276c83e7-27ae-4469-8dfd-aa7c218073f5-istio-podinfo\") pod \"276c83e7-27ae-4469-8dfd-aa7c218073f5\" (UID: \"276c83e7-27ae-4469-8dfd-aa7c218073f5\") "
Aug 04 18:22:38.352018 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.351831    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/276c83e7-27ae-4469-8dfd-aa7c218073f5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "276c83e7-27ae-4469-8dfd-aa7c218073f5" (UID: "276c83e7-27ae-4469-8dfd-aa7c218073f5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:22:38.352018 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.351862    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/276c83e7-27ae-4469-8dfd-aa7c218073f5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "276c83e7-27ae-4469-8dfd-aa7c218073f5" (UID: "276c83e7-27ae-4469-8dfd-aa7c218073f5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:22:38.352018 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.351881    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/276c83e7-27ae-4469-8dfd-aa7c218073f5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "276c83e7-27ae-4469-8dfd-aa7c218073f5" (UID: "276c83e7-27ae-4469-8dfd-aa7c218073f5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:22:38.352018 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.351912    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/276c83e7-27ae-4469-8dfd-aa7c218073f5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "276c83e7-27ae-4469-8dfd-aa7c218073f5" (UID: "276c83e7-27ae-4469-8dfd-aa7c218073f5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:22:38.352213 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.352045    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/276c83e7-27ae-4469-8dfd-aa7c218073f5-istio-data" (OuterVolumeSpecName: "istio-data") pod "276c83e7-27ae-4469-8dfd-aa7c218073f5" (UID: "276c83e7-27ae-4469-8dfd-aa7c218073f5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:22:38.352213 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.352056    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/276c83e7-27ae-4469-8dfd-aa7c218073f5-istiod-ca-cert\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:22:38.352213 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.352075    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/276c83e7-27ae-4469-8dfd-aa7c218073f5-workload-socket\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:22:38.352213 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.352089    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/276c83e7-27ae-4469-8dfd-aa7c218073f5-credential-socket\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:22:38.352213 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.352102    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/276c83e7-27ae-4469-8dfd-aa7c218073f5-workload-certs\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:22:38.353922 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.353889    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/276c83e7-27ae-4469-8dfd-aa7c218073f5-istio-token" (OuterVolumeSpecName: "istio-token") pod "276c83e7-27ae-4469-8dfd-aa7c218073f5" (UID: "276c83e7-27ae-4469-8dfd-aa7c218073f5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:22:38.353922 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.353916    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/276c83e7-27ae-4469-8dfd-aa7c218073f5-kube-api-access-2mjgk" (OuterVolumeSpecName: "kube-api-access-2mjgk") pod "276c83e7-27ae-4469-8dfd-aa7c218073f5" (UID: "276c83e7-27ae-4469-8dfd-aa7c218073f5"). InnerVolumeSpecName "kube-api-access-2mjgk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:22:38.354099 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.354018    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/276c83e7-27ae-4469-8dfd-aa7c218073f5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "276c83e7-27ae-4469-8dfd-aa7c218073f5" (UID: "276c83e7-27ae-4469-8dfd-aa7c218073f5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:22:38.354099 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.354076    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/276c83e7-27ae-4469-8dfd-aa7c218073f5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "276c83e7-27ae-4469-8dfd-aa7c218073f5" (UID: "276c83e7-27ae-4469-8dfd-aa7c218073f5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 18:22:38.452940 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.452893    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/276c83e7-27ae-4469-8dfd-aa7c218073f5-istio-envoy\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:22:38.452940 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.452911    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/276c83e7-27ae-4469-8dfd-aa7c218073f5-istio-token\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:22:38.452940 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.452920    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/276c83e7-27ae-4469-8dfd-aa7c218073f5-istio-data\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:22:38.452940 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.452928    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mjgk\" (UniqueName: \"kubernetes.io/projected/276c83e7-27ae-4469-8dfd-aa7c218073f5-kube-api-access-2mjgk\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:22:38.452940 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.452936    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/276c83e7-27ae-4469-8dfd-aa7c218073f5-istio-podinfo\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:22:38.963516 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.963488    2571 generic.go:356] "Generic (PLEG): container finished" podID="276c83e7-27ae-4469-8dfd-aa7c218073f5" containerID="3bf91cb8d9691e3c4186b7dfd9cbc6bb4c9d55e1ade3e79fcedbadc9c59e4e82" exitCode=0
Aug 04 18:22:38.963666 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.963544    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"
Aug 04 18:22:38.963666 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.963551    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc" event={"ID":"276c83e7-27ae-4469-8dfd-aa7c218073f5","Type":"ContainerDied","Data":"3bf91cb8d9691e3c4186b7dfd9cbc6bb4c9d55e1ade3e79fcedbadc9c59e4e82"}
Aug 04 18:22:38.963666 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.963590    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc" event={"ID":"276c83e7-27ae-4469-8dfd-aa7c218073f5","Type":"ContainerDied","Data":"03b6f045823098901cf74c8bbcb4c9d1093e19e0d9866e635e3780cf68164124"}
Aug 04 18:22:38.963666 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.963612    2571 scope.go:117] "RemoveContainer" containerID="3bf91cb8d9691e3c4186b7dfd9cbc6bb4c9d55e1ade3e79fcedbadc9c59e4e82"
Aug 04 18:22:38.972308 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.972292    2571 scope.go:117] "RemoveContainer" containerID="916cfaa9fb175f9cf4a10c540f78e8450916df10d355edb4170a4ba8922b3d38"
Aug 04 18:22:38.979411 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.979397    2571 scope.go:117] "RemoveContainer" containerID="3bf91cb8d9691e3c4186b7dfd9cbc6bb4c9d55e1ade3e79fcedbadc9c59e4e82"
Aug 04 18:22:38.979652 ip-10-0-141-220 kubenswrapper[2571]: E0804 18:22:38.979632    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bf91cb8d9691e3c4186b7dfd9cbc6bb4c9d55e1ade3e79fcedbadc9c59e4e82\": container with ID starting with 3bf91cb8d9691e3c4186b7dfd9cbc6bb4c9d55e1ade3e79fcedbadc9c59e4e82 not found: ID does not exist" containerID="3bf91cb8d9691e3c4186b7dfd9cbc6bb4c9d55e1ade3e79fcedbadc9c59e4e82"
Aug 04 18:22:38.979705 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.979659    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bf91cb8d9691e3c4186b7dfd9cbc6bb4c9d55e1ade3e79fcedbadc9c59e4e82"} err="failed to get container status \"3bf91cb8d9691e3c4186b7dfd9cbc6bb4c9d55e1ade3e79fcedbadc9c59e4e82\": rpc error: code = NotFound desc = could not find container \"3bf91cb8d9691e3c4186b7dfd9cbc6bb4c9d55e1ade3e79fcedbadc9c59e4e82\": container with ID starting with 3bf91cb8d9691e3c4186b7dfd9cbc6bb4c9d55e1ade3e79fcedbadc9c59e4e82 not found: ID does not exist"
Aug 04 18:22:38.979705 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.979674    2571 scope.go:117] "RemoveContainer" containerID="916cfaa9fb175f9cf4a10c540f78e8450916df10d355edb4170a4ba8922b3d38"
Aug 04 18:22:38.979935 ip-10-0-141-220 kubenswrapper[2571]: E0804 18:22:38.979919    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"916cfaa9fb175f9cf4a10c540f78e8450916df10d355edb4170a4ba8922b3d38\": container with ID starting with 916cfaa9fb175f9cf4a10c540f78e8450916df10d355edb4170a4ba8922b3d38 not found: ID does not exist" containerID="916cfaa9fb175f9cf4a10c540f78e8450916df10d355edb4170a4ba8922b3d38"
Aug 04 18:22:38.979989 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.979943    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"916cfaa9fb175f9cf4a10c540f78e8450916df10d355edb4170a4ba8922b3d38"} err="failed to get container status \"916cfaa9fb175f9cf4a10c540f78e8450916df10d355edb4170a4ba8922b3d38\": rpc error: code = NotFound desc = could not find container \"916cfaa9fb175f9cf4a10c540f78e8450916df10d355edb4170a4ba8922b3d38\": container with ID starting with 916cfaa9fb175f9cf4a10c540f78e8450916df10d355edb4170a4ba8922b3d38 not found: ID does not exist"
Aug 04 18:22:38.984374 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.984353    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"]
Aug 04 18:22:38.989940 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:38.989918    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-024faf48-openshift-default-7ffd7b86b4-sgwzc"]
Aug 04 18:22:39.878703 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:22:39.878678    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="276c83e7-27ae-4469-8dfd-aa7c218073f5" path="/var/lib/kubelet/pods/276c83e7-27ae-4469-8dfd-aa7c218073f5/volumes"
Aug 04 18:24:29.994393 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:29.994365    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"]
Aug 04 18:24:29.994822 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:29.994672    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85781cde-2b16-42d4-8113-da1cbfa1c84f" containerName="istio-proxy"
Aug 04 18:24:29.994822 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:29.994685    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="85781cde-2b16-42d4-8113-da1cbfa1c84f" containerName="istio-proxy"
Aug 04 18:24:29.994822 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:29.994700    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="276c83e7-27ae-4469-8dfd-aa7c218073f5" containerName="istio-proxy"
Aug 04 18:24:29.994822 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:29.994705    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="276c83e7-27ae-4469-8dfd-aa7c218073f5" containerName="istio-proxy"
Aug 04 18:24:29.994822 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:29.994759    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="276c83e7-27ae-4469-8dfd-aa7c218073f5" containerName="istio-proxy"
Aug 04 18:24:29.994822 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:29.994766    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="85781cde-2b16-42d4-8113-da1cbfa1c84f" containerName="istio-proxy"
Aug 04 18:24:29.994822 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:29.994772    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="276c83e7-27ae-4469-8dfd-aa7c218073f5" containerName="istio-proxy"
Aug 04 18:24:29.994822 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:29.994779    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="85781cde-2b16-42d4-8113-da1cbfa1c84f" containerName="istio-proxy"
Aug 04 18:24:29.997472 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:29.997453    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:24:29.999611 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:29.999592    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-10e78006-openshift-default-dockercfg-5zvhs\""
Aug 04 18:24:30.017960 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:30.017939    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"]
Aug 04 18:24:30.054145 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:30.054112    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6e26882-57c0-4983-96d8-7cba3716804f-istiod-ca-cert\") pod \"e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74\" (UID: \"c6e26882-57c0-4983-96d8-7cba3716804f\") " pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:24:30.054258 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:30.054174    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6e26882-57c0-4983-96d8-7cba3716804f-workload-socket\") pod \"e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74\" (UID: \"c6e26882-57c0-4983-96d8-7cba3716804f\") " pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:24:30.054258 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:30.054221    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6e26882-57c0-4983-96d8-7cba3716804f-istio-data\") pod \"e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74\" (UID: \"c6e26882-57c0-4983-96d8-7cba3716804f\") " pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:24:30.054258 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:30.054245    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct7mr\" (UniqueName: \"kubernetes.io/projected/c6e26882-57c0-4983-96d8-7cba3716804f-kube-api-access-ct7mr\") pod \"e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74\" (UID: \"c6e26882-57c0-4983-96d8-7cba3716804f\") " pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:24:30.054386 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:30.054305    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6e26882-57c0-4983-96d8-7cba3716804f-credential-socket\") pod \"e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74\" (UID: \"c6e26882-57c0-4983-96d8-7cba3716804f\") " pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:24:30.054386 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:30.054328    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6e26882-57c0-4983-96d8-7cba3716804f-workload-certs\") pod \"e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74\" (UID: \"c6e26882-57c0-4983-96d8-7cba3716804f\") " pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:24:30.054386 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:30.054352    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6e26882-57c0-4983-96d8-7cba3716804f-istio-podinfo\") pod \"e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74\" (UID: \"c6e26882-57c0-4983-96d8-7cba3716804f\") " pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:24:30.054386 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:30.054370    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6e26882-57c0-4983-96d8-7cba3716804f-istio-token\") pod \"e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74\" (UID: \"c6e26882-57c0-4983-96d8-7cba3716804f\") " pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:24:30.054553 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:30.054388    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6e26882-57c0-4983-96d8-7cba3716804f-istio-envoy\") pod \"e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74\" (UID: \"c6e26882-57c0-4983-96d8-7cba3716804f\") " pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:24:30.155710 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:30.155681    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6e26882-57c0-4983-96d8-7cba3716804f-istiod-ca-cert\") pod \"e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74\" (UID: \"c6e26882-57c0-4983-96d8-7cba3716804f\") " pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:24:30.155837 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:30.155729    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6e26882-57c0-4983-96d8-7cba3716804f-workload-socket\") pod \"e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74\" (UID: \"c6e26882-57c0-4983-96d8-7cba3716804f\") " pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:24:30.155837 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:30.155756    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6e26882-57c0-4983-96d8-7cba3716804f-istio-data\") pod \"e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74\" (UID: \"c6e26882-57c0-4983-96d8-7cba3716804f\") " pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:24:30.155837 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:30.155781    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct7mr\" (UniqueName: \"kubernetes.io/projected/c6e26882-57c0-4983-96d8-7cba3716804f-kube-api-access-ct7mr\") pod \"e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74\" (UID: \"c6e26882-57c0-4983-96d8-7cba3716804f\") " pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:24:30.155837 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:30.155821    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6e26882-57c0-4983-96d8-7cba3716804f-credential-socket\") pod \"e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74\" (UID: \"c6e26882-57c0-4983-96d8-7cba3716804f\") " pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:24:30.156038 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:30.155844    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6e26882-57c0-4983-96d8-7cba3716804f-workload-certs\") pod \"e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74\" (UID: \"c6e26882-57c0-4983-96d8-7cba3716804f\") " pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:24:30.156038 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:30.155871    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6e26882-57c0-4983-96d8-7cba3716804f-istio-podinfo\") pod \"e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74\" (UID: \"c6e26882-57c0-4983-96d8-7cba3716804f\") " pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:24:30.156038 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:30.155895    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6e26882-57c0-4983-96d8-7cba3716804f-istio-token\") pod \"e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74\" (UID: \"c6e26882-57c0-4983-96d8-7cba3716804f\") " pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:24:30.156038 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:30.155919    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6e26882-57c0-4983-96d8-7cba3716804f-istio-envoy\") pod \"e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74\" (UID: \"c6e26882-57c0-4983-96d8-7cba3716804f\") " pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:24:30.156276 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:30.156123    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6e26882-57c0-4983-96d8-7cba3716804f-workload-socket\") pod \"e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74\" (UID: \"c6e26882-57c0-4983-96d8-7cba3716804f\") " pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:24:30.156338 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:30.156303    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6e26882-57c0-4983-96d8-7cba3716804f-istio-data\") pod \"e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74\" (UID: \"c6e26882-57c0-4983-96d8-7cba3716804f\") " pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:24:30.156396 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:30.156371    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6e26882-57c0-4983-96d8-7cba3716804f-workload-certs\") pod \"e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74\" (UID: \"c6e26882-57c0-4983-96d8-7cba3716804f\") " pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:24:30.156501 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:30.156481    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6e26882-57c0-4983-96d8-7cba3716804f-credential-socket\") pod \"e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74\" (UID: \"c6e26882-57c0-4983-96d8-7cba3716804f\") " pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:24:30.156597 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:30.156572    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6e26882-57c0-4983-96d8-7cba3716804f-istiod-ca-cert\") pod \"e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74\" (UID: \"c6e26882-57c0-4983-96d8-7cba3716804f\") " pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:24:30.158182 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:30.158165    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6e26882-57c0-4983-96d8-7cba3716804f-istio-envoy\") pod \"e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74\" (UID: \"c6e26882-57c0-4983-96d8-7cba3716804f\") " pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:24:30.158322 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:30.158305    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6e26882-57c0-4983-96d8-7cba3716804f-istio-podinfo\") pod \"e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74\" (UID: \"c6e26882-57c0-4983-96d8-7cba3716804f\") " pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:24:30.178806 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:30.178787    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6e26882-57c0-4983-96d8-7cba3716804f-istio-token\") pod \"e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74\" (UID: \"c6e26882-57c0-4983-96d8-7cba3716804f\") " pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:24:30.178940 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:30.178921    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct7mr\" (UniqueName: \"kubernetes.io/projected/c6e26882-57c0-4983-96d8-7cba3716804f-kube-api-access-ct7mr\") pod \"e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74\" (UID: \"c6e26882-57c0-4983-96d8-7cba3716804f\") " pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:24:30.307065 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:30.307047    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:24:30.440672 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:30.440645    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"]
Aug 04 18:24:30.442669 ip-10-0-141-220 kubenswrapper[2571]: W0804 18:24:30.442644    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6e26882_57c0_4983_96d8_7cba3716804f.slice/crio-d2bfce6df3eb2b4693d15deb67d6be10f8545447ade4b9301d315f24dc4ab986 WatchSource:0}: Error finding container d2bfce6df3eb2b4693d15deb67d6be10f8545447ade4b9301d315f24dc4ab986: Status 404 returned error can't find the container with id d2bfce6df3eb2b4693d15deb67d6be10f8545447ade4b9301d315f24dc4ab986
Aug 04 18:24:30.444707 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:30.444674    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:24:30.444801 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:30.444751    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:24:30.444801 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:30.444794    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:24:31.409575 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:31.409541    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74" event={"ID":"c6e26882-57c0-4983-96d8-7cba3716804f","Type":"ContainerStarted","Data":"b8ef91b630512573c03ec970c8ae23c7c97029ffd37b4734f7de998a7b7d4de2"}
Aug 04 18:24:31.409983 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:31.409617    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74" event={"ID":"c6e26882-57c0-4983-96d8-7cba3716804f","Type":"ContainerStarted","Data":"d2bfce6df3eb2b4693d15deb67d6be10f8545447ade4b9301d315f24dc4ab986"}
Aug 04 18:24:31.430138 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:31.430092    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74" podStartSLOduration=2.430078739 podStartE2EDuration="2.430078739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:24:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:24:31.428304909 +0000 UTC m=+2288.229441261" watchObservedRunningTime="2026-08-04 18:24:31.430078739 +0000 UTC m=+2288.231215117"
Aug 04 18:24:32.308051 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:32.308025    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:24:32.312377 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:32.312354    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:24:32.413607 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:32.413576    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:24:32.414202 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:32.414187    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:24:46.483212 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:46.483141    2571 generic.go:356] "Generic (PLEG): container finished" podID="c6e26882-57c0-4983-96d8-7cba3716804f" containerID="b8ef91b630512573c03ec970c8ae23c7c97029ffd37b4734f7de998a7b7d4de2" exitCode=0
Aug 04 18:24:46.483212 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:46.483203    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74" event={"ID":"c6e26882-57c0-4983-96d8-7cba3716804f","Type":"ContainerDied","Data":"b8ef91b630512573c03ec970c8ae23c7c97029ffd37b4734f7de998a7b7d4de2"}
Aug 04 18:24:46.483627 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:46.483511    2571 scope.go:117] "RemoveContainer" containerID="b8ef91b630512573c03ec970c8ae23c7c97029ffd37b4734f7de998a7b7d4de2"
Aug 04 18:24:46.484488 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:46.484457    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:24:46.484572 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:46.484548    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:24:46.484611 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:46.484581    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:24:47.413712 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:47.413671    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:24:47.492011 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:47.491975    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74" event={"ID":"c6e26882-57c0-4983-96d8-7cba3716804f","Type":"ContainerStarted","Data":"a524047bf11d3f79ac011f95405ed429ac8b50101ed782a8f00fe126d997dae2"}
Aug 04 18:24:48.307485 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:48.307450    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:24:48.308495 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:48.308471    2571 patch_prober.go:28] interesting pod/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Aug 04 18:24:48.308615 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:48.308517    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74" podUID="c6e26882-57c0-4983-96d8-7cba3716804f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Aug 04 18:24:49.307410 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:49.307373    2571 patch_prober.go:28] interesting pod/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Aug 04 18:24:49.307823 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:49.307423    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74" podUID="c6e26882-57c0-4983-96d8-7cba3716804f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Aug 04 18:24:50.307844 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:50.307808    2571 patch_prober.go:28] interesting pod/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Aug 04 18:24:50.308208 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:50.307860    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74" podUID="c6e26882-57c0-4983-96d8-7cba3716804f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Aug 04 18:24:51.307386 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:51.307350    2571 patch_prober.go:28] interesting pod/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Aug 04 18:24:51.307573 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:51.307409    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74" podUID="c6e26882-57c0-4983-96d8-7cba3716804f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Aug 04 18:24:52.308385 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:52.308346    2571 patch_prober.go:28] interesting pod/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Aug 04 18:24:52.308871 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:52.308405    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74" podUID="c6e26882-57c0-4983-96d8-7cba3716804f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Aug 04 18:24:53.311667 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:53.311635    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:24:53.312037 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:53.311872    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:24:53.312614 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:24:53.312596    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:25:05.395130 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:05.395098    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-10e78006-gv9kv"]
Aug 04 18:25:05.395613 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:05.395376    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85781cde-2b16-42d4-8113-da1cbfa1c84f" containerName="istio-proxy"
Aug 04 18:25:05.395613 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:05.395387    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="85781cde-2b16-42d4-8113-da1cbfa1c84f" containerName="istio-proxy"
Aug 04 18:25:05.395613 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:05.395402    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="276c83e7-27ae-4469-8dfd-aa7c218073f5" containerName="istio-proxy"
Aug 04 18:25:05.395613 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:05.395408    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="276c83e7-27ae-4469-8dfd-aa7c218073f5" containerName="istio-proxy"
Aug 04 18:25:05.398340 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:05.398324    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-10e78006-gv9kv"
Aug 04 18:25:05.400705 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:05.400683    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 18:25:05.401025 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:05.401007    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6xvms\""
Aug 04 18:25:05.405058 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:05.405032    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-10e78006-gv9kv"]
Aug 04 18:25:05.525004 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:05.524978    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce419423-6fd8-45b0-85db-85f1b71094d5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-10e78006-gv9kv\" (UID: \"ce419423-6fd8-45b0-85db-85f1b71094d5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-10e78006-gv9kv"
Aug 04 18:25:05.625491 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:05.625467    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce419423-6fd8-45b0-85db-85f1b71094d5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-10e78006-gv9kv\" (UID: \"ce419423-6fd8-45b0-85db-85f1b71094d5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-10e78006-gv9kv"
Aug 04 18:25:05.626108 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:05.626088    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce419423-6fd8-45b0-85db-85f1b71094d5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-10e78006-gv9kv\" (UID: \"ce419423-6fd8-45b0-85db-85f1b71094d5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-10e78006-gv9kv"
Aug 04 18:25:05.710512 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:05.710466    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-10e78006-gv9kv"
Aug 04 18:25:05.832251 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:05.832228    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-10e78006-gv9kv"]
Aug 04 18:25:05.834086 ip-10-0-141-220 kubenswrapper[2571]: W0804 18:25:05.834061    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce419423_6fd8_45b0_85db_85f1b71094d5.slice/crio-0862ee907a1eba2226e96c92a61c837c6f7b5fc7f43cebab39c16fd45ff736e8 WatchSource:0}: Error finding container 0862ee907a1eba2226e96c92a61c837c6f7b5fc7f43cebab39c16fd45ff736e8: Status 404 returned error can't find the container with id 0862ee907a1eba2226e96c92a61c837c6f7b5fc7f43cebab39c16fd45ff736e8
Aug 04 18:25:06.569075 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:06.569043    2571 generic.go:356] "Generic (PLEG): container finished" podID="ce419423-6fd8-45b0-85db-85f1b71094d5" containerID="1eab903e6585eea09e14dc2e8a00af8493fa3752e58c9eb5f7f395fc4acfba27" exitCode=0
Aug 04 18:25:06.569360 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:06.569099    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-10e78006-gv9kv" event={"ID":"ce419423-6fd8-45b0-85db-85f1b71094d5","Type":"ContainerDied","Data":"1eab903e6585eea09e14dc2e8a00af8493fa3752e58c9eb5f7f395fc4acfba27"}
Aug 04 18:25:06.569360 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:06.569150    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-10e78006-gv9kv" event={"ID":"ce419423-6fd8-45b0-85db-85f1b71094d5","Type":"ContainerStarted","Data":"0862ee907a1eba2226e96c92a61c837c6f7b5fc7f43cebab39c16fd45ff736e8"}
Aug 04 18:25:07.696778 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:07.696756    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-10e78006-gv9kv"
Aug 04 18:25:07.841906 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:07.841852    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce419423-6fd8-45b0-85db-85f1b71094d5-maas-api-service-ca\") pod \"ce419423-6fd8-45b0-85db-85f1b71094d5\" (UID: \"ce419423-6fd8-45b0-85db-85f1b71094d5\") "
Aug 04 18:25:07.842187 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:07.842166    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce419423-6fd8-45b0-85db-85f1b71094d5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ce419423-6fd8-45b0-85db-85f1b71094d5" (UID: "ce419423-6fd8-45b0-85db-85f1b71094d5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:25:07.942793 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:07.942773    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce419423-6fd8-45b0-85db-85f1b71094d5-maas-api-service-ca\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:25:08.583732 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:08.583704    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-10e78006-gv9kv"
Aug 04 18:25:08.583893 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:08.583732    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-10e78006-gv9kv" event={"ID":"ce419423-6fd8-45b0-85db-85f1b71094d5","Type":"ContainerDied","Data":"0862ee907a1eba2226e96c92a61c837c6f7b5fc7f43cebab39c16fd45ff736e8"}
Aug 04 18:25:08.583893 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:08.583792    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0862ee907a1eba2226e96c92a61c837c6f7b5fc7f43cebab39c16fd45ff736e8"
Aug 04 18:25:16.075426 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:16.075394    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-10e78006-gv9kv"]
Aug 04 18:25:16.078012 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:16.077988    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-10e78006-gv9kv"]
Aug 04 18:25:17.879165 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:17.879134    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce419423-6fd8-45b0-85db-85f1b71094d5" path="/var/lib/kubelet/pods/ce419423-6fd8-45b0-85db-85f1b71094d5/volumes"
Aug 04 18:25:22.437801 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:22.437765    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"]
Aug 04 18:25:22.438178 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:22.437982    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74" podUID="c6e26882-57c0-4983-96d8-7cba3716804f" containerName="istio-proxy" containerID="cri-o://a524047bf11d3f79ac011f95405ed429ac8b50101ed782a8f00fe126d997dae2" gracePeriod=30
Aug 04 18:25:23.314564 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:23.314534    2571 patch_prober.go:28] interesting pod/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 18:25:23.314726 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:23.314595    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74" podUID="c6e26882-57c0-4983-96d8-7cba3716804f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:25:27.664889 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:27.664847    2571 generic.go:356] "Generic (PLEG): container finished" podID="c6e26882-57c0-4983-96d8-7cba3716804f" containerID="a524047bf11d3f79ac011f95405ed429ac8b50101ed782a8f00fe126d997dae2" exitCode=0
Aug 04 18:25:27.665241 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:27.664890    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74" event={"ID":"c6e26882-57c0-4983-96d8-7cba3716804f","Type":"ContainerDied","Data":"a524047bf11d3f79ac011f95405ed429ac8b50101ed782a8f00fe126d997dae2"}
Aug 04 18:25:27.665241 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:27.664982    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74" event={"ID":"c6e26882-57c0-4983-96d8-7cba3716804f","Type":"ContainerDied","Data":"d2bfce6df3eb2b4693d15deb67d6be10f8545447ade4b9301d315f24dc4ab986"}
Aug 04 18:25:27.665241 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:27.665004    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d2bfce6df3eb2b4693d15deb67d6be10f8545447ade4b9301d315f24dc4ab986"
Aug 04 18:25:27.665241 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:27.665019    2571 scope.go:117] "RemoveContainer" containerID="b8ef91b630512573c03ec970c8ae23c7c97029ffd37b4734f7de998a7b7d4de2"
Aug 04 18:25:27.674127 ip-10-0-141-220 kubenswrapper[2571]: E0804 18:25:27.674110    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8ef91b630512573c03ec970c8ae23c7c97029ffd37b4734f7de998a7b7d4de2\": container with ID starting with b8ef91b630512573c03ec970c8ae23c7c97029ffd37b4734f7de998a7b7d4de2 not found: ID does not exist" containerID="b8ef91b630512573c03ec970c8ae23c7c97029ffd37b4734f7de998a7b7d4de2"
Aug 04 18:25:27.677506 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:27.677489    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:25:27.784557 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:27.784535    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6e26882-57c0-4983-96d8-7cba3716804f-workload-certs\") pod \"c6e26882-57c0-4983-96d8-7cba3716804f\" (UID: \"c6e26882-57c0-4983-96d8-7cba3716804f\") "
Aug 04 18:25:27.784687 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:27.784564    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6e26882-57c0-4983-96d8-7cba3716804f-istio-token\") pod \"c6e26882-57c0-4983-96d8-7cba3716804f\" (UID: \"c6e26882-57c0-4983-96d8-7cba3716804f\") "
Aug 04 18:25:27.784687 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:27.784588    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6e26882-57c0-4983-96d8-7cba3716804f-workload-socket\") pod \"c6e26882-57c0-4983-96d8-7cba3716804f\" (UID: \"c6e26882-57c0-4983-96d8-7cba3716804f\") "
Aug 04 18:25:27.784687 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:27.784604    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ct7mr\" (UniqueName: \"kubernetes.io/projected/c6e26882-57c0-4983-96d8-7cba3716804f-kube-api-access-ct7mr\") pod \"c6e26882-57c0-4983-96d8-7cba3716804f\" (UID: \"c6e26882-57c0-4983-96d8-7cba3716804f\") "
Aug 04 18:25:27.784687 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:27.784626    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6e26882-57c0-4983-96d8-7cba3716804f-istio-data\") pod \"c6e26882-57c0-4983-96d8-7cba3716804f\" (UID: \"c6e26882-57c0-4983-96d8-7cba3716804f\") "
Aug 04 18:25:27.784687 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:27.784657    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6e26882-57c0-4983-96d8-7cba3716804f-istio-envoy\") pod \"c6e26882-57c0-4983-96d8-7cba3716804f\" (UID: \"c6e26882-57c0-4983-96d8-7cba3716804f\") "
Aug 04 18:25:27.784959 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:27.784693    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6e26882-57c0-4983-96d8-7cba3716804f-credential-socket\") pod \"c6e26882-57c0-4983-96d8-7cba3716804f\" (UID: \"c6e26882-57c0-4983-96d8-7cba3716804f\") "
Aug 04 18:25:27.784959 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:27.784758    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6e26882-57c0-4983-96d8-7cba3716804f-istio-podinfo\") pod \"c6e26882-57c0-4983-96d8-7cba3716804f\" (UID: \"c6e26882-57c0-4983-96d8-7cba3716804f\") "
Aug 04 18:25:27.784959 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:27.784788    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6e26882-57c0-4983-96d8-7cba3716804f-istiod-ca-cert\") pod \"c6e26882-57c0-4983-96d8-7cba3716804f\" (UID: \"c6e26882-57c0-4983-96d8-7cba3716804f\") "
Aug 04 18:25:27.784959 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:27.784857    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6e26882-57c0-4983-96d8-7cba3716804f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c6e26882-57c0-4983-96d8-7cba3716804f" (UID: "c6e26882-57c0-4983-96d8-7cba3716804f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:25:27.784959 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:27.784882    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6e26882-57c0-4983-96d8-7cba3716804f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c6e26882-57c0-4983-96d8-7cba3716804f" (UID: "c6e26882-57c0-4983-96d8-7cba3716804f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:25:27.785226 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:27.785037    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6e26882-57c0-4983-96d8-7cba3716804f-workload-certs\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:25:27.785226 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:27.785034    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6e26882-57c0-4983-96d8-7cba3716804f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c6e26882-57c0-4983-96d8-7cba3716804f" (UID: "c6e26882-57c0-4983-96d8-7cba3716804f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:25:27.785226 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:27.785056    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6e26882-57c0-4983-96d8-7cba3716804f-workload-socket\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:25:27.785226 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:27.785175    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6e26882-57c0-4983-96d8-7cba3716804f-istio-data" (OuterVolumeSpecName: "istio-data") pod "c6e26882-57c0-4983-96d8-7cba3716804f" (UID: "c6e26882-57c0-4983-96d8-7cba3716804f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:25:27.785426 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:27.785222    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6e26882-57c0-4983-96d8-7cba3716804f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c6e26882-57c0-4983-96d8-7cba3716804f" (UID: "c6e26882-57c0-4983-96d8-7cba3716804f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:25:27.786758 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:27.786737    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6e26882-57c0-4983-96d8-7cba3716804f-istio-token" (OuterVolumeSpecName: "istio-token") pod "c6e26882-57c0-4983-96d8-7cba3716804f" (UID: "c6e26882-57c0-4983-96d8-7cba3716804f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:25:27.786843 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:27.786795    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6e26882-57c0-4983-96d8-7cba3716804f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c6e26882-57c0-4983-96d8-7cba3716804f" (UID: "c6e26882-57c0-4983-96d8-7cba3716804f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:25:27.786886 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:27.786864    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c6e26882-57c0-4983-96d8-7cba3716804f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c6e26882-57c0-4983-96d8-7cba3716804f" (UID: "c6e26882-57c0-4983-96d8-7cba3716804f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 18:25:27.786886 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:27.786871    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6e26882-57c0-4983-96d8-7cba3716804f-kube-api-access-ct7mr" (OuterVolumeSpecName: "kube-api-access-ct7mr") pod "c6e26882-57c0-4983-96d8-7cba3716804f" (UID: "c6e26882-57c0-4983-96d8-7cba3716804f"). InnerVolumeSpecName "kube-api-access-ct7mr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:25:27.885861 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:27.885841    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6e26882-57c0-4983-96d8-7cba3716804f-istio-podinfo\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:25:27.885945 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:27.885864    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6e26882-57c0-4983-96d8-7cba3716804f-istiod-ca-cert\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:25:27.885945 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:27.885876    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6e26882-57c0-4983-96d8-7cba3716804f-istio-token\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:25:27.885945 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:27.885887    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ct7mr\" (UniqueName: \"kubernetes.io/projected/c6e26882-57c0-4983-96d8-7cba3716804f-kube-api-access-ct7mr\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:25:27.885945 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:27.885900    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6e26882-57c0-4983-96d8-7cba3716804f-istio-data\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:25:27.885945 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:27.885911    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6e26882-57c0-4983-96d8-7cba3716804f-istio-envoy\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:25:27.885945 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:27.885921    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6e26882-57c0-4983-96d8-7cba3716804f-credential-socket\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:25:28.670186 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:28.670161    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"
Aug 04 18:25:28.688283 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:28.688258    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"]
Aug 04 18:25:28.699538 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:28.699496    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-10e78006-openshift-default-5b4d8b9d88-ltz74"]
Aug 04 18:25:29.878650 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:25:29.878622    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6e26882-57c0-4983-96d8-7cba3716804f" path="/var/lib/kubelet/pods/c6e26882-57c0-4983-96d8-7cba3716804f/volumes"
Aug 04 18:27:37.287466 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.287435    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"]
Aug 04 18:27:37.287945 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.287730    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6e26882-57c0-4983-96d8-7cba3716804f" containerName="istio-proxy"
Aug 04 18:27:37.287945 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.287743    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6e26882-57c0-4983-96d8-7cba3716804f" containerName="istio-proxy"
Aug 04 18:27:37.287945 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.287757    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce419423-6fd8-45b0-85db-85f1b71094d5" containerName="revoke-keys"
Aug 04 18:27:37.287945 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.287762    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce419423-6fd8-45b0-85db-85f1b71094d5" containerName="revoke-keys"
Aug 04 18:27:37.287945 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.287813    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6e26882-57c0-4983-96d8-7cba3716804f" containerName="istio-proxy"
Aug 04 18:27:37.287945 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.287821    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6e26882-57c0-4983-96d8-7cba3716804f" containerName="istio-proxy"
Aug 04 18:27:37.287945 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.287827    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce419423-6fd8-45b0-85db-85f1b71094d5" containerName="revoke-keys"
Aug 04 18:27:37.290562 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.290541    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:27:37.292694 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.292674    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-6f0f8ee0-openshift-default-dockercfg-gr8mx\""
Aug 04 18:27:37.303410 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.303389    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"]
Aug 04 18:27:37.357308 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.357284    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf23585-306c-4081-9874-8b494efbdd81-workload-socket\") pod \"e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd\" (UID: \"3cf23585-306c-4081-9874-8b494efbdd81\") " pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:27:37.357408 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.357327    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf23585-306c-4081-9874-8b494efbdd81-credential-socket\") pod \"e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd\" (UID: \"3cf23585-306c-4081-9874-8b494efbdd81\") " pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:27:37.357408 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.357344    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cf23585-306c-4081-9874-8b494efbdd81-istio-token\") pod \"e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd\" (UID: \"3cf23585-306c-4081-9874-8b494efbdd81\") " pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:27:37.357408 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.357368    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cf23585-306c-4081-9874-8b494efbdd81-istio-envoy\") pod \"e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd\" (UID: \"3cf23585-306c-4081-9874-8b494efbdd81\") " pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:27:37.357408 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.357390    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cf23585-306c-4081-9874-8b494efbdd81-istiod-ca-cert\") pod \"e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd\" (UID: \"3cf23585-306c-4081-9874-8b494efbdd81\") " pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:27:37.357408 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.357406    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cf23585-306c-4081-9874-8b494efbdd81-istio-data\") pod \"e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd\" (UID: \"3cf23585-306c-4081-9874-8b494efbdd81\") " pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:27:37.357631 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.357426    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cf23585-306c-4081-9874-8b494efbdd81-istio-podinfo\") pod \"e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd\" (UID: \"3cf23585-306c-4081-9874-8b494efbdd81\") " pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:27:37.357631 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.357443    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cf23585-306c-4081-9874-8b494efbdd81-workload-certs\") pod \"e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd\" (UID: \"3cf23585-306c-4081-9874-8b494efbdd81\") " pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:27:37.357631 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.357474    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk2qh\" (UniqueName: \"kubernetes.io/projected/3cf23585-306c-4081-9874-8b494efbdd81-kube-api-access-nk2qh\") pod \"e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd\" (UID: \"3cf23585-306c-4081-9874-8b494efbdd81\") " pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:27:37.458591 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.458562    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cf23585-306c-4081-9874-8b494efbdd81-istio-podinfo\") pod \"e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd\" (UID: \"3cf23585-306c-4081-9874-8b494efbdd81\") " pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:27:37.458591 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.458597    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cf23585-306c-4081-9874-8b494efbdd81-workload-certs\") pod \"e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd\" (UID: \"3cf23585-306c-4081-9874-8b494efbdd81\") " pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:27:37.458820 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.458615    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk2qh\" (UniqueName: \"kubernetes.io/projected/3cf23585-306c-4081-9874-8b494efbdd81-kube-api-access-nk2qh\") pod \"e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd\" (UID: \"3cf23585-306c-4081-9874-8b494efbdd81\") " pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:27:37.458820 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.458748    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf23585-306c-4081-9874-8b494efbdd81-workload-socket\") pod \"e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd\" (UID: \"3cf23585-306c-4081-9874-8b494efbdd81\") " pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:27:37.458946 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.458833    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf23585-306c-4081-9874-8b494efbdd81-credential-socket\") pod \"e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd\" (UID: \"3cf23585-306c-4081-9874-8b494efbdd81\") " pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:27:37.458946 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.458859    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cf23585-306c-4081-9874-8b494efbdd81-istio-token\") pod \"e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd\" (UID: \"3cf23585-306c-4081-9874-8b494efbdd81\") " pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:27:37.458946 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.458904    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cf23585-306c-4081-9874-8b494efbdd81-istio-envoy\") pod \"e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd\" (UID: \"3cf23585-306c-4081-9874-8b494efbdd81\") " pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:27:37.459115 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.458947    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cf23585-306c-4081-9874-8b494efbdd81-istiod-ca-cert\") pod \"e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd\" (UID: \"3cf23585-306c-4081-9874-8b494efbdd81\") " pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:27:37.459115 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.458956    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cf23585-306c-4081-9874-8b494efbdd81-workload-certs\") pod \"e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd\" (UID: \"3cf23585-306c-4081-9874-8b494efbdd81\") " pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:27:37.459115 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.458975    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cf23585-306c-4081-9874-8b494efbdd81-istio-data\") pod \"e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd\" (UID: \"3cf23585-306c-4081-9874-8b494efbdd81\") " pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:27:37.459115 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.459093    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf23585-306c-4081-9874-8b494efbdd81-workload-socket\") pod \"e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd\" (UID: \"3cf23585-306c-4081-9874-8b494efbdd81\") " pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:27:37.459389 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.459169    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf23585-306c-4081-9874-8b494efbdd81-credential-socket\") pod \"e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd\" (UID: \"3cf23585-306c-4081-9874-8b494efbdd81\") " pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:27:37.459389 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.459303    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cf23585-306c-4081-9874-8b494efbdd81-istio-data\") pod \"e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd\" (UID: \"3cf23585-306c-4081-9874-8b494efbdd81\") " pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:27:37.459576 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.459559    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cf23585-306c-4081-9874-8b494efbdd81-istiod-ca-cert\") pod \"e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd\" (UID: \"3cf23585-306c-4081-9874-8b494efbdd81\") " pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:27:37.461132 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.461113    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cf23585-306c-4081-9874-8b494efbdd81-istio-envoy\") pod \"e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd\" (UID: \"3cf23585-306c-4081-9874-8b494efbdd81\") " pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:27:37.461203 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.461146    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cf23585-306c-4081-9874-8b494efbdd81-istio-podinfo\") pod \"e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd\" (UID: \"3cf23585-306c-4081-9874-8b494efbdd81\") " pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:27:37.465855 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.465836    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cf23585-306c-4081-9874-8b494efbdd81-istio-token\") pod \"e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd\" (UID: \"3cf23585-306c-4081-9874-8b494efbdd81\") " pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:27:37.466014 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.465998    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk2qh\" (UniqueName: \"kubernetes.io/projected/3cf23585-306c-4081-9874-8b494efbdd81-kube-api-access-nk2qh\") pod \"e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd\" (UID: \"3cf23585-306c-4081-9874-8b494efbdd81\") " pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:27:37.600975 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.600924    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:27:37.724443 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.724417    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"]
Aug 04 18:27:37.727091 ip-10-0-141-220 kubenswrapper[2571]: W0804 18:27:37.727063    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cf23585_306c_4081_9874_8b494efbdd81.slice/crio-9bc377d4a7091d603e338a705b93cc21064a3c4d4433971d2894bb4f28d2878b WatchSource:0}: Error finding container 9bc377d4a7091d603e338a705b93cc21064a3c4d4433971d2894bb4f28d2878b: Status 404 returned error can't find the container with id 9bc377d4a7091d603e338a705b93cc21064a3c4d4433971d2894bb4f28d2878b
Aug 04 18:27:37.729619 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.729585    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:27:37.729725 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.729647    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:27:37.729725 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:37.729673    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:27:38.184110 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:38.184076    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd" event={"ID":"3cf23585-306c-4081-9874-8b494efbdd81","Type":"ContainerStarted","Data":"3598cadf446983e0c14ff240a61551ab18beb0581e055f10bb91568eb01e41fd"}
Aug 04 18:27:38.184256 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:38.184126    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd" event={"ID":"3cf23585-306c-4081-9874-8b494efbdd81","Type":"ContainerStarted","Data":"9bc377d4a7091d603e338a705b93cc21064a3c4d4433971d2894bb4f28d2878b"}
Aug 04 18:27:38.201959 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:38.201913    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd" podStartSLOduration=1.201899836 podStartE2EDuration="1.201899836s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:27:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:27:38.200573053 +0000 UTC m=+2475.001709407" watchObservedRunningTime="2026-08-04 18:27:38.201899836 +0000 UTC m=+2475.003036163"
Aug 04 18:27:38.602035 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:38.602009    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:27:38.606610 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:38.606589    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:27:39.188807 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:39.188782    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:27:39.189476 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:39.189459    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:27:54.390289 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:54.390245    2571 patch_prober.go:28] interesting pod/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": read tcp 10.132.0.2:35462->10.132.0.35:15021: read: connection reset by peer" start-of-body=
Aug 04 18:27:54.390737 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:54.390470    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd" podUID="3cf23585-306c-4081-9874-8b494efbdd81" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": read tcp 10.132.0.2:35462->10.132.0.35:15021: read: connection reset by peer"
Aug 04 18:27:55.265531 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:55.265492    2571 generic.go:356] "Generic (PLEG): container finished" podID="3cf23585-306c-4081-9874-8b494efbdd81" containerID="3598cadf446983e0c14ff240a61551ab18beb0581e055f10bb91568eb01e41fd" exitCode=0
Aug 04 18:27:55.265678 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:55.265563    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd" event={"ID":"3cf23585-306c-4081-9874-8b494efbdd81","Type":"ContainerDied","Data":"3598cadf446983e0c14ff240a61551ab18beb0581e055f10bb91568eb01e41fd"}
Aug 04 18:27:55.265898 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:55.265884    2571 scope.go:117] "RemoveContainer" containerID="3598cadf446983e0c14ff240a61551ab18beb0581e055f10bb91568eb01e41fd"
Aug 04 18:27:55.266740 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:55.266714    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:27:55.266846 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:55.266775    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:27:55.266846 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:55.266807    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:27:56.271684 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:56.271647    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd" event={"ID":"3cf23585-306c-4081-9874-8b494efbdd81","Type":"ContainerStarted","Data":"f221bf532fc76de1dca2d2357672c69a6692090069d4e82adfe9c258c55441ae"}
Aug 04 18:27:56.601149 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:56.601108    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:27:56.601365 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:56.601342    2571 patch_prober.go:28] interesting pod/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Aug 04 18:27:56.601473 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:56.601393    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd" podUID="3cf23585-306c-4081-9874-8b494efbdd81" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Aug 04 18:27:57.601953 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:57.601919    2571 patch_prober.go:28] interesting pod/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Aug 04 18:27:57.602335 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:57.601968    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd" podUID="3cf23585-306c-4081-9874-8b494efbdd81" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Aug 04 18:27:58.601819 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:58.601782    2571 patch_prober.go:28] interesting pod/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Aug 04 18:27:58.602016 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:58.601854    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd" podUID="3cf23585-306c-4081-9874-8b494efbdd81" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Aug 04 18:27:59.601466 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:59.601420    2571 patch_prober.go:28] interesting pod/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Aug 04 18:27:59.601667 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:27:59.601478    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd" podUID="3cf23585-306c-4081-9874-8b494efbdd81" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Aug 04 18:28:00.601791 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:00.601757    2571 patch_prober.go:28] interesting pod/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Aug 04 18:28:00.602170 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:00.601812    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd" podUID="3cf23585-306c-4081-9874-8b494efbdd81" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Aug 04 18:28:01.604309 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:01.604277    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:28:01.604761 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:01.604540    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:28:01.605047 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:01.605032    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:28:11.375536 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:11.375497    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7"]
Aug 04 18:28:11.376115 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:11.375957    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6e26882-57c0-4983-96d8-7cba3716804f" containerName="istio-proxy"
Aug 04 18:28:11.376115 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:11.375975    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6e26882-57c0-4983-96d8-7cba3716804f" containerName="istio-proxy"
Aug 04 18:28:11.378906 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:11.378886    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7"
Aug 04 18:28:11.381985 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:11.381960    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-6f0f8ee0\"/\"kube-root-ca.crt\""
Aug 04 18:28:11.382111 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:11.381972    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-6f0f8ee0\"/\"default-dockercfg-jsvph\""
Aug 04 18:28:11.382111 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:11.382007    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-6f0f8ee0\"/\"openshift-service-ca.crt\""
Aug 04 18:28:11.382236 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:11.382107    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-6f0f8ee0\"/\"e2e-lifecycle-model-6f0f8ee0-kserve-self-signed-certs\""
Aug 04 18:28:11.388622 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:11.388602    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7"]
Aug 04 18:28:11.514280 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:11.514253    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46a372f4-3de0-4790-b4bb-234758030a0f-tmp-dir\") pod \"e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7\" (UID: \"46a372f4-3de0-4790-b4bb-234758030a0f\") " pod="ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7"
Aug 04 18:28:11.514444 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:11.514284    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pmnj\" (UniqueName: \"kubernetes.io/projected/46a372f4-3de0-4790-b4bb-234758030a0f-kube-api-access-6pmnj\") pod \"e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7\" (UID: \"46a372f4-3de0-4790-b4bb-234758030a0f\") " pod="ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7"
Aug 04 18:28:11.514444 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:11.514321    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46a372f4-3de0-4790-b4bb-234758030a0f-home\") pod \"e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7\" (UID: \"46a372f4-3de0-4790-b4bb-234758030a0f\") " pod="ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7"
Aug 04 18:28:11.514444 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:11.514381    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46a372f4-3de0-4790-b4bb-234758030a0f-dshm\") pod \"e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7\" (UID: \"46a372f4-3de0-4790-b4bb-234758030a0f\") " pod="ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7"
Aug 04 18:28:11.514628 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:11.514445    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46a372f4-3de0-4790-b4bb-234758030a0f-tls-certs\") pod \"e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7\" (UID: \"46a372f4-3de0-4790-b4bb-234758030a0f\") " pod="ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7"
Aug 04 18:28:11.514628 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:11.514475    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46a372f4-3de0-4790-b4bb-234758030a0f-model-cache\") pod \"e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7\" (UID: \"46a372f4-3de0-4790-b4bb-234758030a0f\") " pod="ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7"
Aug 04 18:28:11.615716 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:11.615692    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46a372f4-3de0-4790-b4bb-234758030a0f-home\") pod \"e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7\" (UID: \"46a372f4-3de0-4790-b4bb-234758030a0f\") " pod="ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7"
Aug 04 18:28:11.615830 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:11.615718    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46a372f4-3de0-4790-b4bb-234758030a0f-dshm\") pod \"e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7\" (UID: \"46a372f4-3de0-4790-b4bb-234758030a0f\") " pod="ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7"
Aug 04 18:28:11.615830 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:11.615736    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46a372f4-3de0-4790-b4bb-234758030a0f-tls-certs\") pod \"e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7\" (UID: \"46a372f4-3de0-4790-b4bb-234758030a0f\") " pod="ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7"
Aug 04 18:28:11.615830 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:11.615755    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46a372f4-3de0-4790-b4bb-234758030a0f-model-cache\") pod \"e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7\" (UID: \"46a372f4-3de0-4790-b4bb-234758030a0f\") " pod="ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7"
Aug 04 18:28:11.615830 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:11.615799    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46a372f4-3de0-4790-b4bb-234758030a0f-tmp-dir\") pod \"e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7\" (UID: \"46a372f4-3de0-4790-b4bb-234758030a0f\") " pod="ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7"
Aug 04 18:28:11.616038 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:11.615832    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pmnj\" (UniqueName: \"kubernetes.io/projected/46a372f4-3de0-4790-b4bb-234758030a0f-kube-api-access-6pmnj\") pod \"e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7\" (UID: \"46a372f4-3de0-4790-b4bb-234758030a0f\") " pod="ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7"
Aug 04 18:28:11.616222 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:11.616196    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46a372f4-3de0-4790-b4bb-234758030a0f-tmp-dir\") pod \"e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7\" (UID: \"46a372f4-3de0-4790-b4bb-234758030a0f\") " pod="ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7"
Aug 04 18:28:11.616309 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:11.616223    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46a372f4-3de0-4790-b4bb-234758030a0f-model-cache\") pod \"e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7\" (UID: \"46a372f4-3de0-4790-b4bb-234758030a0f\") " pod="ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7"
Aug 04 18:28:11.616309 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:11.616294    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46a372f4-3de0-4790-b4bb-234758030a0f-home\") pod \"e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7\" (UID: \"46a372f4-3de0-4790-b4bb-234758030a0f\") " pod="ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7"
Aug 04 18:28:11.617955 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:11.617931    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46a372f4-3de0-4790-b4bb-234758030a0f-dshm\") pod \"e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7\" (UID: \"46a372f4-3de0-4790-b4bb-234758030a0f\") " pod="ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7"
Aug 04 18:28:11.618204 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:11.618186    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46a372f4-3de0-4790-b4bb-234758030a0f-tls-certs\") pod \"e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7\" (UID: \"46a372f4-3de0-4790-b4bb-234758030a0f\") " pod="ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7"
Aug 04 18:28:11.622705 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:11.622683    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pmnj\" (UniqueName: \"kubernetes.io/projected/46a372f4-3de0-4790-b4bb-234758030a0f-kube-api-access-6pmnj\") pod \"e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7\" (UID: \"46a372f4-3de0-4790-b4bb-234758030a0f\") " pod="ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7"
Aug 04 18:28:11.689672 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:11.689623    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7"
Aug 04 18:28:11.812909 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:11.812832    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7"]
Aug 04 18:28:11.815341 ip-10-0-141-220 kubenswrapper[2571]: W0804 18:28:11.815308    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46a372f4_3de0_4790_b4bb_234758030a0f.slice/crio-74e538c04a758f8166bcad42c19f9fe5809b646ded9cfc47df0613fc55789dd6 WatchSource:0}: Error finding container 74e538c04a758f8166bcad42c19f9fe5809b646ded9cfc47df0613fc55789dd6: Status 404 returned error can't find the container with id 74e538c04a758f8166bcad42c19f9fe5809b646ded9cfc47df0613fc55789dd6
Aug 04 18:28:12.337149 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:12.337119    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7" event={"ID":"46a372f4-3de0-4790-b4bb-234758030a0f","Type":"ContainerStarted","Data":"87da693c1590c4868e9734ca8a4aa2b5395ea471e781a93c169bdde6550ff332"}
Aug 04 18:28:12.337308 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:12.337160    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7" event={"ID":"46a372f4-3de0-4790-b4bb-234758030a0f","Type":"ContainerStarted","Data":"74e538c04a758f8166bcad42c19f9fe5809b646ded9cfc47df0613fc55789dd6"}
Aug 04 18:28:12.353669 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:12.353622    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7" podStartSLOduration=1.353608658 podStartE2EDuration="1.353608658s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:28:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:28:12.351833229 +0000 UTC m=+2509.152969570" watchObservedRunningTime="2026-08-04 18:28:12.353608658 +0000 UTC m=+2509.154744982"
Aug 04 18:28:21.690349 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:21.690255    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7"
Aug 04 18:28:21.690349 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:21.690303    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7"
Aug 04 18:28:21.702538 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:21.702502    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7"
Aug 04 18:28:22.388004 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:22.387979    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7"
Aug 04 18:28:23.861965 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:28:23.861936    2571 scope.go:117] "RemoveContainer" containerID="db6e3e67a14915c427c43d488b8f1cf2407b5c298e23ebe17e1b251c80dd4ebf"
Aug 04 18:29:13.090926 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:29:13.090893    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7"]
Aug 04 18:29:28.109416 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:29:28.109357    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7" podUID="46a372f4-3de0-4790-b4bb-234758030a0f" containerName="main" containerID="cri-o://87da693c1590c4868e9734ca8a4aa2b5395ea471e781a93c169bdde6550ff332" gracePeriod=45
Aug 04 18:29:28.346906 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:29:28.346882    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7"
Aug 04 18:29:28.461947 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:29:28.461885    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46a372f4-3de0-4790-b4bb-234758030a0f-tmp-dir\") pod \"46a372f4-3de0-4790-b4bb-234758030a0f\" (UID: \"46a372f4-3de0-4790-b4bb-234758030a0f\") "
Aug 04 18:29:28.461947 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:29:28.461914    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46a372f4-3de0-4790-b4bb-234758030a0f-dshm\") pod \"46a372f4-3de0-4790-b4bb-234758030a0f\" (UID: \"46a372f4-3de0-4790-b4bb-234758030a0f\") "
Aug 04 18:29:28.461947 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:29:28.461938    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pmnj\" (UniqueName: \"kubernetes.io/projected/46a372f4-3de0-4790-b4bb-234758030a0f-kube-api-access-6pmnj\") pod \"46a372f4-3de0-4790-b4bb-234758030a0f\" (UID: \"46a372f4-3de0-4790-b4bb-234758030a0f\") "
Aug 04 18:29:28.462141 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:29:28.461990    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46a372f4-3de0-4790-b4bb-234758030a0f-home\") pod \"46a372f4-3de0-4790-b4bb-234758030a0f\" (UID: \"46a372f4-3de0-4790-b4bb-234758030a0f\") "
Aug 04 18:29:28.462141 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:29:28.462012    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46a372f4-3de0-4790-b4bb-234758030a0f-tls-certs\") pod \"46a372f4-3de0-4790-b4bb-234758030a0f\" (UID: \"46a372f4-3de0-4790-b4bb-234758030a0f\") "
Aug 04 18:29:28.462141 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:29:28.462034    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46a372f4-3de0-4790-b4bb-234758030a0f-model-cache\") pod \"46a372f4-3de0-4790-b4bb-234758030a0f\" (UID: \"46a372f4-3de0-4790-b4bb-234758030a0f\") "
Aug 04 18:29:28.462297 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:29:28.462163    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46a372f4-3de0-4790-b4bb-234758030a0f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "46a372f4-3de0-4790-b4bb-234758030a0f" (UID: "46a372f4-3de0-4790-b4bb-234758030a0f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:29:28.462297 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:29:28.462267    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46a372f4-3de0-4790-b4bb-234758030a0f-home" (OuterVolumeSpecName: "home") pod "46a372f4-3de0-4790-b4bb-234758030a0f" (UID: "46a372f4-3de0-4790-b4bb-234758030a0f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:29:28.462410 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:29:28.462335    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46a372f4-3de0-4790-b4bb-234758030a0f-home\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:29:28.462410 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:29:28.462352    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46a372f4-3de0-4790-b4bb-234758030a0f-tmp-dir\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:29:28.462410 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:29:28.462373    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46a372f4-3de0-4790-b4bb-234758030a0f-model-cache" (OuterVolumeSpecName: "model-cache") pod "46a372f4-3de0-4790-b4bb-234758030a0f" (UID: "46a372f4-3de0-4790-b4bb-234758030a0f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:29:28.464073 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:29:28.464041    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46a372f4-3de0-4790-b4bb-234758030a0f-kube-api-access-6pmnj" (OuterVolumeSpecName: "kube-api-access-6pmnj") pod "46a372f4-3de0-4790-b4bb-234758030a0f" (UID: "46a372f4-3de0-4790-b4bb-234758030a0f"). InnerVolumeSpecName "kube-api-access-6pmnj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:29:28.464073 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:29:28.464061    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46a372f4-3de0-4790-b4bb-234758030a0f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "46a372f4-3de0-4790-b4bb-234758030a0f" (UID: "46a372f4-3de0-4790-b4bb-234758030a0f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:29:28.464210 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:29:28.464114    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46a372f4-3de0-4790-b4bb-234758030a0f-dshm" (OuterVolumeSpecName: "dshm") pod "46a372f4-3de0-4790-b4bb-234758030a0f" (UID: "46a372f4-3de0-4790-b4bb-234758030a0f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:29:28.562966 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:29:28.562945    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46a372f4-3de0-4790-b4bb-234758030a0f-dshm\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:29:28.562966 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:29:28.562965    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pmnj\" (UniqueName: \"kubernetes.io/projected/46a372f4-3de0-4790-b4bb-234758030a0f-kube-api-access-6pmnj\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:29:28.563101 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:29:28.562975    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46a372f4-3de0-4790-b4bb-234758030a0f-tls-certs\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:29:28.563101 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:29:28.562984    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46a372f4-3de0-4790-b4bb-234758030a0f-model-cache\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:29:28.648102 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:29:28.648077    2571 generic.go:356] "Generic (PLEG): container finished" podID="46a372f4-3de0-4790-b4bb-234758030a0f" containerID="87da693c1590c4868e9734ca8a4aa2b5395ea471e781a93c169bdde6550ff332" exitCode=0
Aug 04 18:29:28.648196 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:29:28.648116    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7"
Aug 04 18:29:28.648242 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:29:28.648116    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7" event={"ID":"46a372f4-3de0-4790-b4bb-234758030a0f","Type":"ContainerDied","Data":"87da693c1590c4868e9734ca8a4aa2b5395ea471e781a93c169bdde6550ff332"}
Aug 04 18:29:28.648287 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:29:28.648239    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7" event={"ID":"46a372f4-3de0-4790-b4bb-234758030a0f","Type":"ContainerDied","Data":"74e538c04a758f8166bcad42c19f9fe5809b646ded9cfc47df0613fc55789dd6"}
Aug 04 18:29:28.648287 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:29:28.648261    2571 scope.go:117] "RemoveContainer" containerID="87da693c1590c4868e9734ca8a4aa2b5395ea471e781a93c169bdde6550ff332"
Aug 04 18:29:28.656288 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:29:28.656271    2571 scope.go:117] "RemoveContainer" containerID="87da693c1590c4868e9734ca8a4aa2b5395ea471e781a93c169bdde6550ff332"
Aug 04 18:29:28.656556 ip-10-0-141-220 kubenswrapper[2571]: E0804 18:29:28.656515    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87da693c1590c4868e9734ca8a4aa2b5395ea471e781a93c169bdde6550ff332\": container with ID starting with 87da693c1590c4868e9734ca8a4aa2b5395ea471e781a93c169bdde6550ff332 not found: ID does not exist" containerID="87da693c1590c4868e9734ca8a4aa2b5395ea471e781a93c169bdde6550ff332"
Aug 04 18:29:28.656629 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:29:28.656569    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87da693c1590c4868e9734ca8a4aa2b5395ea471e781a93c169bdde6550ff332"} err="failed to get container status \"87da693c1590c4868e9734ca8a4aa2b5395ea471e781a93c169bdde6550ff332\": rpc error: code = NotFound desc = could not find container \"87da693c1590c4868e9734ca8a4aa2b5395ea471e781a93c169bdde6550ff332\": container with ID starting with 87da693c1590c4868e9734ca8a4aa2b5395ea471e781a93c169bdde6550ff332 not found: ID does not exist"
Aug 04 18:29:28.668094 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:29:28.668075    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7"]
Aug 04 18:29:28.671471 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:29:28.671452    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-6f0f8ee0/e2e-lifecycle-model-6f0f8ee0-kserve-8865c9cc9-z92c7"]
Aug 04 18:29:29.879668 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:29:29.879634    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46a372f4-3de0-4790-b4bb-234758030a0f" path="/var/lib/kubelet/pods/46a372f4-3de0-4790-b4bb-234758030a0f/volumes"
Aug 04 18:29:55.907922 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:29:55.907839    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"]
Aug 04 18:29:55.908507 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:29:55.908041    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd" podUID="3cf23585-306c-4081-9874-8b494efbdd81" containerName="istio-proxy" containerID="cri-o://f221bf532fc76de1dca2d2357672c69a6692090069d4e82adfe9c258c55441ae" gracePeriod=30
Aug 04 18:30:00.129323 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:00.129286    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764470-gnn2h"]
Aug 04 18:30:00.129757 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:00.129599    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46a372f4-3de0-4790-b4bb-234758030a0f" containerName="main"
Aug 04 18:30:00.129757 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:00.129610    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="46a372f4-3de0-4790-b4bb-234758030a0f" containerName="main"
Aug 04 18:30:00.129757 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:00.129657    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="46a372f4-3de0-4790-b4bb-234758030a0f" containerName="main"
Aug 04 18:30:00.132291 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:00.132271    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764470-gnn2h"
Aug 04 18:30:00.134381 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:00.134363    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6xvms\""
Aug 04 18:30:00.138383 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:00.138356    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764470-gnn2h"]
Aug 04 18:30:00.142970 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:00.142949    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764470-gnn2h"
Aug 04 18:30:00.263779 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:00.263757    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764470-gnn2h"]
Aug 04 18:30:00.265972 ip-10-0-141-220 kubenswrapper[2571]: W0804 18:30:00.265947    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04bb1a44_d38f_456a_98a2_08c09bd0da33.slice/crio-ccfd9a06207a2e9e0a53ae021fc73f70cc2edcb432dcbd2a1090226834326915 WatchSource:0}: Error finding container ccfd9a06207a2e9e0a53ae021fc73f70cc2edcb432dcbd2a1090226834326915: Status 404 returned error can't find the container with id ccfd9a06207a2e9e0a53ae021fc73f70cc2edcb432dcbd2a1090226834326915
Aug 04 18:30:00.783317 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:00.783283    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764470-gnn2h" event={"ID":"04bb1a44-d38f-456a-98a2-08c09bd0da33","Type":"ContainerStarted","Data":"12b463c7bea5788d19a33115635a31b7a5e17b97f94b2ee45e894ece70aec4ae"}
Aug 04 18:30:00.783453 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:00.783342    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764470-gnn2h" event={"ID":"04bb1a44-d38f-456a-98a2-08c09bd0da33","Type":"ContainerStarted","Data":"ccfd9a06207a2e9e0a53ae021fc73f70cc2edcb432dcbd2a1090226834326915"}
Aug 04 18:30:00.796697 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:00.796647    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764470-gnn2h" podStartSLOduration=0.796633515 podStartE2EDuration="796.633515ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:30:00.795407401 +0000 UTC m=+2617.596543728" watchObservedRunningTime="2026-08-04 18:30:00.796633515 +0000 UTC m=+2617.597769865"
Aug 04 18:30:01.138096 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.138073    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:30:01.198936 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.198913    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cf23585-306c-4081-9874-8b494efbdd81-istio-data\") pod \"3cf23585-306c-4081-9874-8b494efbdd81\" (UID: \"3cf23585-306c-4081-9874-8b494efbdd81\") "
Aug 04 18:30:01.199078 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.198945    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf23585-306c-4081-9874-8b494efbdd81-credential-socket\") pod \"3cf23585-306c-4081-9874-8b494efbdd81\" (UID: \"3cf23585-306c-4081-9874-8b494efbdd81\") "
Aug 04 18:30:01.199078 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.198964    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nk2qh\" (UniqueName: \"kubernetes.io/projected/3cf23585-306c-4081-9874-8b494efbdd81-kube-api-access-nk2qh\") pod \"3cf23585-306c-4081-9874-8b494efbdd81\" (UID: \"3cf23585-306c-4081-9874-8b494efbdd81\") "
Aug 04 18:30:01.199078 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.198992    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cf23585-306c-4081-9874-8b494efbdd81-istio-envoy\") pod \"3cf23585-306c-4081-9874-8b494efbdd81\" (UID: \"3cf23585-306c-4081-9874-8b494efbdd81\") "
Aug 04 18:30:01.199078 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.199031    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cf23585-306c-4081-9874-8b494efbdd81-workload-certs\") pod \"3cf23585-306c-4081-9874-8b494efbdd81\" (UID: \"3cf23585-306c-4081-9874-8b494efbdd81\") "
Aug 04 18:30:01.199078 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.199072    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cf23585-306c-4081-9874-8b494efbdd81-istiod-ca-cert\") pod \"3cf23585-306c-4081-9874-8b494efbdd81\" (UID: \"3cf23585-306c-4081-9874-8b494efbdd81\") "
Aug 04 18:30:01.199343 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.199089    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf23585-306c-4081-9874-8b494efbdd81-workload-socket\") pod \"3cf23585-306c-4081-9874-8b494efbdd81\" (UID: \"3cf23585-306c-4081-9874-8b494efbdd81\") "
Aug 04 18:30:01.199343 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.199113    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cf23585-306c-4081-9874-8b494efbdd81-istio-token\") pod \"3cf23585-306c-4081-9874-8b494efbdd81\" (UID: \"3cf23585-306c-4081-9874-8b494efbdd81\") "
Aug 04 18:30:01.199343 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.199157    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cf23585-306c-4081-9874-8b494efbdd81-istio-podinfo\") pod \"3cf23585-306c-4081-9874-8b494efbdd81\" (UID: \"3cf23585-306c-4081-9874-8b494efbdd81\") "
Aug 04 18:30:01.199343 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.199228    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cf23585-306c-4081-9874-8b494efbdd81-istio-data" (OuterVolumeSpecName: "istio-data") pod "3cf23585-306c-4081-9874-8b494efbdd81" (UID: "3cf23585-306c-4081-9874-8b494efbdd81"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:30:01.199585 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.199335    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cf23585-306c-4081-9874-8b494efbdd81-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3cf23585-306c-4081-9874-8b494efbdd81" (UID: "3cf23585-306c-4081-9874-8b494efbdd81"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:30:01.199585 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.199408    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cf23585-306c-4081-9874-8b494efbdd81-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3cf23585-306c-4081-9874-8b494efbdd81" (UID: "3cf23585-306c-4081-9874-8b494efbdd81"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:30:01.199585 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.199413    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cf23585-306c-4081-9874-8b494efbdd81-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3cf23585-306c-4081-9874-8b494efbdd81" (UID: "3cf23585-306c-4081-9874-8b494efbdd81"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:30:01.199585 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.199471    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cf23585-306c-4081-9874-8b494efbdd81-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3cf23585-306c-4081-9874-8b494efbdd81" (UID: "3cf23585-306c-4081-9874-8b494efbdd81"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:30:01.199585 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.199504    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cf23585-306c-4081-9874-8b494efbdd81-workload-certs\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:30:01.199585 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.199547    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cf23585-306c-4081-9874-8b494efbdd81-istiod-ca-cert\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:30:01.199585 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.199562    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf23585-306c-4081-9874-8b494efbdd81-workload-socket\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:30:01.199585 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.199574    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cf23585-306c-4081-9874-8b494efbdd81-istio-data\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:30:01.201126 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.201100    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cf23585-306c-4081-9874-8b494efbdd81-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3cf23585-306c-4081-9874-8b494efbdd81" (UID: "3cf23585-306c-4081-9874-8b494efbdd81"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:30:01.201224 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.201177    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3cf23585-306c-4081-9874-8b494efbdd81-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3cf23585-306c-4081-9874-8b494efbdd81" (UID: "3cf23585-306c-4081-9874-8b494efbdd81"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 18:30:01.201515 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.201494    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cf23585-306c-4081-9874-8b494efbdd81-kube-api-access-nk2qh" (OuterVolumeSpecName: "kube-api-access-nk2qh") pod "3cf23585-306c-4081-9874-8b494efbdd81" (UID: "3cf23585-306c-4081-9874-8b494efbdd81"). InnerVolumeSpecName "kube-api-access-nk2qh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:30:01.201602 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.201565    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cf23585-306c-4081-9874-8b494efbdd81-istio-token" (OuterVolumeSpecName: "istio-token") pod "3cf23585-306c-4081-9874-8b494efbdd81" (UID: "3cf23585-306c-4081-9874-8b494efbdd81"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:30:01.300180 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.300125    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cf23585-306c-4081-9874-8b494efbdd81-istio-token\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:30:01.300180 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.300152    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cf23585-306c-4081-9874-8b494efbdd81-istio-podinfo\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:30:01.300180 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.300161    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf23585-306c-4081-9874-8b494efbdd81-credential-socket\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:30:01.300180 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.300170    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nk2qh\" (UniqueName: \"kubernetes.io/projected/3cf23585-306c-4081-9874-8b494efbdd81-kube-api-access-nk2qh\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:30:01.300180 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.300179    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cf23585-306c-4081-9874-8b494efbdd81-istio-envoy\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:30:01.789095 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.789068    2571 generic.go:356] "Generic (PLEG): container finished" podID="3cf23585-306c-4081-9874-8b494efbdd81" containerID="f221bf532fc76de1dca2d2357672c69a6692090069d4e82adfe9c258c55441ae" exitCode=0
Aug 04 18:30:01.789210 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.789187    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd" event={"ID":"3cf23585-306c-4081-9874-8b494efbdd81","Type":"ContainerDied","Data":"f221bf532fc76de1dca2d2357672c69a6692090069d4e82adfe9c258c55441ae"}
Aug 04 18:30:01.789266 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.789233    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd" event={"ID":"3cf23585-306c-4081-9874-8b494efbdd81","Type":"ContainerDied","Data":"9bc377d4a7091d603e338a705b93cc21064a3c4d4433971d2894bb4f28d2878b"}
Aug 04 18:30:01.789266 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.789256    2571 scope.go:117] "RemoveContainer" containerID="f221bf532fc76de1dca2d2357672c69a6692090069d4e82adfe9c258c55441ae"
Aug 04 18:30:01.789367 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.789190    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"
Aug 04 18:30:01.790857 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.790834    2571 generic.go:356] "Generic (PLEG): container finished" podID="04bb1a44-d38f-456a-98a2-08c09bd0da33" containerID="12b463c7bea5788d19a33115635a31b7a5e17b97f94b2ee45e894ece70aec4ae" exitCode=0
Aug 04 18:30:01.790931 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.790874    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764470-gnn2h" event={"ID":"04bb1a44-d38f-456a-98a2-08c09bd0da33","Type":"ContainerDied","Data":"12b463c7bea5788d19a33115635a31b7a5e17b97f94b2ee45e894ece70aec4ae"}
Aug 04 18:30:01.798103 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.798088    2571 scope.go:117] "RemoveContainer" containerID="3598cadf446983e0c14ff240a61551ab18beb0581e055f10bb91568eb01e41fd"
Aug 04 18:30:01.809013 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.808996    2571 scope.go:117] "RemoveContainer" containerID="f221bf532fc76de1dca2d2357672c69a6692090069d4e82adfe9c258c55441ae"
Aug 04 18:30:01.809287 ip-10-0-141-220 kubenswrapper[2571]: E0804 18:30:01.809270    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f221bf532fc76de1dca2d2357672c69a6692090069d4e82adfe9c258c55441ae\": container with ID starting with f221bf532fc76de1dca2d2357672c69a6692090069d4e82adfe9c258c55441ae not found: ID does not exist" containerID="f221bf532fc76de1dca2d2357672c69a6692090069d4e82adfe9c258c55441ae"
Aug 04 18:30:01.809333 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.809297    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f221bf532fc76de1dca2d2357672c69a6692090069d4e82adfe9c258c55441ae"} err="failed to get container status \"f221bf532fc76de1dca2d2357672c69a6692090069d4e82adfe9c258c55441ae\": rpc error: code = NotFound desc = could not find container \"f221bf532fc76de1dca2d2357672c69a6692090069d4e82adfe9c258c55441ae\": container with ID starting with f221bf532fc76de1dca2d2357672c69a6692090069d4e82adfe9c258c55441ae not found: ID does not exist"
Aug 04 18:30:01.809375 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.809335    2571 scope.go:117] "RemoveContainer" containerID="3598cadf446983e0c14ff240a61551ab18beb0581e055f10bb91568eb01e41fd"
Aug 04 18:30:01.809580 ip-10-0-141-220 kubenswrapper[2571]: E0804 18:30:01.809561    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3598cadf446983e0c14ff240a61551ab18beb0581e055f10bb91568eb01e41fd\": container with ID starting with 3598cadf446983e0c14ff240a61551ab18beb0581e055f10bb91568eb01e41fd not found: ID does not exist" containerID="3598cadf446983e0c14ff240a61551ab18beb0581e055f10bb91568eb01e41fd"
Aug 04 18:30:01.809648 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.809587    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3598cadf446983e0c14ff240a61551ab18beb0581e055f10bb91568eb01e41fd"} err="failed to get container status \"3598cadf446983e0c14ff240a61551ab18beb0581e055f10bb91568eb01e41fd\": rpc error: code = NotFound desc = could not find container \"3598cadf446983e0c14ff240a61551ab18beb0581e055f10bb91568eb01e41fd\": container with ID starting with 3598cadf446983e0c14ff240a61551ab18beb0581e055f10bb91568eb01e41fd not found: ID does not exist"
Aug 04 18:30:01.818539 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.818502    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"]
Aug 04 18:30:01.822310 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.822291    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-6f0f8ee0-openshift-default-8b558895b-ccmmd"]
Aug 04 18:30:01.878986 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:01.878966    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cf23585-306c-4081-9874-8b494efbdd81" path="/var/lib/kubelet/pods/3cf23585-306c-4081-9874-8b494efbdd81/volumes"
Aug 04 18:30:02.915136 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:02.915116    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764470-gnn2h"
Aug 04 18:30:03.801316 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:03.801286    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764470-gnn2h"
Aug 04 18:30:03.801316 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:03.801302    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764470-gnn2h" event={"ID":"04bb1a44-d38f-456a-98a2-08c09bd0da33","Type":"ContainerDied","Data":"ccfd9a06207a2e9e0a53ae021fc73f70cc2edcb432dcbd2a1090226834326915"}
Aug 04 18:30:03.801504 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:30:03.801344    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ccfd9a06207a2e9e0a53ae021fc73f70cc2edcb432dcbd2a1090226834326915"
Aug 04 18:31:00.302231 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.302200    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"]
Aug 04 18:31:00.302683 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.302494    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cf23585-306c-4081-9874-8b494efbdd81" containerName="istio-proxy"
Aug 04 18:31:00.302683 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.302506    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cf23585-306c-4081-9874-8b494efbdd81" containerName="istio-proxy"
Aug 04 18:31:00.302683 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.302516    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cf23585-306c-4081-9874-8b494efbdd81" containerName="istio-proxy"
Aug 04 18:31:00.302683 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.302543    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cf23585-306c-4081-9874-8b494efbdd81" containerName="istio-proxy"
Aug 04 18:31:00.302683 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.302552    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04bb1a44-d38f-456a-98a2-08c09bd0da33" containerName="cleanup"
Aug 04 18:31:00.302683 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.302557    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="04bb1a44-d38f-456a-98a2-08c09bd0da33" containerName="cleanup"
Aug 04 18:31:00.302683 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.302612    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="04bb1a44-d38f-456a-98a2-08c09bd0da33" containerName="cleanup"
Aug 04 18:31:00.302683 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.302622    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cf23585-306c-4081-9874-8b494efbdd81" containerName="istio-proxy"
Aug 04 18:31:00.302683 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.302628    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cf23585-306c-4081-9874-8b494efbdd81" containerName="istio-proxy"
Aug 04 18:31:00.305110 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.305094    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:31:00.307312 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.307285    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-7e1998-openshift-default-dockercfg-nx9h7\""
Aug 04 18:31:00.316282 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.316258    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"]
Aug 04 18:31:00.412303 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.412270    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/321e806f-21f1-4cdf-8db8-e76fe6913b5e-workload-certs\") pod \"e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk\" (UID: \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\") " pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:31:00.412469 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.412320    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/321e806f-21f1-4cdf-8db8-e76fe6913b5e-istio-data\") pod \"e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk\" (UID: \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\") " pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:31:00.412469 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.412342    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/321e806f-21f1-4cdf-8db8-e76fe6913b5e-workload-socket\") pod \"e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk\" (UID: \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\") " pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:31:00.412469 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.412380    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/321e806f-21f1-4cdf-8db8-e76fe6913b5e-istio-envoy\") pod \"e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk\" (UID: \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\") " pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:31:00.412469 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.412414    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/321e806f-21f1-4cdf-8db8-e76fe6913b5e-istiod-ca-cert\") pod \"e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk\" (UID: \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\") " pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:31:00.412661 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.412581    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh4qz\" (UniqueName: \"kubernetes.io/projected/321e806f-21f1-4cdf-8db8-e76fe6913b5e-kube-api-access-kh4qz\") pod \"e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk\" (UID: \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\") " pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:31:00.412661 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.412624    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/321e806f-21f1-4cdf-8db8-e76fe6913b5e-istio-token\") pod \"e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk\" (UID: \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\") " pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:31:00.412745 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.412657    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/321e806f-21f1-4cdf-8db8-e76fe6913b5e-istio-podinfo\") pod \"e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk\" (UID: \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\") " pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:31:00.412745 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.412719    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/321e806f-21f1-4cdf-8db8-e76fe6913b5e-credential-socket\") pod \"e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk\" (UID: \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\") " pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:31:00.513285 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.513258    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/321e806f-21f1-4cdf-8db8-e76fe6913b5e-credential-socket\") pod \"e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk\" (UID: \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\") " pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:31:00.513415 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.513294    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/321e806f-21f1-4cdf-8db8-e76fe6913b5e-workload-certs\") pod \"e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk\" (UID: \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\") " pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:31:00.513415 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.513332    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/321e806f-21f1-4cdf-8db8-e76fe6913b5e-istio-data\") pod \"e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk\" (UID: \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\") " pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:31:00.513415 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.513359    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/321e806f-21f1-4cdf-8db8-e76fe6913b5e-workload-socket\") pod \"e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk\" (UID: \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\") " pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:31:00.513415 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.513405    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/321e806f-21f1-4cdf-8db8-e76fe6913b5e-istio-envoy\") pod \"e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk\" (UID: \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\") " pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:31:00.513653 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.513429    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/321e806f-21f1-4cdf-8db8-e76fe6913b5e-istiod-ca-cert\") pod \"e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk\" (UID: \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\") " pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:31:00.513653 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.513478    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh4qz\" (UniqueName: \"kubernetes.io/projected/321e806f-21f1-4cdf-8db8-e76fe6913b5e-kube-api-access-kh4qz\") pod \"e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk\" (UID: \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\") " pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:31:00.513653 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.513506    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/321e806f-21f1-4cdf-8db8-e76fe6913b5e-istio-token\") pod \"e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk\" (UID: \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\") " pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:31:00.513653 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.513557    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/321e806f-21f1-4cdf-8db8-e76fe6913b5e-istio-podinfo\") pod \"e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk\" (UID: \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\") " pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:31:00.513867 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.513714    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/321e806f-21f1-4cdf-8db8-e76fe6913b5e-credential-socket\") pod \"e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk\" (UID: \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\") " pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:31:00.513867 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.513729    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/321e806f-21f1-4cdf-8db8-e76fe6913b5e-istio-data\") pod \"e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk\" (UID: \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\") " pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:31:00.513867 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.513849    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/321e806f-21f1-4cdf-8db8-e76fe6913b5e-workload-certs\") pod \"e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk\" (UID: \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\") " pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:31:00.514029 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.513993    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/321e806f-21f1-4cdf-8db8-e76fe6913b5e-workload-socket\") pod \"e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk\" (UID: \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\") " pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:31:00.514240 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.514221    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/321e806f-21f1-4cdf-8db8-e76fe6913b5e-istiod-ca-cert\") pod \"e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk\" (UID: \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\") " pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:31:00.515833 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.515810    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/321e806f-21f1-4cdf-8db8-e76fe6913b5e-istio-envoy\") pod \"e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk\" (UID: \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\") " pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:31:00.515909 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.515889    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/321e806f-21f1-4cdf-8db8-e76fe6913b5e-istio-podinfo\") pod \"e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk\" (UID: \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\") " pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:31:00.521771 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.521745    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh4qz\" (UniqueName: \"kubernetes.io/projected/321e806f-21f1-4cdf-8db8-e76fe6913b5e-kube-api-access-kh4qz\") pod \"e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk\" (UID: \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\") " pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:31:00.521989 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.521968    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/321e806f-21f1-4cdf-8db8-e76fe6913b5e-istio-token\") pod \"e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk\" (UID: \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\") " pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:31:00.614618 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.614571    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:31:00.743343 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.743320    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"]
Aug 04 18:31:00.745620 ip-10-0-141-220 kubenswrapper[2571]: W0804 18:31:00.745592    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod321e806f_21f1_4cdf_8db8_e76fe6913b5e.slice/crio-110b28935b99279824deb2a29958646f0a6b11dfedad76bd82623eb6df35586b WatchSource:0}: Error finding container 110b28935b99279824deb2a29958646f0a6b11dfedad76bd82623eb6df35586b: Status 404 returned error can't find the container with id 110b28935b99279824deb2a29958646f0a6b11dfedad76bd82623eb6df35586b
Aug 04 18:31:00.747812 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.747759    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:31:00.747933 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.747832    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:31:00.747933 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:00.747879    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:31:01.034507 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:01.034474    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk" event={"ID":"321e806f-21f1-4cdf-8db8-e76fe6913b5e","Type":"ContainerStarted","Data":"5967046591eb6bcb65151bb6863dfad63d62a0648fb224c0ee4844f7ef9a9544"}
Aug 04 18:31:01.034693 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:01.034545    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk" event={"ID":"321e806f-21f1-4cdf-8db8-e76fe6913b5e","Type":"ContainerStarted","Data":"110b28935b99279824deb2a29958646f0a6b11dfedad76bd82623eb6df35586b"}
Aug 04 18:31:01.052318 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:01.052261    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk" podStartSLOduration=1.05224315 podStartE2EDuration="1.05224315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:31:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:31:01.051297936 +0000 UTC m=+2677.852434264" watchObservedRunningTime="2026-08-04 18:31:01.05224315 +0000 UTC m=+2677.853379478"
Aug 04 18:31:01.614756 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:01.614724    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:31:01.619216 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:01.619185    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:31:02.039033 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:02.039002    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:31:02.039803 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:02.039783    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:31:17.040296 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:17.040267    2571 patch_prober.go:28] interesting pod/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Aug 04 18:31:17.040714 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:17.040327    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk" podUID="321e806f-21f1-4cdf-8db8-e76fe6913b5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Aug 04 18:31:17.110440 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:17.110411    2571 generic.go:356] "Generic (PLEG): container finished" podID="321e806f-21f1-4cdf-8db8-e76fe6913b5e" containerID="5967046591eb6bcb65151bb6863dfad63d62a0648fb224c0ee4844f7ef9a9544" exitCode=0
Aug 04 18:31:17.110605 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:17.110489    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk" event={"ID":"321e806f-21f1-4cdf-8db8-e76fe6913b5e","Type":"ContainerDied","Data":"5967046591eb6bcb65151bb6863dfad63d62a0648fb224c0ee4844f7ef9a9544"}
Aug 04 18:31:17.110866 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:17.110850    2571 scope.go:117] "RemoveContainer" containerID="5967046591eb6bcb65151bb6863dfad63d62a0648fb224c0ee4844f7ef9a9544"
Aug 04 18:31:17.111786 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:17.111761    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:31:17.111879 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:17.111821    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:31:17.111879 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:17.111852    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:31:18.117017 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:18.116980    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk" event={"ID":"321e806f-21f1-4cdf-8db8-e76fe6913b5e","Type":"ContainerStarted","Data":"91b6f87e31fc88cab727834cf5e2392ce9e0cbc603e646490226eb24ccf2d79a"}
Aug 04 18:31:18.615652 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:18.615620    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:31:18.615830 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:18.615793    2571 patch_prober.go:28] interesting pod/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Aug 04 18:31:18.615877 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:18.615852    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk" podUID="321e806f-21f1-4cdf-8db8-e76fe6913b5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Aug 04 18:31:19.614964 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:19.614929    2571 patch_prober.go:28] interesting pod/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Aug 04 18:31:19.615331 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:19.614979    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk" podUID="321e806f-21f1-4cdf-8db8-e76fe6913b5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Aug 04 18:31:20.615542 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:20.615498    2571 patch_prober.go:28] interesting pod/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Aug 04 18:31:20.615924 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:20.615566    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk" podUID="321e806f-21f1-4cdf-8db8-e76fe6913b5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Aug 04 18:31:21.615828 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:21.615792    2571 patch_prober.go:28] interesting pod/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Aug 04 18:31:21.616233 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:21.615855    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk" podUID="321e806f-21f1-4cdf-8db8-e76fe6913b5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Aug 04 18:31:22.615660 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:22.615625    2571 patch_prober.go:28] interesting pod/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Aug 04 18:31:22.615826 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:22.615686    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk" podUID="321e806f-21f1-4cdf-8db8-e76fe6913b5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Aug 04 18:31:23.619009 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:23.618979    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:31:23.619375 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:23.619269    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:31:23.619865 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:23.619844    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:31:23.897036 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:23.896961    2571 scope.go:117] "RemoveContainer" containerID="1eab903e6585eea09e14dc2e8a00af8493fa3752e58c9eb5f7f395fc4acfba27"
Aug 04 18:31:23.904002 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:23.903983    2571 scope.go:117] "RemoveContainer" containerID="a524047bf11d3f79ac011f95405ed429ac8b50101ed782a8f00fe126d997dae2"
Aug 04 18:31:33.605161 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:33.605130    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"]
Aug 04 18:31:33.607210 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:33.607192    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:31:33.609480 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:33.609460    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-8ca2e8-openshift-default-dockercfg-c8bzb\""
Aug 04 18:31:33.620157 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:33.620136    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"]
Aug 04 18:31:33.664556 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:33.664507    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1753f64b-a6c1-4c13-bd4b-fa511aac641a-istio-token\") pod \"e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb\" (UID: \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\") " pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:31:33.664669 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:33.664570    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1753f64b-a6c1-4c13-bd4b-fa511aac641a-istiod-ca-cert\") pod \"e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb\" (UID: \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\") " pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:31:33.664669 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:33.664605    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1753f64b-a6c1-4c13-bd4b-fa511aac641a-istio-podinfo\") pod \"e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb\" (UID: \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\") " pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:31:33.664669 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:33.664625    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1753f64b-a6c1-4c13-bd4b-fa511aac641a-istio-data\") pod \"e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb\" (UID: \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\") " pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:31:33.664669 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:33.664650    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1753f64b-a6c1-4c13-bd4b-fa511aac641a-workload-certs\") pod \"e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb\" (UID: \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\") " pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:31:33.664837 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:33.664715    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1753f64b-a6c1-4c13-bd4b-fa511aac641a-credential-socket\") pod \"e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb\" (UID: \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\") " pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:31:33.664837 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:33.664737    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1753f64b-a6c1-4c13-bd4b-fa511aac641a-istio-envoy\") pod \"e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb\" (UID: \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\") " pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:31:33.664837 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:33.664774    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5bdq\" (UniqueName: \"kubernetes.io/projected/1753f64b-a6c1-4c13-bd4b-fa511aac641a-kube-api-access-n5bdq\") pod \"e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb\" (UID: \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\") " pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:31:33.664837 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:33.664794    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1753f64b-a6c1-4c13-bd4b-fa511aac641a-workload-socket\") pod \"e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb\" (UID: \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\") " pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:31:33.765917 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:33.765888    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1753f64b-a6c1-4c13-bd4b-fa511aac641a-istio-token\") pod \"e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb\" (UID: \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\") " pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:31:33.766083 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:33.765926    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1753f64b-a6c1-4c13-bd4b-fa511aac641a-istiod-ca-cert\") pod \"e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb\" (UID: \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\") " pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:31:33.766083 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:33.765951    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1753f64b-a6c1-4c13-bd4b-fa511aac641a-istio-podinfo\") pod \"e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb\" (UID: \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\") " pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:31:33.766083 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:33.766071    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1753f64b-a6c1-4c13-bd4b-fa511aac641a-istio-data\") pod \"e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb\" (UID: \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\") " pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:31:33.766245 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:33.766114    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1753f64b-a6c1-4c13-bd4b-fa511aac641a-workload-certs\") pod \"e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb\" (UID: \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\") " pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:31:33.766245 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:33.766146    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1753f64b-a6c1-4c13-bd4b-fa511aac641a-credential-socket\") pod \"e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb\" (UID: \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\") " pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:31:33.766245 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:33.766168    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1753f64b-a6c1-4c13-bd4b-fa511aac641a-istio-envoy\") pod \"e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb\" (UID: \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\") " pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:31:33.766245 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:33.766232    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5bdq\" (UniqueName: \"kubernetes.io/projected/1753f64b-a6c1-4c13-bd4b-fa511aac641a-kube-api-access-n5bdq\") pod \"e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb\" (UID: \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\") " pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:31:33.766455 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:33.766283    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1753f64b-a6c1-4c13-bd4b-fa511aac641a-workload-socket\") pod \"e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb\" (UID: \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\") " pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:31:33.766514 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:33.766492    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1753f64b-a6c1-4c13-bd4b-fa511aac641a-istio-data\") pod \"e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb\" (UID: \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\") " pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:31:33.766661 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:33.766646    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1753f64b-a6c1-4c13-bd4b-fa511aac641a-credential-socket\") pod \"e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb\" (UID: \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\") " pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:31:33.766725 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:33.766672    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1753f64b-a6c1-4c13-bd4b-fa511aac641a-istiod-ca-cert\") pod \"e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb\" (UID: \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\") " pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:31:33.766766 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:33.766741    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1753f64b-a6c1-4c13-bd4b-fa511aac641a-workload-certs\") pod \"e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb\" (UID: \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\") " pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:31:33.766861 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:33.766840    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1753f64b-a6c1-4c13-bd4b-fa511aac641a-workload-socket\") pod \"e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb\" (UID: \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\") " pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:31:33.768457 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:33.768434    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1753f64b-a6c1-4c13-bd4b-fa511aac641a-istio-podinfo\") pod \"e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb\" (UID: \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\") " pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:31:33.768457 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:33.768449    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1753f64b-a6c1-4c13-bd4b-fa511aac641a-istio-envoy\") pod \"e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb\" (UID: \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\") " pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:31:33.776267 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:33.776238    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1753f64b-a6c1-4c13-bd4b-fa511aac641a-istio-token\") pod \"e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb\" (UID: \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\") " pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:31:33.776815 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:33.776799    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5bdq\" (UniqueName: \"kubernetes.io/projected/1753f64b-a6c1-4c13-bd4b-fa511aac641a-kube-api-access-n5bdq\") pod \"e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb\" (UID: \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\") " pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:31:33.917217 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:33.917164    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:31:34.045564 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:34.045536    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"]
Aug 04 18:31:34.048102 ip-10-0-141-220 kubenswrapper[2571]: W0804 18:31:34.048081    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1753f64b_a6c1_4c13_bd4b_fa511aac641a.slice/crio-ec2dcc7622db0c0ab2a4e0a906c15f8bf997b978a303a52a4aca92af49a84b48 WatchSource:0}: Error finding container ec2dcc7622db0c0ab2a4e0a906c15f8bf997b978a303a52a4aca92af49a84b48: Status 404 returned error can't find the container with id ec2dcc7622db0c0ab2a4e0a906c15f8bf997b978a303a52a4aca92af49a84b48
Aug 04 18:31:34.050283 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:34.050250    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:31:34.050385 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:34.050325    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:31:34.050385 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:34.050366    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:31:34.187305 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:34.187230    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb" event={"ID":"1753f64b-a6c1-4c13-bd4b-fa511aac641a","Type":"ContainerStarted","Data":"f9a9913311a4ca222bdd67ac66191ef9531288f95b1a1830f9c730da0bf2c97a"}
Aug 04 18:31:34.187305 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:34.187292    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb" event={"ID":"1753f64b-a6c1-4c13-bd4b-fa511aac641a","Type":"ContainerStarted","Data":"ec2dcc7622db0c0ab2a4e0a906c15f8bf997b978a303a52a4aca92af49a84b48"}
Aug 04 18:31:34.207273 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:34.207224    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb" podStartSLOduration=1.207206116 podStartE2EDuration="1.207206116s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:31:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:31:34.205698753 +0000 UTC m=+2711.006835080" watchObservedRunningTime="2026-08-04 18:31:34.207206116 +0000 UTC m=+2711.008342435"
Aug 04 18:31:34.917422 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:34.917391    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:31:35.922171 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:35.922130    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:31:36.197835 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:36.197767    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:31:36.198443 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:36.198425    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:31:49.262104 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:49.262041    2571 generic.go:356] "Generic (PLEG): container finished" podID="1753f64b-a6c1-4c13-bd4b-fa511aac641a" containerID="f9a9913311a4ca222bdd67ac66191ef9531288f95b1a1830f9c730da0bf2c97a" exitCode=0
Aug 04 18:31:49.262104 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:49.262077    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb" event={"ID":"1753f64b-a6c1-4c13-bd4b-fa511aac641a","Type":"ContainerDied","Data":"f9a9913311a4ca222bdd67ac66191ef9531288f95b1a1830f9c730da0bf2c97a"}
Aug 04 18:31:49.262557 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:49.262370    2571 scope.go:117] "RemoveContainer" containerID="f9a9913311a4ca222bdd67ac66191ef9531288f95b1a1830f9c730da0bf2c97a"
Aug 04 18:31:49.263315 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:49.263283    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:31:49.263404 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:49.263351    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:31:49.263404 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:49.263381    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:31:50.268146 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:50.268114    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb" event={"ID":"1753f64b-a6c1-4c13-bd4b-fa511aac641a","Type":"ContainerStarted","Data":"03c88d96ae50001b241358fb2562657a729ecda2026394ab19d80b1a155364ee"}
Aug 04 18:31:50.918163 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:50.918131    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:31:50.919108 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:50.919083    2571 patch_prober.go:28] interesting pod/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Aug 04 18:31:50.919224 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:50.919132    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb" podUID="1753f64b-a6c1-4c13-bd4b-fa511aac641a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Aug 04 18:31:51.198378 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:51.198308    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:31:51.918300 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:51.918266    2571 patch_prober.go:28] interesting pod/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Aug 04 18:31:51.918688 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:51.918317    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb" podUID="1753f64b-a6c1-4c13-bd4b-fa511aac641a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Aug 04 18:31:52.918044 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:52.918009    2571 patch_prober.go:28] interesting pod/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Aug 04 18:31:52.918228 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:52.918070    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb" podUID="1753f64b-a6c1-4c13-bd4b-fa511aac641a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Aug 04 18:31:53.918262 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:53.918229    2571 patch_prober.go:28] interesting pod/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Aug 04 18:31:53.918659 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:53.918283    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb" podUID="1753f64b-a6c1-4c13-bd4b-fa511aac641a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Aug 04 18:31:54.918273 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:54.918237    2571 patch_prober.go:28] interesting pod/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Aug 04 18:31:54.918667 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:54.918291    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb" podUID="1753f64b-a6c1-4c13-bd4b-fa511aac641a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Aug 04 18:31:55.921987 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:55.921960    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:31:55.922755 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:31:55.922739    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:32:17.074268 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:17.074239    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h"]
Aug 04 18:32:17.077518 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:17.077497    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h"
Aug 04 18:32:17.080076 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:17.080058    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-7e1998\"/\"kube-root-ca.crt\""
Aug 04 18:32:17.080915 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:17.080897    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-7e1998\"/\"openshift-service-ca.crt\""
Aug 04 18:32:17.080983 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:17.080963    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-7e1998\"/\"test-model-7e1998-kserve-self-signed-certs\""
Aug 04 18:32:17.081024 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:17.081002    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-7e1998\"/\"default-dockercfg-tb8kr\""
Aug 04 18:32:17.087415 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:17.087394    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h"]
Aug 04 18:32:17.200036 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:17.200017    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f5b6605-5592-42d6-80a6-44973ce909c2-dshm\") pod \"test-model-7e1998-kserve-5f8b968b99-kfz5h\" (UID: \"9f5b6605-5592-42d6-80a6-44973ce909c2\") " pod="ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h"
Aug 04 18:32:17.200135 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:17.200049    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f5b6605-5592-42d6-80a6-44973ce909c2-home\") pod \"test-model-7e1998-kserve-5f8b968b99-kfz5h\" (UID: \"9f5b6605-5592-42d6-80a6-44973ce909c2\") " pod="ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h"
Aug 04 18:32:17.200135 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:17.200065    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f5b6605-5592-42d6-80a6-44973ce909c2-tmp-dir\") pod \"test-model-7e1998-kserve-5f8b968b99-kfz5h\" (UID: \"9f5b6605-5592-42d6-80a6-44973ce909c2\") " pod="ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h"
Aug 04 18:32:17.200135 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:17.200104    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f5b6605-5592-42d6-80a6-44973ce909c2-model-cache\") pod \"test-model-7e1998-kserve-5f8b968b99-kfz5h\" (UID: \"9f5b6605-5592-42d6-80a6-44973ce909c2\") " pod="ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h"
Aug 04 18:32:17.200244 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:17.200139    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f5b6605-5592-42d6-80a6-44973ce909c2-tls-certs\") pod \"test-model-7e1998-kserve-5f8b968b99-kfz5h\" (UID: \"9f5b6605-5592-42d6-80a6-44973ce909c2\") " pod="ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h"
Aug 04 18:32:17.200244 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:17.200160    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq9vl\" (UniqueName: \"kubernetes.io/projected/9f5b6605-5592-42d6-80a6-44973ce909c2-kube-api-access-mq9vl\") pod \"test-model-7e1998-kserve-5f8b968b99-kfz5h\" (UID: \"9f5b6605-5592-42d6-80a6-44973ce909c2\") " pod="ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h"
Aug 04 18:32:17.301598 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:17.301570    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f5b6605-5592-42d6-80a6-44973ce909c2-model-cache\") pod \"test-model-7e1998-kserve-5f8b968b99-kfz5h\" (UID: \"9f5b6605-5592-42d6-80a6-44973ce909c2\") " pod="ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h"
Aug 04 18:32:17.301768 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:17.301612    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f5b6605-5592-42d6-80a6-44973ce909c2-tls-certs\") pod \"test-model-7e1998-kserve-5f8b968b99-kfz5h\" (UID: \"9f5b6605-5592-42d6-80a6-44973ce909c2\") " pod="ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h"
Aug 04 18:32:17.301768 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:17.301643    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq9vl\" (UniqueName: \"kubernetes.io/projected/9f5b6605-5592-42d6-80a6-44973ce909c2-kube-api-access-mq9vl\") pod \"test-model-7e1998-kserve-5f8b968b99-kfz5h\" (UID: \"9f5b6605-5592-42d6-80a6-44973ce909c2\") " pod="ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h"
Aug 04 18:32:17.301768 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:17.301673    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f5b6605-5592-42d6-80a6-44973ce909c2-dshm\") pod \"test-model-7e1998-kserve-5f8b968b99-kfz5h\" (UID: \"9f5b6605-5592-42d6-80a6-44973ce909c2\") " pod="ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h"
Aug 04 18:32:17.301768 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:17.301701    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f5b6605-5592-42d6-80a6-44973ce909c2-home\") pod \"test-model-7e1998-kserve-5f8b968b99-kfz5h\" (UID: \"9f5b6605-5592-42d6-80a6-44973ce909c2\") " pod="ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h"
Aug 04 18:32:17.301768 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:17.301721    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f5b6605-5592-42d6-80a6-44973ce909c2-tmp-dir\") pod \"test-model-7e1998-kserve-5f8b968b99-kfz5h\" (UID: \"9f5b6605-5592-42d6-80a6-44973ce909c2\") " pod="ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h"
Aug 04 18:32:17.302072 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:17.302051    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f5b6605-5592-42d6-80a6-44973ce909c2-model-cache\") pod \"test-model-7e1998-kserve-5f8b968b99-kfz5h\" (UID: \"9f5b6605-5592-42d6-80a6-44973ce909c2\") " pod="ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h"
Aug 04 18:32:17.302126 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:17.302097    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f5b6605-5592-42d6-80a6-44973ce909c2-home\") pod \"test-model-7e1998-kserve-5f8b968b99-kfz5h\" (UID: \"9f5b6605-5592-42d6-80a6-44973ce909c2\") " pod="ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h"
Aug 04 18:32:17.302163 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:17.302125    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f5b6605-5592-42d6-80a6-44973ce909c2-tmp-dir\") pod \"test-model-7e1998-kserve-5f8b968b99-kfz5h\" (UID: \"9f5b6605-5592-42d6-80a6-44973ce909c2\") " pod="ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h"
Aug 04 18:32:17.304010 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:17.303983    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f5b6605-5592-42d6-80a6-44973ce909c2-dshm\") pod \"test-model-7e1998-kserve-5f8b968b99-kfz5h\" (UID: \"9f5b6605-5592-42d6-80a6-44973ce909c2\") " pod="ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h"
Aug 04 18:32:17.304162 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:17.304144    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f5b6605-5592-42d6-80a6-44973ce909c2-tls-certs\") pod \"test-model-7e1998-kserve-5f8b968b99-kfz5h\" (UID: \"9f5b6605-5592-42d6-80a6-44973ce909c2\") " pod="ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h"
Aug 04 18:32:17.308987 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:17.308963    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq9vl\" (UniqueName: \"kubernetes.io/projected/9f5b6605-5592-42d6-80a6-44973ce909c2-kube-api-access-mq9vl\") pod \"test-model-7e1998-kserve-5f8b968b99-kfz5h\" (UID: \"9f5b6605-5592-42d6-80a6-44973ce909c2\") " pod="ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h"
Aug 04 18:32:17.386682 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:17.386631    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h"
Aug 04 18:32:17.508954 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:17.508929    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h"]
Aug 04 18:32:17.511465 ip-10-0-141-220 kubenswrapper[2571]: W0804 18:32:17.511443    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f5b6605_5592_42d6_80a6_44973ce909c2.slice/crio-afbd9fb0df5fdc8b0c8f3714d1b302b47c078c0d32fa7ed5b5b0f4d6f39b2e17 WatchSource:0}: Error finding container afbd9fb0df5fdc8b0c8f3714d1b302b47c078c0d32fa7ed5b5b0f4d6f39b2e17: Status 404 returned error can't find the container with id afbd9fb0df5fdc8b0c8f3714d1b302b47c078c0d32fa7ed5b5b0f4d6f39b2e17
Aug 04 18:32:18.393878 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:18.393844    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h" event={"ID":"9f5b6605-5592-42d6-80a6-44973ce909c2","Type":"ContainerStarted","Data":"fb46f1b37806d961fa4f05c5ee0192162318bf6d9e6b0165f9627eee04275a42"}
Aug 04 18:32:18.394250 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:18.393891    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h" event={"ID":"9f5b6605-5592-42d6-80a6-44973ce909c2","Type":"ContainerStarted","Data":"afbd9fb0df5fdc8b0c8f3714d1b302b47c078c0d32fa7ed5b5b0f4d6f39b2e17"}
Aug 04 18:32:18.410722 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:18.410682    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h" podStartSLOduration=1.410668048 podStartE2EDuration="1.410668048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:32:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:32:18.408952538 +0000 UTC m=+2755.210088871" watchObservedRunningTime="2026-08-04 18:32:18.410668048 +0000 UTC m=+2755.211804374"
Aug 04 18:32:27.387171 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:27.387131    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h"
Aug 04 18:32:27.387696 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:27.387195    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h"
Aug 04 18:32:27.399370 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:27.399348    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h"
Aug 04 18:32:27.445436 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:27.445410    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h"
Aug 04 18:32:37.272347 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:37.272314    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss"]
Aug 04 18:32:37.275613 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:37.275594    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss"
Aug 04 18:32:37.278497 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:37.278475    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-8ca2e8\"/\"test-model-8ca2e8-kserve-self-signed-certs\""
Aug 04 18:32:37.278628 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:37.278476    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-8ca2e8\"/\"default-dockercfg-jxljd\""
Aug 04 18:32:37.278628 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:37.278537    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-8ca2e8\"/\"kube-root-ca.crt\""
Aug 04 18:32:37.278628 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:37.278558    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-8ca2e8\"/\"openshift-service-ca.crt\""
Aug 04 18:32:37.286084 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:37.286063    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss"]
Aug 04 18:32:37.355328 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:37.355304    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40ab0873-82ae-4a33-825a-4bf2373512ac-tls-certs\") pod \"test-model-8ca2e8-kserve-549d4b74ff-ghxss\" (UID: \"40ab0873-82ae-4a33-825a-4bf2373512ac\") " pod="ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss"
Aug 04 18:32:37.355424 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:37.355341    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40ab0873-82ae-4a33-825a-4bf2373512ac-model-cache\") pod \"test-model-8ca2e8-kserve-549d4b74ff-ghxss\" (UID: \"40ab0873-82ae-4a33-825a-4bf2373512ac\") " pod="ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss"
Aug 04 18:32:37.355424 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:37.355368    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj77b\" (UniqueName: \"kubernetes.io/projected/40ab0873-82ae-4a33-825a-4bf2373512ac-kube-api-access-dj77b\") pod \"test-model-8ca2e8-kserve-549d4b74ff-ghxss\" (UID: \"40ab0873-82ae-4a33-825a-4bf2373512ac\") " pod="ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss"
Aug 04 18:32:37.355498 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:37.355433    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40ab0873-82ae-4a33-825a-4bf2373512ac-dshm\") pod \"test-model-8ca2e8-kserve-549d4b74ff-ghxss\" (UID: \"40ab0873-82ae-4a33-825a-4bf2373512ac\") " pod="ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss"
Aug 04 18:32:37.355498 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:37.355470    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40ab0873-82ae-4a33-825a-4bf2373512ac-tmp-dir\") pod \"test-model-8ca2e8-kserve-549d4b74ff-ghxss\" (UID: \"40ab0873-82ae-4a33-825a-4bf2373512ac\") " pod="ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss"
Aug 04 18:32:37.355498 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:37.355495    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40ab0873-82ae-4a33-825a-4bf2373512ac-home\") pod \"test-model-8ca2e8-kserve-549d4b74ff-ghxss\" (UID: \"40ab0873-82ae-4a33-825a-4bf2373512ac\") " pod="ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss"
Aug 04 18:32:37.456772 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:37.456746    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40ab0873-82ae-4a33-825a-4bf2373512ac-tls-certs\") pod \"test-model-8ca2e8-kserve-549d4b74ff-ghxss\" (UID: \"40ab0873-82ae-4a33-825a-4bf2373512ac\") " pod="ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss"
Aug 04 18:32:37.456910 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:37.456797    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40ab0873-82ae-4a33-825a-4bf2373512ac-model-cache\") pod \"test-model-8ca2e8-kserve-549d4b74ff-ghxss\" (UID: \"40ab0873-82ae-4a33-825a-4bf2373512ac\") " pod="ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss"
Aug 04 18:32:37.456985 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:37.456918    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj77b\" (UniqueName: \"kubernetes.io/projected/40ab0873-82ae-4a33-825a-4bf2373512ac-kube-api-access-dj77b\") pod \"test-model-8ca2e8-kserve-549d4b74ff-ghxss\" (UID: \"40ab0873-82ae-4a33-825a-4bf2373512ac\") " pod="ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss"
Aug 04 18:32:37.456985 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:37.456964    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40ab0873-82ae-4a33-825a-4bf2373512ac-dshm\") pod \"test-model-8ca2e8-kserve-549d4b74ff-ghxss\" (UID: \"40ab0873-82ae-4a33-825a-4bf2373512ac\") " pod="ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss"
Aug 04 18:32:37.457102 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:37.456996    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40ab0873-82ae-4a33-825a-4bf2373512ac-tmp-dir\") pod \"test-model-8ca2e8-kserve-549d4b74ff-ghxss\" (UID: \"40ab0873-82ae-4a33-825a-4bf2373512ac\") " pod="ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss"
Aug 04 18:32:37.457102 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:37.457028    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40ab0873-82ae-4a33-825a-4bf2373512ac-home\") pod \"test-model-8ca2e8-kserve-549d4b74ff-ghxss\" (UID: \"40ab0873-82ae-4a33-825a-4bf2373512ac\") " pod="ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss"
Aug 04 18:32:37.457459 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:37.457436    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40ab0873-82ae-4a33-825a-4bf2373512ac-home\") pod \"test-model-8ca2e8-kserve-549d4b74ff-ghxss\" (UID: \"40ab0873-82ae-4a33-825a-4bf2373512ac\") " pod="ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss"
Aug 04 18:32:37.457825 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:37.457802    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40ab0873-82ae-4a33-825a-4bf2373512ac-tmp-dir\") pod \"test-model-8ca2e8-kserve-549d4b74ff-ghxss\" (UID: \"40ab0873-82ae-4a33-825a-4bf2373512ac\") " pod="ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss"
Aug 04 18:32:37.458320 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:37.458299    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40ab0873-82ae-4a33-825a-4bf2373512ac-model-cache\") pod \"test-model-8ca2e8-kserve-549d4b74ff-ghxss\" (UID: \"40ab0873-82ae-4a33-825a-4bf2373512ac\") " pod="ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss"
Aug 04 18:32:37.460006 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:37.459983    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40ab0873-82ae-4a33-825a-4bf2373512ac-tls-certs\") pod \"test-model-8ca2e8-kserve-549d4b74ff-ghxss\" (UID: \"40ab0873-82ae-4a33-825a-4bf2373512ac\") " pod="ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss"
Aug 04 18:32:37.460290 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:37.460262    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40ab0873-82ae-4a33-825a-4bf2373512ac-dshm\") pod \"test-model-8ca2e8-kserve-549d4b74ff-ghxss\" (UID: \"40ab0873-82ae-4a33-825a-4bf2373512ac\") " pod="ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss"
Aug 04 18:32:37.467732 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:37.467690    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj77b\" (UniqueName: \"kubernetes.io/projected/40ab0873-82ae-4a33-825a-4bf2373512ac-kube-api-access-dj77b\") pod \"test-model-8ca2e8-kserve-549d4b74ff-ghxss\" (UID: \"40ab0873-82ae-4a33-825a-4bf2373512ac\") " pod="ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss"
Aug 04 18:32:37.583859 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:37.583835    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss"
Aug 04 18:32:37.707300 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:37.707177    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss"]
Aug 04 18:32:37.709805 ip-10-0-141-220 kubenswrapper[2571]: W0804 18:32:37.709773    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40ab0873_82ae_4a33_825a_4bf2373512ac.slice/crio-43fc9aae9cf739e8fdde9c42c2ccb2684c22c9e9b039db05e2e92bdc814c1f84 WatchSource:0}: Error finding container 43fc9aae9cf739e8fdde9c42c2ccb2684c22c9e9b039db05e2e92bdc814c1f84: Status 404 returned error can't find the container with id 43fc9aae9cf739e8fdde9c42c2ccb2684c22c9e9b039db05e2e92bdc814c1f84
Aug 04 18:32:38.484471 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:38.484441    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss" event={"ID":"40ab0873-82ae-4a33-825a-4bf2373512ac","Type":"ContainerStarted","Data":"50e5bead0b47e793ef571466fc7e67ca2312f7895186629ec7fe3bd2618c0f01"}
Aug 04 18:32:38.484862 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:38.484480    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss" event={"ID":"40ab0873-82ae-4a33-825a-4bf2373512ac","Type":"ContainerStarted","Data":"43fc9aae9cf739e8fdde9c42c2ccb2684c22c9e9b039db05e2e92bdc814c1f84"}
Aug 04 18:32:38.500948 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:38.500903    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss" podStartSLOduration=1.500888524 podStartE2EDuration="1.500888524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:32:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:32:38.498929116 +0000 UTC m=+2775.300065443" watchObservedRunningTime="2026-08-04 18:32:38.500888524 +0000 UTC m=+2775.302024851"
Aug 04 18:32:47.584797 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:47.584713    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss"
Aug 04 18:32:47.584797 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:47.584756    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss"
Aug 04 18:32:47.596813 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:47.596790    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss"
Aug 04 18:32:48.536702 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:32:48.536672    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss"
Aug 04 18:33:25.565727 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:25.565691    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h"]
Aug 04 18:33:26.567207 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:26.567176    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss"]
Aug 04 18:33:40.584807 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:40.584769    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h" podUID="9f5b6605-5592-42d6-80a6-44973ce909c2" containerName="main" containerID="cri-o://fb46f1b37806d961fa4f05c5ee0192162318bf6d9e6b0165f9627eee04275a42" gracePeriod=45
Aug 04 18:33:40.745926 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:40.745898    2571 generic.go:356] "Generic (PLEG): container finished" podID="9f5b6605-5592-42d6-80a6-44973ce909c2" containerID="fb46f1b37806d961fa4f05c5ee0192162318bf6d9e6b0165f9627eee04275a42" exitCode=0
Aug 04 18:33:40.746082 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:40.745979    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h" event={"ID":"9f5b6605-5592-42d6-80a6-44973ce909c2","Type":"ContainerDied","Data":"fb46f1b37806d961fa4f05c5ee0192162318bf6d9e6b0165f9627eee04275a42"}
Aug 04 18:33:40.824310 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:40.824289    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h"
Aug 04 18:33:40.914593 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:40.914516    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f5b6605-5592-42d6-80a6-44973ce909c2-home\") pod \"9f5b6605-5592-42d6-80a6-44973ce909c2\" (UID: \"9f5b6605-5592-42d6-80a6-44973ce909c2\") "
Aug 04 18:33:40.914593 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:40.914564    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f5b6605-5592-42d6-80a6-44973ce909c2-dshm\") pod \"9f5b6605-5592-42d6-80a6-44973ce909c2\" (UID: \"9f5b6605-5592-42d6-80a6-44973ce909c2\") "
Aug 04 18:33:40.914775 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:40.914604    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f5b6605-5592-42d6-80a6-44973ce909c2-tmp-dir\") pod \"9f5b6605-5592-42d6-80a6-44973ce909c2\" (UID: \"9f5b6605-5592-42d6-80a6-44973ce909c2\") "
Aug 04 18:33:40.914775 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:40.914655    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f5b6605-5592-42d6-80a6-44973ce909c2-tls-certs\") pod \"9f5b6605-5592-42d6-80a6-44973ce909c2\" (UID: \"9f5b6605-5592-42d6-80a6-44973ce909c2\") "
Aug 04 18:33:40.914775 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:40.914686    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mq9vl\" (UniqueName: \"kubernetes.io/projected/9f5b6605-5592-42d6-80a6-44973ce909c2-kube-api-access-mq9vl\") pod \"9f5b6605-5592-42d6-80a6-44973ce909c2\" (UID: \"9f5b6605-5592-42d6-80a6-44973ce909c2\") "
Aug 04 18:33:40.914775 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:40.914742    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f5b6605-5592-42d6-80a6-44973ce909c2-model-cache\") pod \"9f5b6605-5592-42d6-80a6-44973ce909c2\" (UID: \"9f5b6605-5592-42d6-80a6-44973ce909c2\") "
Aug 04 18:33:40.914775 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:40.914747    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f5b6605-5592-42d6-80a6-44973ce909c2-home" (OuterVolumeSpecName: "home") pod "9f5b6605-5592-42d6-80a6-44973ce909c2" (UID: "9f5b6605-5592-42d6-80a6-44973ce909c2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:33:40.915013 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:40.914862    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f5b6605-5592-42d6-80a6-44973ce909c2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9f5b6605-5592-42d6-80a6-44973ce909c2" (UID: "9f5b6605-5592-42d6-80a6-44973ce909c2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:33:40.915013 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:40.914988    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f5b6605-5592-42d6-80a6-44973ce909c2-model-cache" (OuterVolumeSpecName: "model-cache") pod "9f5b6605-5592-42d6-80a6-44973ce909c2" (UID: "9f5b6605-5592-42d6-80a6-44973ce909c2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:33:40.915097 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:40.915070    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f5b6605-5592-42d6-80a6-44973ce909c2-model-cache\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:33:40.915097 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:40.915086    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f5b6605-5592-42d6-80a6-44973ce909c2-home\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:33:40.915097 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:40.915095    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f5b6605-5592-42d6-80a6-44973ce909c2-tmp-dir\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:33:40.916799 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:40.916777    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f5b6605-5592-42d6-80a6-44973ce909c2-dshm" (OuterVolumeSpecName: "dshm") pod "9f5b6605-5592-42d6-80a6-44973ce909c2" (UID: "9f5b6605-5592-42d6-80a6-44973ce909c2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:33:40.916873 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:40.916810    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f5b6605-5592-42d6-80a6-44973ce909c2-kube-api-access-mq9vl" (OuterVolumeSpecName: "kube-api-access-mq9vl") pod "9f5b6605-5592-42d6-80a6-44973ce909c2" (UID: "9f5b6605-5592-42d6-80a6-44973ce909c2"). InnerVolumeSpecName "kube-api-access-mq9vl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:33:40.916873 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:40.916863    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f5b6605-5592-42d6-80a6-44973ce909c2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9f5b6605-5592-42d6-80a6-44973ce909c2" (UID: "9f5b6605-5592-42d6-80a6-44973ce909c2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:33:41.015855 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:41.015832    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f5b6605-5592-42d6-80a6-44973ce909c2-dshm\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:33:41.015855 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:41.015852    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f5b6605-5592-42d6-80a6-44973ce909c2-tls-certs\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:33:41.015983 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:41.015862    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mq9vl\" (UniqueName: \"kubernetes.io/projected/9f5b6605-5592-42d6-80a6-44973ce909c2-kube-api-access-mq9vl\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:33:41.586165 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:41.586119    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss" podUID="40ab0873-82ae-4a33-825a-4bf2373512ac" containerName="main" containerID="cri-o://50e5bead0b47e793ef571466fc7e67ca2312f7895186629ec7fe3bd2618c0f01" gracePeriod=45
Aug 04 18:33:41.752390 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:41.752268    2571 generic.go:356] "Generic (PLEG): container finished" podID="40ab0873-82ae-4a33-825a-4bf2373512ac" containerID="50e5bead0b47e793ef571466fc7e67ca2312f7895186629ec7fe3bd2618c0f01" exitCode=0
Aug 04 18:33:41.752390 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:41.752310    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss" event={"ID":"40ab0873-82ae-4a33-825a-4bf2373512ac","Type":"ContainerDied","Data":"50e5bead0b47e793ef571466fc7e67ca2312f7895186629ec7fe3bd2618c0f01"}
Aug 04 18:33:41.754737 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:41.754710    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h" event={"ID":"9f5b6605-5592-42d6-80a6-44973ce909c2","Type":"ContainerDied","Data":"afbd9fb0df5fdc8b0c8f3714d1b302b47c078c0d32fa7ed5b5b0f4d6f39b2e17"}
Aug 04 18:33:41.754881 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:41.754718    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h"
Aug 04 18:33:41.754881 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:41.754756    2571 scope.go:117] "RemoveContainer" containerID="fb46f1b37806d961fa4f05c5ee0192162318bf6d9e6b0165f9627eee04275a42"
Aug 04 18:33:41.779567 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:41.779510    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h"]
Aug 04 18:33:41.783880 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:41.783861    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-7e1998/test-model-7e1998-kserve-5f8b968b99-kfz5h"]
Aug 04 18:33:41.831831 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:41.831812    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss"
Aug 04 18:33:41.880116 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:41.880055    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f5b6605-5592-42d6-80a6-44973ce909c2" path="/var/lib/kubelet/pods/9f5b6605-5592-42d6-80a6-44973ce909c2/volumes"
Aug 04 18:33:41.922071 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:41.922046    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dj77b\" (UniqueName: \"kubernetes.io/projected/40ab0873-82ae-4a33-825a-4bf2373512ac-kube-api-access-dj77b\") pod \"40ab0873-82ae-4a33-825a-4bf2373512ac\" (UID: \"40ab0873-82ae-4a33-825a-4bf2373512ac\") "
Aug 04 18:33:41.922164 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:41.922107    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40ab0873-82ae-4a33-825a-4bf2373512ac-model-cache\") pod \"40ab0873-82ae-4a33-825a-4bf2373512ac\" (UID: \"40ab0873-82ae-4a33-825a-4bf2373512ac\") "
Aug 04 18:33:41.922164 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:41.922138    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40ab0873-82ae-4a33-825a-4bf2373512ac-tmp-dir\") pod \"40ab0873-82ae-4a33-825a-4bf2373512ac\" (UID: \"40ab0873-82ae-4a33-825a-4bf2373512ac\") "
Aug 04 18:33:41.922164 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:41.922152    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40ab0873-82ae-4a33-825a-4bf2373512ac-home\") pod \"40ab0873-82ae-4a33-825a-4bf2373512ac\" (UID: \"40ab0873-82ae-4a33-825a-4bf2373512ac\") "
Aug 04 18:33:41.922348 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:41.922201    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40ab0873-82ae-4a33-825a-4bf2373512ac-dshm\") pod \"40ab0873-82ae-4a33-825a-4bf2373512ac\" (UID: \"40ab0873-82ae-4a33-825a-4bf2373512ac\") "
Aug 04 18:33:41.922348 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:41.922250    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40ab0873-82ae-4a33-825a-4bf2373512ac-tls-certs\") pod \"40ab0873-82ae-4a33-825a-4bf2373512ac\" (UID: \"40ab0873-82ae-4a33-825a-4bf2373512ac\") "
Aug 04 18:33:41.922454 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:41.922417    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40ab0873-82ae-4a33-825a-4bf2373512ac-home" (OuterVolumeSpecName: "home") pod "40ab0873-82ae-4a33-825a-4bf2373512ac" (UID: "40ab0873-82ae-4a33-825a-4bf2373512ac"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:33:41.922454 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:41.922434    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40ab0873-82ae-4a33-825a-4bf2373512ac-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "40ab0873-82ae-4a33-825a-4bf2373512ac" (UID: "40ab0873-82ae-4a33-825a-4bf2373512ac"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:33:41.922454 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:41.922443    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40ab0873-82ae-4a33-825a-4bf2373512ac-model-cache" (OuterVolumeSpecName: "model-cache") pod "40ab0873-82ae-4a33-825a-4bf2373512ac" (UID: "40ab0873-82ae-4a33-825a-4bf2373512ac"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:33:41.924243 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:41.924221    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40ab0873-82ae-4a33-825a-4bf2373512ac-dshm" (OuterVolumeSpecName: "dshm") pod "40ab0873-82ae-4a33-825a-4bf2373512ac" (UID: "40ab0873-82ae-4a33-825a-4bf2373512ac"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:33:41.924336 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:41.924285    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40ab0873-82ae-4a33-825a-4bf2373512ac-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "40ab0873-82ae-4a33-825a-4bf2373512ac" (UID: "40ab0873-82ae-4a33-825a-4bf2373512ac"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:33:41.924384 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:41.924363    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40ab0873-82ae-4a33-825a-4bf2373512ac-kube-api-access-dj77b" (OuterVolumeSpecName: "kube-api-access-dj77b") pod "40ab0873-82ae-4a33-825a-4bf2373512ac" (UID: "40ab0873-82ae-4a33-825a-4bf2373512ac"). InnerVolumeSpecName "kube-api-access-dj77b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:33:42.023396 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:42.023376    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40ab0873-82ae-4a33-825a-4bf2373512ac-tls-certs\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:33:42.023396 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:42.023397    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dj77b\" (UniqueName: \"kubernetes.io/projected/40ab0873-82ae-4a33-825a-4bf2373512ac-kube-api-access-dj77b\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:33:42.023538 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:42.023406    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40ab0873-82ae-4a33-825a-4bf2373512ac-model-cache\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:33:42.023538 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:42.023415    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40ab0873-82ae-4a33-825a-4bf2373512ac-tmp-dir\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:33:42.023538 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:42.023422    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40ab0873-82ae-4a33-825a-4bf2373512ac-home\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:33:42.023538 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:42.023430    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40ab0873-82ae-4a33-825a-4bf2373512ac-dshm\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:33:42.761194 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:42.761174    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss"
Aug 04 18:33:42.761577 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:42.761167    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss" event={"ID":"40ab0873-82ae-4a33-825a-4bf2373512ac","Type":"ContainerDied","Data":"43fc9aae9cf739e8fdde9c42c2ccb2684c22c9e9b039db05e2e92bdc814c1f84"}
Aug 04 18:33:42.761577 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:42.761305    2571 scope.go:117] "RemoveContainer" containerID="50e5bead0b47e793ef571466fc7e67ca2312f7895186629ec7fe3bd2618c0f01"
Aug 04 18:33:42.781084 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:42.781065    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss"]
Aug 04 18:33:42.784320 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:42.784297    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-8ca2e8/test-model-8ca2e8-kserve-549d4b74ff-ghxss"]
Aug 04 18:33:43.666211 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:43.666179    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"]
Aug 04 18:33:43.666444 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:43.666412    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk" podUID="321e806f-21f1-4cdf-8db8-e76fe6913b5e" containerName="istio-proxy" containerID="cri-o://91b6f87e31fc88cab727834cf5e2392ce9e0cbc603e646490226eb24ccf2d79a" gracePeriod=30
Aug 04 18:33:43.879765 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:43.879731    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40ab0873-82ae-4a33-825a-4bf2373512ac" path="/var/lib/kubelet/pods/40ab0873-82ae-4a33-825a-4bf2373512ac/volumes"
Aug 04 18:33:48.791580 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:48.791555    2571 generic.go:356] "Generic (PLEG): container finished" podID="321e806f-21f1-4cdf-8db8-e76fe6913b5e" containerID="91b6f87e31fc88cab727834cf5e2392ce9e0cbc603e646490226eb24ccf2d79a" exitCode=0
Aug 04 18:33:48.791917 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:48.791630    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk" event={"ID":"321e806f-21f1-4cdf-8db8-e76fe6913b5e","Type":"ContainerDied","Data":"91b6f87e31fc88cab727834cf5e2392ce9e0cbc603e646490226eb24ccf2d79a"}
Aug 04 18:33:48.791917 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:48.791703    2571 scope.go:117] "RemoveContainer" containerID="5967046591eb6bcb65151bb6863dfad63d62a0648fb224c0ee4844f7ef9a9544"
Aug 04 18:33:48.910949 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:48.910926    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:33:49.074534 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:49.074493    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/321e806f-21f1-4cdf-8db8-e76fe6913b5e-credential-socket\") pod \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\" (UID: \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\") "
Aug 04 18:33:49.074655 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:49.074562    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/321e806f-21f1-4cdf-8db8-e76fe6913b5e-istio-token\") pod \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\" (UID: \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\") "
Aug 04 18:33:49.074655 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:49.074586    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/321e806f-21f1-4cdf-8db8-e76fe6913b5e-workload-socket\") pod \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\" (UID: \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\") "
Aug 04 18:33:49.074655 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:49.074613    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kh4qz\" (UniqueName: \"kubernetes.io/projected/321e806f-21f1-4cdf-8db8-e76fe6913b5e-kube-api-access-kh4qz\") pod \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\" (UID: \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\") "
Aug 04 18:33:49.074655 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:49.074642    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/321e806f-21f1-4cdf-8db8-e76fe6913b5e-istio-podinfo\") pod \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\" (UID: \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\") "
Aug 04 18:33:49.074871 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:49.074667    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/321e806f-21f1-4cdf-8db8-e76fe6913b5e-istio-envoy\") pod \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\" (UID: \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\") "
Aug 04 18:33:49.074871 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:49.074730    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/321e806f-21f1-4cdf-8db8-e76fe6913b5e-istiod-ca-cert\") pod \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\" (UID: \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\") "
Aug 04 18:33:49.074871 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:49.074750    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/321e806f-21f1-4cdf-8db8-e76fe6913b5e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "321e806f-21f1-4cdf-8db8-e76fe6913b5e" (UID: "321e806f-21f1-4cdf-8db8-e76fe6913b5e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:33:49.074871 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:49.074760    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/321e806f-21f1-4cdf-8db8-e76fe6913b5e-istio-data\") pod \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\" (UID: \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\") "
Aug 04 18:33:49.074871 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:49.074791    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/321e806f-21f1-4cdf-8db8-e76fe6913b5e-workload-certs\") pod \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\" (UID: \"321e806f-21f1-4cdf-8db8-e76fe6913b5e\") "
Aug 04 18:33:49.075147 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:49.074883    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/321e806f-21f1-4cdf-8db8-e76fe6913b5e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "321e806f-21f1-4cdf-8db8-e76fe6913b5e" (UID: "321e806f-21f1-4cdf-8db8-e76fe6913b5e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:33:49.075147 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:49.075042    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/321e806f-21f1-4cdf-8db8-e76fe6913b5e-credential-socket\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:33:49.075147 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:49.075062    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/321e806f-21f1-4cdf-8db8-e76fe6913b5e-workload-socket\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:33:49.075147 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:49.075096    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/321e806f-21f1-4cdf-8db8-e76fe6913b5e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "321e806f-21f1-4cdf-8db8-e76fe6913b5e" (UID: "321e806f-21f1-4cdf-8db8-e76fe6913b5e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:33:49.075147 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:49.075130    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/321e806f-21f1-4cdf-8db8-e76fe6913b5e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "321e806f-21f1-4cdf-8db8-e76fe6913b5e" (UID: "321e806f-21f1-4cdf-8db8-e76fe6913b5e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:33:49.075410 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:49.075271    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/321e806f-21f1-4cdf-8db8-e76fe6913b5e-istio-data" (OuterVolumeSpecName: "istio-data") pod "321e806f-21f1-4cdf-8db8-e76fe6913b5e" (UID: "321e806f-21f1-4cdf-8db8-e76fe6913b5e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:33:49.076834 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:49.076805    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/321e806f-21f1-4cdf-8db8-e76fe6913b5e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "321e806f-21f1-4cdf-8db8-e76fe6913b5e" (UID: "321e806f-21f1-4cdf-8db8-e76fe6913b5e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:33:49.076941 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:49.076830    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/321e806f-21f1-4cdf-8db8-e76fe6913b5e-istio-token" (OuterVolumeSpecName: "istio-token") pod "321e806f-21f1-4cdf-8db8-e76fe6913b5e" (UID: "321e806f-21f1-4cdf-8db8-e76fe6913b5e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:33:49.076941 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:49.076849    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/321e806f-21f1-4cdf-8db8-e76fe6913b5e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "321e806f-21f1-4cdf-8db8-e76fe6913b5e" (UID: "321e806f-21f1-4cdf-8db8-e76fe6913b5e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 18:33:49.076941 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:49.076920    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/321e806f-21f1-4cdf-8db8-e76fe6913b5e-kube-api-access-kh4qz" (OuterVolumeSpecName: "kube-api-access-kh4qz") pod "321e806f-21f1-4cdf-8db8-e76fe6913b5e" (UID: "321e806f-21f1-4cdf-8db8-e76fe6913b5e"). InnerVolumeSpecName "kube-api-access-kh4qz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:33:49.176074 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:49.176054    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/321e806f-21f1-4cdf-8db8-e76fe6913b5e-istiod-ca-cert\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:33:49.176074 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:49.176073    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/321e806f-21f1-4cdf-8db8-e76fe6913b5e-istio-data\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:33:49.176192 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:49.176081    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/321e806f-21f1-4cdf-8db8-e76fe6913b5e-workload-certs\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:33:49.176192 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:49.176089    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/321e806f-21f1-4cdf-8db8-e76fe6913b5e-istio-token\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:33:49.176192 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:49.176097    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kh4qz\" (UniqueName: \"kubernetes.io/projected/321e806f-21f1-4cdf-8db8-e76fe6913b5e-kube-api-access-kh4qz\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:33:49.176192 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:49.176105    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/321e806f-21f1-4cdf-8db8-e76fe6913b5e-istio-podinfo\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:33:49.176192 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:49.176113    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/321e806f-21f1-4cdf-8db8-e76fe6913b5e-istio-envoy\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:33:49.797462 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:49.797439    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"
Aug 04 18:33:49.797913 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:49.797476    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk" event={"ID":"321e806f-21f1-4cdf-8db8-e76fe6913b5e","Type":"ContainerDied","Data":"110b28935b99279824deb2a29958646f0a6b11dfedad76bd82623eb6df35586b"}
Aug 04 18:33:49.797913 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:49.797546    2571 scope.go:117] "RemoveContainer" containerID="91b6f87e31fc88cab727834cf5e2392ce9e0cbc603e646490226eb24ccf2d79a"
Aug 04 18:33:49.816788 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:49.816768    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"]
Aug 04 18:33:49.820167 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:49.820146    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-7e1998-openshift-default-558d44664-zlpnk"]
Aug 04 18:33:49.884022 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:33:49.880954    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="321e806f-21f1-4cdf-8db8-e76fe6913b5e" path="/var/lib/kubelet/pods/321e806f-21f1-4cdf-8db8-e76fe6913b5e/volumes"
Aug 04 18:34:01.113201 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:01.113164    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"]
Aug 04 18:34:01.113676 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:01.113408    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb" podUID="1753f64b-a6c1-4c13-bd4b-fa511aac641a" containerName="istio-proxy" containerID="cri-o://03c88d96ae50001b241358fb2562657a729ecda2026394ab19d80b1a155364ee" gracePeriod=30
Aug 04 18:34:01.960335 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:01.960304    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"]
Aug 04 18:34:01.960689 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:01.960672    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="321e806f-21f1-4cdf-8db8-e76fe6913b5e" containerName="istio-proxy"
Aug 04 18:34:01.960844 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:01.960691    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="321e806f-21f1-4cdf-8db8-e76fe6913b5e" containerName="istio-proxy"
Aug 04 18:34:01.960844 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:01.960704    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f5b6605-5592-42d6-80a6-44973ce909c2" containerName="main"
Aug 04 18:34:01.960844 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:01.960712    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f5b6605-5592-42d6-80a6-44973ce909c2" containerName="main"
Aug 04 18:34:01.960844 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:01.960719    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40ab0873-82ae-4a33-825a-4bf2373512ac" containerName="main"
Aug 04 18:34:01.960844 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:01.960728    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="40ab0873-82ae-4a33-825a-4bf2373512ac" containerName="main"
Aug 04 18:34:01.960844 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:01.960741    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="321e806f-21f1-4cdf-8db8-e76fe6913b5e" containerName="istio-proxy"
Aug 04 18:34:01.960844 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:01.960749    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="321e806f-21f1-4cdf-8db8-e76fe6913b5e" containerName="istio-proxy"
Aug 04 18:34:01.960844 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:01.960842    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="40ab0873-82ae-4a33-825a-4bf2373512ac" containerName="main"
Aug 04 18:34:01.961227 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:01.960853    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="321e806f-21f1-4cdf-8db8-e76fe6913b5e" containerName="istio-proxy"
Aug 04 18:34:01.961227 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:01.960864    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f5b6605-5592-42d6-80a6-44973ce909c2" containerName="main"
Aug 04 18:34:01.965092 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:01.965072    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:01.967157 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:01.967141    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-16b81f-openshift-default-dockercfg-d78tl\""
Aug 04 18:34:01.976792 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:01.976773    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"]
Aug 04 18:34:02.065437 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:02.065398    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11fe2701-d062-458d-927f-da3166fc2ef3-workload-certs\") pod \"e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d\" (UID: \"11fe2701-d062-458d-927f-da3166fc2ef3\") " pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:02.065651 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:02.065462    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5fvp\" (UniqueName: \"kubernetes.io/projected/11fe2701-d062-458d-927f-da3166fc2ef3-kube-api-access-d5fvp\") pod \"e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d\" (UID: \"11fe2701-d062-458d-927f-da3166fc2ef3\") " pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:02.065651 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:02.065495    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11fe2701-d062-458d-927f-da3166fc2ef3-istio-token\") pod \"e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d\" (UID: \"11fe2701-d062-458d-927f-da3166fc2ef3\") " pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:02.065651 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:02.065608    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11fe2701-d062-458d-927f-da3166fc2ef3-credential-socket\") pod \"e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d\" (UID: \"11fe2701-d062-458d-927f-da3166fc2ef3\") " pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:02.065838 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:02.065667    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11fe2701-d062-458d-927f-da3166fc2ef3-istio-podinfo\") pod \"e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d\" (UID: \"11fe2701-d062-458d-927f-da3166fc2ef3\") " pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:02.065838 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:02.065741    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11fe2701-d062-458d-927f-da3166fc2ef3-istio-data\") pod \"e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d\" (UID: \"11fe2701-d062-458d-927f-da3166fc2ef3\") " pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:02.065838 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:02.065783    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11fe2701-d062-458d-927f-da3166fc2ef3-workload-socket\") pod \"e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d\" (UID: \"11fe2701-d062-458d-927f-da3166fc2ef3\") " pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:02.065838 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:02.065806    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11fe2701-d062-458d-927f-da3166fc2ef3-istiod-ca-cert\") pod \"e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d\" (UID: \"11fe2701-d062-458d-927f-da3166fc2ef3\") " pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:02.066049 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:02.065841    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11fe2701-d062-458d-927f-da3166fc2ef3-istio-envoy\") pod \"e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d\" (UID: \"11fe2701-d062-458d-927f-da3166fc2ef3\") " pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:02.166610 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:02.166579    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11fe2701-d062-458d-927f-da3166fc2ef3-istio-token\") pod \"e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d\" (UID: \"11fe2701-d062-458d-927f-da3166fc2ef3\") " pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:02.167008 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:02.166619    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11fe2701-d062-458d-927f-da3166fc2ef3-credential-socket\") pod \"e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d\" (UID: \"11fe2701-d062-458d-927f-da3166fc2ef3\") " pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:02.167008 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:02.166637    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11fe2701-d062-458d-927f-da3166fc2ef3-istio-podinfo\") pod \"e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d\" (UID: \"11fe2701-d062-458d-927f-da3166fc2ef3\") " pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:02.167008 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:02.166660    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11fe2701-d062-458d-927f-da3166fc2ef3-istio-data\") pod \"e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d\" (UID: \"11fe2701-d062-458d-927f-da3166fc2ef3\") " pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:02.167008 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:02.166794    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11fe2701-d062-458d-927f-da3166fc2ef3-workload-socket\") pod \"e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d\" (UID: \"11fe2701-d062-458d-927f-da3166fc2ef3\") " pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:02.167008 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:02.166832    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11fe2701-d062-458d-927f-da3166fc2ef3-istiod-ca-cert\") pod \"e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d\" (UID: \"11fe2701-d062-458d-927f-da3166fc2ef3\") " pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:02.167008 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:02.166870    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11fe2701-d062-458d-927f-da3166fc2ef3-istio-envoy\") pod \"e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d\" (UID: \"11fe2701-d062-458d-927f-da3166fc2ef3\") " pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:02.167008 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:02.166931    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11fe2701-d062-458d-927f-da3166fc2ef3-workload-certs\") pod \"e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d\" (UID: \"11fe2701-d062-458d-927f-da3166fc2ef3\") " pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:02.167008 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:02.166973    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5fvp\" (UniqueName: \"kubernetes.io/projected/11fe2701-d062-458d-927f-da3166fc2ef3-kube-api-access-d5fvp\") pod \"e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d\" (UID: \"11fe2701-d062-458d-927f-da3166fc2ef3\") " pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:02.167358 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:02.167072    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11fe2701-d062-458d-927f-da3166fc2ef3-istio-data\") pod \"e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d\" (UID: \"11fe2701-d062-458d-927f-da3166fc2ef3\") " pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:02.167358 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:02.167144    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11fe2701-d062-458d-927f-da3166fc2ef3-credential-socket\") pod \"e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d\" (UID: \"11fe2701-d062-458d-927f-da3166fc2ef3\") " pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:02.167358 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:02.167161    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11fe2701-d062-458d-927f-da3166fc2ef3-workload-socket\") pod \"e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d\" (UID: \"11fe2701-d062-458d-927f-da3166fc2ef3\") " pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:02.167358 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:02.167321    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11fe2701-d062-458d-927f-da3166fc2ef3-workload-certs\") pod \"e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d\" (UID: \"11fe2701-d062-458d-927f-da3166fc2ef3\") " pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:02.167595 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:02.167571    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11fe2701-d062-458d-927f-da3166fc2ef3-istiod-ca-cert\") pod \"e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d\" (UID: \"11fe2701-d062-458d-927f-da3166fc2ef3\") " pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:02.168971 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:02.168951    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11fe2701-d062-458d-927f-da3166fc2ef3-istio-envoy\") pod \"e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d\" (UID: \"11fe2701-d062-458d-927f-da3166fc2ef3\") " pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:02.169218 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:02.169199    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11fe2701-d062-458d-927f-da3166fc2ef3-istio-podinfo\") pod \"e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d\" (UID: \"11fe2701-d062-458d-927f-da3166fc2ef3\") " pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:02.173927 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:02.173897    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11fe2701-d062-458d-927f-da3166fc2ef3-istio-token\") pod \"e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d\" (UID: \"11fe2701-d062-458d-927f-da3166fc2ef3\") " pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:02.174023 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:02.173965    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5fvp\" (UniqueName: \"kubernetes.io/projected/11fe2701-d062-458d-927f-da3166fc2ef3-kube-api-access-d5fvp\") pod \"e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d\" (UID: \"11fe2701-d062-458d-927f-da3166fc2ef3\") " pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:02.274696 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:02.274675    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:02.398690 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:02.398665    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"]
Aug 04 18:34:02.400882 ip-10-0-141-220 kubenswrapper[2571]: W0804 18:34:02.400859    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11fe2701_d062_458d_927f_da3166fc2ef3.slice/crio-86c2b38e3d2f7fb4005438a68ac2fd1ccf5d0b86488d1c263131b06507a32f1e WatchSource:0}: Error finding container 86c2b38e3d2f7fb4005438a68ac2fd1ccf5d0b86488d1c263131b06507a32f1e: Status 404 returned error can't find the container with id 86c2b38e3d2f7fb4005438a68ac2fd1ccf5d0b86488d1c263131b06507a32f1e
Aug 04 18:34:02.403329 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:02.403298    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:34:02.403382 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:02.403360    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:34:02.403426 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:02.403387    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:34:02.857171 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:02.857133    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d" event={"ID":"11fe2701-d062-458d-927f-da3166fc2ef3","Type":"ContainerStarted","Data":"17b47d0c79821ce1bf84778f186ca1d25860f7ce32ef7414acb42f6d68f113a4"}
Aug 04 18:34:02.857334 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:02.857185    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d" event={"ID":"11fe2701-d062-458d-927f-da3166fc2ef3","Type":"ContainerStarted","Data":"86c2b38e3d2f7fb4005438a68ac2fd1ccf5d0b86488d1c263131b06507a32f1e"}
Aug 04 18:34:02.876010 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:02.875964    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d" podStartSLOduration=1.87594962 podStartE2EDuration="1.87594962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:34:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:34:02.874253731 +0000 UTC m=+2859.675390070" watchObservedRunningTime="2026-08-04 18:34:02.87594962 +0000 UTC m=+2859.677085947"
Aug 04 18:34:03.275669 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:03.275640    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:03.280132 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:03.280110    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:03.861972 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:03.861945    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:03.862912 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:03.862893    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:06.356697 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.356672    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:34:06.399567 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.399501    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1753f64b-a6c1-4c13-bd4b-fa511aac641a-istiod-ca-cert\") pod \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\" (UID: \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\") "
Aug 04 18:34:06.399567 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.399557    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1753f64b-a6c1-4c13-bd4b-fa511aac641a-istio-token\") pod \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\" (UID: \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\") "
Aug 04 18:34:06.399732 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.399711    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5bdq\" (UniqueName: \"kubernetes.io/projected/1753f64b-a6c1-4c13-bd4b-fa511aac641a-kube-api-access-n5bdq\") pod \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\" (UID: \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\") "
Aug 04 18:34:06.399772 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.399763    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1753f64b-a6c1-4c13-bd4b-fa511aac641a-credential-socket\") pod \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\" (UID: \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\") "
Aug 04 18:34:06.399811 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.399794    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1753f64b-a6c1-4c13-bd4b-fa511aac641a-istio-envoy\") pod \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\" (UID: \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\") "
Aug 04 18:34:06.399863 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.399844    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1753f64b-a6c1-4c13-bd4b-fa511aac641a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1753f64b-a6c1-4c13-bd4b-fa511aac641a" (UID: "1753f64b-a6c1-4c13-bd4b-fa511aac641a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:34:06.399863 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.399856    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1753f64b-a6c1-4c13-bd4b-fa511aac641a-workload-certs\") pod \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\" (UID: \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\") "
Aug 04 18:34:06.399973 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.399906    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1753f64b-a6c1-4c13-bd4b-fa511aac641a-workload-socket\") pod \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\" (UID: \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\") "
Aug 04 18:34:06.399973 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.399941    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1753f64b-a6c1-4c13-bd4b-fa511aac641a-istio-podinfo\") pod \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\" (UID: \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\") "
Aug 04 18:34:06.400077 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.399980    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1753f64b-a6c1-4c13-bd4b-fa511aac641a-istio-data\") pod \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\" (UID: \"1753f64b-a6c1-4c13-bd4b-fa511aac641a\") "
Aug 04 18:34:06.400077 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.400027    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1753f64b-a6c1-4c13-bd4b-fa511aac641a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1753f64b-a6c1-4c13-bd4b-fa511aac641a" (UID: "1753f64b-a6c1-4c13-bd4b-fa511aac641a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:34:06.400185 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.400076    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1753f64b-a6c1-4c13-bd4b-fa511aac641a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1753f64b-a6c1-4c13-bd4b-fa511aac641a" (UID: "1753f64b-a6c1-4c13-bd4b-fa511aac641a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:34:06.400239 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.400207    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1753f64b-a6c1-4c13-bd4b-fa511aac641a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1753f64b-a6c1-4c13-bd4b-fa511aac641a" (UID: "1753f64b-a6c1-4c13-bd4b-fa511aac641a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:34:06.400297 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.400263    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1753f64b-a6c1-4c13-bd4b-fa511aac641a-istio-data" (OuterVolumeSpecName: "istio-data") pod "1753f64b-a6c1-4c13-bd4b-fa511aac641a" (UID: "1753f64b-a6c1-4c13-bd4b-fa511aac641a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:34:06.400354 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.400325    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1753f64b-a6c1-4c13-bd4b-fa511aac641a-workload-certs\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:34:06.400354 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.400344    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1753f64b-a6c1-4c13-bd4b-fa511aac641a-workload-socket\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:34:06.400454 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.400359    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1753f64b-a6c1-4c13-bd4b-fa511aac641a-istiod-ca-cert\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:34:06.400454 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.400375    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1753f64b-a6c1-4c13-bd4b-fa511aac641a-credential-socket\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:34:06.401777 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.401753    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1753f64b-a6c1-4c13-bd4b-fa511aac641a-istio-token" (OuterVolumeSpecName: "istio-token") pod "1753f64b-a6c1-4c13-bd4b-fa511aac641a" (UID: "1753f64b-a6c1-4c13-bd4b-fa511aac641a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:34:06.401879 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.401833    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1753f64b-a6c1-4c13-bd4b-fa511aac641a-kube-api-access-n5bdq" (OuterVolumeSpecName: "kube-api-access-n5bdq") pod "1753f64b-a6c1-4c13-bd4b-fa511aac641a" (UID: "1753f64b-a6c1-4c13-bd4b-fa511aac641a"). InnerVolumeSpecName "kube-api-access-n5bdq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:34:06.402229 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.402205    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1753f64b-a6c1-4c13-bd4b-fa511aac641a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1753f64b-a6c1-4c13-bd4b-fa511aac641a" (UID: "1753f64b-a6c1-4c13-bd4b-fa511aac641a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:34:06.402229 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.402211    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1753f64b-a6c1-4c13-bd4b-fa511aac641a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1753f64b-a6c1-4c13-bd4b-fa511aac641a" (UID: "1753f64b-a6c1-4c13-bd4b-fa511aac641a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 18:34:06.501385 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.501356    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1753f64b-a6c1-4c13-bd4b-fa511aac641a-istio-podinfo\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:34:06.501385 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.501378    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1753f64b-a6c1-4c13-bd4b-fa511aac641a-istio-data\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:34:06.501385 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.501387    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1753f64b-a6c1-4c13-bd4b-fa511aac641a-istio-token\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:34:06.501583 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.501396    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5bdq\" (UniqueName: \"kubernetes.io/projected/1753f64b-a6c1-4c13-bd4b-fa511aac641a-kube-api-access-n5bdq\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:34:06.501583 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.501404    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1753f64b-a6c1-4c13-bd4b-fa511aac641a-istio-envoy\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:34:06.874839 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.874804    2571 generic.go:356] "Generic (PLEG): container finished" podID="1753f64b-a6c1-4c13-bd4b-fa511aac641a" containerID="03c88d96ae50001b241358fb2562657a729ecda2026394ab19d80b1a155364ee" exitCode=0
Aug 04 18:34:06.874992 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.874847    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"
Aug 04 18:34:06.874992 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.874878    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb" event={"ID":"1753f64b-a6c1-4c13-bd4b-fa511aac641a","Type":"ContainerDied","Data":"03c88d96ae50001b241358fb2562657a729ecda2026394ab19d80b1a155364ee"}
Aug 04 18:34:06.874992 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.874923    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb" event={"ID":"1753f64b-a6c1-4c13-bd4b-fa511aac641a","Type":"ContainerDied","Data":"ec2dcc7622db0c0ab2a4e0a906c15f8bf997b978a303a52a4aca92af49a84b48"}
Aug 04 18:34:06.874992 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.874947    2571 scope.go:117] "RemoveContainer" containerID="03c88d96ae50001b241358fb2562657a729ecda2026394ab19d80b1a155364ee"
Aug 04 18:34:06.883989 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.883974    2571 scope.go:117] "RemoveContainer" containerID="f9a9913311a4ca222bdd67ac66191ef9531288f95b1a1830f9c730da0bf2c97a"
Aug 04 18:34:06.891227 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.891211    2571 scope.go:117] "RemoveContainer" containerID="03c88d96ae50001b241358fb2562657a729ecda2026394ab19d80b1a155364ee"
Aug 04 18:34:06.891469 ip-10-0-141-220 kubenswrapper[2571]: E0804 18:34:06.891452    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03c88d96ae50001b241358fb2562657a729ecda2026394ab19d80b1a155364ee\": container with ID starting with 03c88d96ae50001b241358fb2562657a729ecda2026394ab19d80b1a155364ee not found: ID does not exist" containerID="03c88d96ae50001b241358fb2562657a729ecda2026394ab19d80b1a155364ee"
Aug 04 18:34:06.891515 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.891477    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03c88d96ae50001b241358fb2562657a729ecda2026394ab19d80b1a155364ee"} err="failed to get container status \"03c88d96ae50001b241358fb2562657a729ecda2026394ab19d80b1a155364ee\": rpc error: code = NotFound desc = could not find container \"03c88d96ae50001b241358fb2562657a729ecda2026394ab19d80b1a155364ee\": container with ID starting with 03c88d96ae50001b241358fb2562657a729ecda2026394ab19d80b1a155364ee not found: ID does not exist"
Aug 04 18:34:06.891515 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.891493    2571 scope.go:117] "RemoveContainer" containerID="f9a9913311a4ca222bdd67ac66191ef9531288f95b1a1830f9c730da0bf2c97a"
Aug 04 18:34:06.891769 ip-10-0-141-220 kubenswrapper[2571]: E0804 18:34:06.891751    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9a9913311a4ca222bdd67ac66191ef9531288f95b1a1830f9c730da0bf2c97a\": container with ID starting with f9a9913311a4ca222bdd67ac66191ef9531288f95b1a1830f9c730da0bf2c97a not found: ID does not exist" containerID="f9a9913311a4ca222bdd67ac66191ef9531288f95b1a1830f9c730da0bf2c97a"
Aug 04 18:34:06.891846 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.891774    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9a9913311a4ca222bdd67ac66191ef9531288f95b1a1830f9c730da0bf2c97a"} err="failed to get container status \"f9a9913311a4ca222bdd67ac66191ef9531288f95b1a1830f9c730da0bf2c97a\": rpc error: code = NotFound desc = could not find container \"f9a9913311a4ca222bdd67ac66191ef9531288f95b1a1830f9c730da0bf2c97a\": container with ID starting with f9a9913311a4ca222bdd67ac66191ef9531288f95b1a1830f9c730da0bf2c97a not found: ID does not exist"
Aug 04 18:34:06.895441 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.895420    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"]
Aug 04 18:34:06.898866 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:06.898847    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-8ca2e8-openshift-default-76699cfcfd-jf5zb"]
Aug 04 18:34:07.880100 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:07.880068    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1753f64b-a6c1-4c13-bd4b-fa511aac641a" path="/var/lib/kubelet/pods/1753f64b-a6c1-4c13-bd4b-fa511aac641a/volumes"
Aug 04 18:34:17.924008 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:17.923940    2571 generic.go:356] "Generic (PLEG): container finished" podID="11fe2701-d062-458d-927f-da3166fc2ef3" containerID="17b47d0c79821ce1bf84778f186ca1d25860f7ce32ef7414acb42f6d68f113a4" exitCode=0
Aug 04 18:34:17.924008 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:17.923987    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d" event={"ID":"11fe2701-d062-458d-927f-da3166fc2ef3","Type":"ContainerDied","Data":"17b47d0c79821ce1bf84778f186ca1d25860f7ce32ef7414acb42f6d68f113a4"}
Aug 04 18:34:17.924364 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:17.924277    2571 scope.go:117] "RemoveContainer" containerID="17b47d0c79821ce1bf84778f186ca1d25860f7ce32ef7414acb42f6d68f113a4"
Aug 04 18:34:17.925294 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:17.925266    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:34:17.925404 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:17.925338    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:34:17.925404 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:17.925371    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:34:18.862275 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:18.862240    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:18.933492 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:18.933451    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d" event={"ID":"11fe2701-d062-458d-927f-da3166fc2ef3","Type":"ContainerStarted","Data":"8b61df3378738892735889e544d668746b4fa4d587f8baf93ecb8b08cad17717"}
Aug 04 18:34:19.275286 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:19.275258    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:19.275984 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:19.275966    2571 patch_prober.go:28] interesting pod/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Aug 04 18:34:19.276051 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:19.276016    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d" podUID="11fe2701-d062-458d-927f-da3166fc2ef3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Aug 04 18:34:20.276019 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:20.275984    2571 patch_prober.go:28] interesting pod/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Aug 04 18:34:20.276435 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:20.276046    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d" podUID="11fe2701-d062-458d-927f-da3166fc2ef3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Aug 04 18:34:21.275486 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:21.275452    2571 patch_prober.go:28] interesting pod/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Aug 04 18:34:21.275672 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:21.275508    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d" podUID="11fe2701-d062-458d-927f-da3166fc2ef3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Aug 04 18:34:22.275625 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:22.275589    2571 patch_prober.go:28] interesting pod/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Aug 04 18:34:22.276009 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:22.275645    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d" podUID="11fe2701-d062-458d-927f-da3166fc2ef3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Aug 04 18:34:23.275786 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:23.275752    2571 patch_prober.go:28] interesting pod/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Aug 04 18:34:23.276174 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:23.275821    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d" podUID="11fe2701-d062-458d-927f-da3166fc2ef3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Aug 04 18:34:24.279421 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:24.279388    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:24.279822 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:24.279760    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:24.280488 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:24.280470    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:34:30.449263 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.449225    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"]
Aug 04 18:34:30.449748 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.449660    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1753f64b-a6c1-4c13-bd4b-fa511aac641a" containerName="istio-proxy"
Aug 04 18:34:30.449748 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.449679    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1753f64b-a6c1-4c13-bd4b-fa511aac641a" containerName="istio-proxy"
Aug 04 18:34:30.449870 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.449790    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="321e806f-21f1-4cdf-8db8-e76fe6913b5e" containerName="istio-proxy"
Aug 04 18:34:30.449870 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.449806    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1753f64b-a6c1-4c13-bd4b-fa511aac641a" containerName="istio-proxy"
Aug 04 18:34:30.449870 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.449816    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1753f64b-a6c1-4c13-bd4b-fa511aac641a" containerName="istio-proxy"
Aug 04 18:34:30.454489 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.454468    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:34:30.456918 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.456897    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-95cf1a-openshift-default-dockercfg-ckjk2\""
Aug 04 18:34:30.464248 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.464223    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"]
Aug 04 18:34:30.590914 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.590884    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6435b7b-1c46-4744-a888-f5f0cb3abbff-credential-socket\") pod \"e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77\" (UID: \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\") " pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:34:30.590914 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.590916    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6435b7b-1c46-4744-a888-f5f0cb3abbff-istio-token\") pod \"e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77\" (UID: \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\") " pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:34:30.591115 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.590939    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6435b7b-1c46-4744-a888-f5f0cb3abbff-istio-data\") pod \"e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77\" (UID: \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\") " pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:34:30.591115 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.591050    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfdqb\" (UniqueName: \"kubernetes.io/projected/a6435b7b-1c46-4744-a888-f5f0cb3abbff-kube-api-access-wfdqb\") pod \"e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77\" (UID: \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\") " pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:34:30.591115 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.591078    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6435b7b-1c46-4744-a888-f5f0cb3abbff-workload-certs\") pod \"e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77\" (UID: \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\") " pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:34:30.591224 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.591121    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6435b7b-1c46-4744-a888-f5f0cb3abbff-workload-socket\") pod \"e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77\" (UID: \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\") " pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:34:30.591224 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.591146    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6435b7b-1c46-4744-a888-f5f0cb3abbff-istio-podinfo\") pod \"e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77\" (UID: \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\") " pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:34:30.591224 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.591170    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6435b7b-1c46-4744-a888-f5f0cb3abbff-istiod-ca-cert\") pod \"e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77\" (UID: \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\") " pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:34:30.591224 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.591191    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6435b7b-1c46-4744-a888-f5f0cb3abbff-istio-envoy\") pod \"e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77\" (UID: \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\") " pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:34:30.692454 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.692426    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfdqb\" (UniqueName: \"kubernetes.io/projected/a6435b7b-1c46-4744-a888-f5f0cb3abbff-kube-api-access-wfdqb\") pod \"e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77\" (UID: \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\") " pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:34:30.692612 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.692460    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6435b7b-1c46-4744-a888-f5f0cb3abbff-workload-certs\") pod \"e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77\" (UID: \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\") " pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:34:30.692612 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.692487    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6435b7b-1c46-4744-a888-f5f0cb3abbff-workload-socket\") pod \"e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77\" (UID: \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\") " pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:34:30.692612 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.692518    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6435b7b-1c46-4744-a888-f5f0cb3abbff-istio-podinfo\") pod \"e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77\" (UID: \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\") " pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:34:30.692612 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.692553    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6435b7b-1c46-4744-a888-f5f0cb3abbff-istiod-ca-cert\") pod \"e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77\" (UID: \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\") " pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:34:30.692612 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.692580    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6435b7b-1c46-4744-a888-f5f0cb3abbff-istio-envoy\") pod \"e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77\" (UID: \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\") " pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:34:30.692886 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.692755    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6435b7b-1c46-4744-a888-f5f0cb3abbff-credential-socket\") pod \"e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77\" (UID: \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\") " pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:34:30.692886 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.692779    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6435b7b-1c46-4744-a888-f5f0cb3abbff-istio-token\") pod \"e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77\" (UID: \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\") " pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:34:30.692886 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.692809    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6435b7b-1c46-4744-a888-f5f0cb3abbff-istio-data\") pod \"e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77\" (UID: \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\") " pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:34:30.693144 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.693117    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6435b7b-1c46-4744-a888-f5f0cb3abbff-workload-certs\") pod \"e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77\" (UID: \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\") " pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:34:30.693268 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.693156    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6435b7b-1c46-4744-a888-f5f0cb3abbff-workload-socket\") pod \"e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77\" (UID: \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\") " pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:34:30.693268 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.693243    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6435b7b-1c46-4744-a888-f5f0cb3abbff-credential-socket\") pod \"e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77\" (UID: \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\") " pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:34:30.693405 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.693283    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6435b7b-1c46-4744-a888-f5f0cb3abbff-istio-data\") pod \"e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77\" (UID: \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\") " pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:34:30.693478 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.693459    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6435b7b-1c46-4744-a888-f5f0cb3abbff-istiod-ca-cert\") pod \"e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77\" (UID: \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\") " pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:34:30.694816 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.694795    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6435b7b-1c46-4744-a888-f5f0cb3abbff-istio-envoy\") pod \"e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77\" (UID: \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\") " pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:34:30.695094 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.695078    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6435b7b-1c46-4744-a888-f5f0cb3abbff-istio-podinfo\") pod \"e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77\" (UID: \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\") " pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:34:30.699840 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.699790    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6435b7b-1c46-4744-a888-f5f0cb3abbff-istio-token\") pod \"e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77\" (UID: \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\") " pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:34:30.700017 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.699999    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfdqb\" (UniqueName: \"kubernetes.io/projected/a6435b7b-1c46-4744-a888-f5f0cb3abbff-kube-api-access-wfdqb\") pod \"e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77\" (UID: \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\") " pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:34:30.765003 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.764977    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:34:30.893388 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.893360    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"]
Aug 04 18:34:30.894930 ip-10-0-141-220 kubenswrapper[2571]: W0804 18:34:30.894895    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6435b7b_1c46_4744_a888_f5f0cb3abbff.slice/crio-d3498b9321f5322be9268c81edd1c99709cfce9230a2589bd1b0bcb307595d8f WatchSource:0}: Error finding container d3498b9321f5322be9268c81edd1c99709cfce9230a2589bd1b0bcb307595d8f: Status 404 returned error can't find the container with id d3498b9321f5322be9268c81edd1c99709cfce9230a2589bd1b0bcb307595d8f
Aug 04 18:34:30.896900 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.896868    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:34:30.896988 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.896930    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:34:30.896988 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.896958    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:34:30.988872 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.988844    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77" event={"ID":"a6435b7b-1c46-4744-a888-f5f0cb3abbff","Type":"ContainerStarted","Data":"7c1f9bf2fd3fa50e59be4de78929b040470c70ed4db64814db6d31a8ed6c2083"}
Aug 04 18:34:30.989010 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:30.988895    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77" event={"ID":"a6435b7b-1c46-4744-a888-f5f0cb3abbff","Type":"ContainerStarted","Data":"d3498b9321f5322be9268c81edd1c99709cfce9230a2589bd1b0bcb307595d8f"}
Aug 04 18:34:31.016244 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:31.015038    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77" podStartSLOduration=1.015019039 podStartE2EDuration="1.015019039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:34:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:34:31.014685245 +0000 UTC m=+2887.815821573" watchObservedRunningTime="2026-08-04 18:34:31.015019039 +0000 UTC m=+2887.816155376"
Aug 04 18:34:31.765328 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:31.765291    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:34:31.769743 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:31.769711    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:34:31.992762 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:31.992735    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:34:31.993377 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:31.993360    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:34:46.994576 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:46.994548    2571 patch_prober.go:28] interesting pod/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Aug 04 18:34:46.994950 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:46.994600    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77" podUID="a6435b7b-1c46-4744-a888-f5f0cb3abbff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Aug 04 18:34:47.070826 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:47.070801    2571 generic.go:356] "Generic (PLEG): container finished" podID="a6435b7b-1c46-4744-a888-f5f0cb3abbff" containerID="7c1f9bf2fd3fa50e59be4de78929b040470c70ed4db64814db6d31a8ed6c2083" exitCode=0
Aug 04 18:34:47.070957 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:47.070872    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77" event={"ID":"a6435b7b-1c46-4744-a888-f5f0cb3abbff","Type":"ContainerDied","Data":"7c1f9bf2fd3fa50e59be4de78929b040470c70ed4db64814db6d31a8ed6c2083"}
Aug 04 18:34:47.071249 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:47.071236    2571 scope.go:117] "RemoveContainer" containerID="7c1f9bf2fd3fa50e59be4de78929b040470c70ed4db64814db6d31a8ed6c2083"
Aug 04 18:34:47.072225 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:47.072198    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:34:47.072289 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:47.072274    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:34:47.072332 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:47.072309    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:34:48.076976 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:48.076944    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77" event={"ID":"a6435b7b-1c46-4744-a888-f5f0cb3abbff","Type":"ContainerStarted","Data":"f141d97b7548edfc1b14988f70f3a9c09813054cd70a7a9e578ca1617d1bf115"}
Aug 04 18:34:48.766046 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:48.766013    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:34:48.766245 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:48.766225    2571 patch_prober.go:28] interesting pod/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Aug 04 18:34:48.766292 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:48.766277    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77" podUID="a6435b7b-1c46-4744-a888-f5f0cb3abbff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Aug 04 18:34:49.766243 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:49.766211    2571 patch_prober.go:28] interesting pod/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Aug 04 18:34:49.766636 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:49.766260    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77" podUID="a6435b7b-1c46-4744-a888-f5f0cb3abbff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Aug 04 18:34:50.765389 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:50.765351    2571 patch_prober.go:28] interesting pod/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Aug 04 18:34:50.765582 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:50.765408    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77" podUID="a6435b7b-1c46-4744-a888-f5f0cb3abbff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Aug 04 18:34:51.766105 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:51.766066    2571 patch_prober.go:28] interesting pod/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Aug 04 18:34:51.766594 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:51.766128    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77" podUID="a6435b7b-1c46-4744-a888-f5f0cb3abbff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Aug 04 18:34:52.765801 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:52.765766    2571 patch_prober.go:28] interesting pod/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Aug 04 18:34:52.765968 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:52.765818    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77" podUID="a6435b7b-1c46-4744-a888-f5f0cb3abbff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Aug 04 18:34:53.769482 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:53.769452    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:34:53.769941 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:53.769732    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:34:53.770504 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:34:53.770487    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:35:22.524927 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:22.524892    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"]
Aug 04 18:35:22.525443 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:22.525102    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d" podUID="11fe2701-d062-458d-927f-da3166fc2ef3" containerName="istio-proxy" containerID="cri-o://8b61df3378738892735889e544d668746b4fa4d587f8baf93ecb8b08cad17717" gracePeriod=30
Aug 04 18:35:24.281109 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:24.281074    2571 patch_prober.go:28] interesting pod/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 18:35:24.281473 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:24.281135    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d" podUID="11fe2701-d062-458d-927f-da3166fc2ef3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:35:27.765631 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:27.765607    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:35:27.818503 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:27.818446    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11fe2701-d062-458d-927f-da3166fc2ef3-istio-envoy\") pod \"11fe2701-d062-458d-927f-da3166fc2ef3\" (UID: \"11fe2701-d062-458d-927f-da3166fc2ef3\") "
Aug 04 18:35:27.818503 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:27.818479    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11fe2701-d062-458d-927f-da3166fc2ef3-istio-podinfo\") pod \"11fe2701-d062-458d-927f-da3166fc2ef3\" (UID: \"11fe2701-d062-458d-927f-da3166fc2ef3\") "
Aug 04 18:35:27.818503 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:27.818496    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11fe2701-d062-458d-927f-da3166fc2ef3-istio-data\") pod \"11fe2701-d062-458d-927f-da3166fc2ef3\" (UID: \"11fe2701-d062-458d-927f-da3166fc2ef3\") "
Aug 04 18:35:27.818694 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:27.818578    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11fe2701-d062-458d-927f-da3166fc2ef3-istiod-ca-cert\") pod \"11fe2701-d062-458d-927f-da3166fc2ef3\" (UID: \"11fe2701-d062-458d-927f-da3166fc2ef3\") "
Aug 04 18:35:27.818694 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:27.818642    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5fvp\" (UniqueName: \"kubernetes.io/projected/11fe2701-d062-458d-927f-da3166fc2ef3-kube-api-access-d5fvp\") pod \"11fe2701-d062-458d-927f-da3166fc2ef3\" (UID: \"11fe2701-d062-458d-927f-da3166fc2ef3\") "
Aug 04 18:35:27.818694 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:27.818682    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11fe2701-d062-458d-927f-da3166fc2ef3-workload-certs\") pod \"11fe2701-d062-458d-927f-da3166fc2ef3\" (UID: \"11fe2701-d062-458d-927f-da3166fc2ef3\") "
Aug 04 18:35:27.818854 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:27.818705    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11fe2701-d062-458d-927f-da3166fc2ef3-credential-socket\") pod \"11fe2701-d062-458d-927f-da3166fc2ef3\" (UID: \"11fe2701-d062-458d-927f-da3166fc2ef3\") "
Aug 04 18:35:27.818854 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:27.818733    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11fe2701-d062-458d-927f-da3166fc2ef3-workload-socket\") pod \"11fe2701-d062-458d-927f-da3166fc2ef3\" (UID: \"11fe2701-d062-458d-927f-da3166fc2ef3\") "
Aug 04 18:35:27.818854 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:27.818771    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11fe2701-d062-458d-927f-da3166fc2ef3-istio-token\") pod \"11fe2701-d062-458d-927f-da3166fc2ef3\" (UID: \"11fe2701-d062-458d-927f-da3166fc2ef3\") "
Aug 04 18:35:27.819019 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:27.818847    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11fe2701-d062-458d-927f-da3166fc2ef3-istio-data" (OuterVolumeSpecName: "istio-data") pod "11fe2701-d062-458d-927f-da3166fc2ef3" (UID: "11fe2701-d062-458d-927f-da3166fc2ef3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:35:27.819019 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:27.818952    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11fe2701-d062-458d-927f-da3166fc2ef3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "11fe2701-d062-458d-927f-da3166fc2ef3" (UID: "11fe2701-d062-458d-927f-da3166fc2ef3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:35:27.819125 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:27.819062    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11fe2701-d062-458d-927f-da3166fc2ef3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "11fe2701-d062-458d-927f-da3166fc2ef3" (UID: "11fe2701-d062-458d-927f-da3166fc2ef3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:35:27.819125 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:27.819090    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11fe2701-d062-458d-927f-da3166fc2ef3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "11fe2701-d062-458d-927f-da3166fc2ef3" (UID: "11fe2701-d062-458d-927f-da3166fc2ef3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:35:27.819229 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:27.819145    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11fe2701-d062-458d-927f-da3166fc2ef3-istiod-ca-cert\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:35:27.819229 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:27.819164    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11fe2701-d062-458d-927f-da3166fc2ef3-workload-certs\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:35:27.819229 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:27.819177    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11fe2701-d062-458d-927f-da3166fc2ef3-istio-data\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:35:27.819348 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:27.819271    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11fe2701-d062-458d-927f-da3166fc2ef3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "11fe2701-d062-458d-927f-da3166fc2ef3" (UID: "11fe2701-d062-458d-927f-da3166fc2ef3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:35:27.820616 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:27.820593    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11fe2701-d062-458d-927f-da3166fc2ef3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "11fe2701-d062-458d-927f-da3166fc2ef3" (UID: "11fe2701-d062-458d-927f-da3166fc2ef3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:35:27.820741 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:27.820725    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11fe2701-d062-458d-927f-da3166fc2ef3-kube-api-access-d5fvp" (OuterVolumeSpecName: "kube-api-access-d5fvp") pod "11fe2701-d062-458d-927f-da3166fc2ef3" (UID: "11fe2701-d062-458d-927f-da3166fc2ef3"). InnerVolumeSpecName "kube-api-access-d5fvp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:35:27.820984 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:27.820962    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/11fe2701-d062-458d-927f-da3166fc2ef3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "11fe2701-d062-458d-927f-da3166fc2ef3" (UID: "11fe2701-d062-458d-927f-da3166fc2ef3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 18:35:27.821073 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:27.821061    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11fe2701-d062-458d-927f-da3166fc2ef3-istio-token" (OuterVolumeSpecName: "istio-token") pod "11fe2701-d062-458d-927f-da3166fc2ef3" (UID: "11fe2701-d062-458d-927f-da3166fc2ef3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:35:27.919426 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:27.919402    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5fvp\" (UniqueName: \"kubernetes.io/projected/11fe2701-d062-458d-927f-da3166fc2ef3-kube-api-access-d5fvp\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:35:27.919426 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:27.919422    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11fe2701-d062-458d-927f-da3166fc2ef3-credential-socket\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:35:27.919588 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:27.919437    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11fe2701-d062-458d-927f-da3166fc2ef3-workload-socket\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:35:27.919588 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:27.919449    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11fe2701-d062-458d-927f-da3166fc2ef3-istio-token\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:35:27.919588 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:27.919461    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11fe2701-d062-458d-927f-da3166fc2ef3-istio-envoy\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:35:27.919588 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:27.919473    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11fe2701-d062-458d-927f-da3166fc2ef3-istio-podinfo\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:35:28.235950 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:28.235894    2571 generic.go:356] "Generic (PLEG): container finished" podID="11fe2701-d062-458d-927f-da3166fc2ef3" containerID="8b61df3378738892735889e544d668746b4fa4d587f8baf93ecb8b08cad17717" exitCode=0
Aug 04 18:35:28.236036 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:28.235964    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"
Aug 04 18:35:28.236036 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:28.235989    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d" event={"ID":"11fe2701-d062-458d-927f-da3166fc2ef3","Type":"ContainerDied","Data":"8b61df3378738892735889e544d668746b4fa4d587f8baf93ecb8b08cad17717"}
Aug 04 18:35:28.236114 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:28.236043    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d" event={"ID":"11fe2701-d062-458d-927f-da3166fc2ef3","Type":"ContainerDied","Data":"86c2b38e3d2f7fb4005438a68ac2fd1ccf5d0b86488d1c263131b06507a32f1e"}
Aug 04 18:35:28.236114 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:28.236066    2571 scope.go:117] "RemoveContainer" containerID="8b61df3378738892735889e544d668746b4fa4d587f8baf93ecb8b08cad17717"
Aug 04 18:35:28.244369 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:28.244353    2571 scope.go:117] "RemoveContainer" containerID="17b47d0c79821ce1bf84778f186ca1d25860f7ce32ef7414acb42f6d68f113a4"
Aug 04 18:35:28.251431 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:28.251416    2571 scope.go:117] "RemoveContainer" containerID="8b61df3378738892735889e544d668746b4fa4d587f8baf93ecb8b08cad17717"
Aug 04 18:35:28.251682 ip-10-0-141-220 kubenswrapper[2571]: E0804 18:35:28.251666    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b61df3378738892735889e544d668746b4fa4d587f8baf93ecb8b08cad17717\": container with ID starting with 8b61df3378738892735889e544d668746b4fa4d587f8baf93ecb8b08cad17717 not found: ID does not exist" containerID="8b61df3378738892735889e544d668746b4fa4d587f8baf93ecb8b08cad17717"
Aug 04 18:35:28.251747 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:28.251687    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b61df3378738892735889e544d668746b4fa4d587f8baf93ecb8b08cad17717"} err="failed to get container status \"8b61df3378738892735889e544d668746b4fa4d587f8baf93ecb8b08cad17717\": rpc error: code = NotFound desc = could not find container \"8b61df3378738892735889e544d668746b4fa4d587f8baf93ecb8b08cad17717\": container with ID starting with 8b61df3378738892735889e544d668746b4fa4d587f8baf93ecb8b08cad17717 not found: ID does not exist"
Aug 04 18:35:28.251747 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:28.251702    2571 scope.go:117] "RemoveContainer" containerID="17b47d0c79821ce1bf84778f186ca1d25860f7ce32ef7414acb42f6d68f113a4"
Aug 04 18:35:28.251960 ip-10-0-141-220 kubenswrapper[2571]: E0804 18:35:28.251942    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17b47d0c79821ce1bf84778f186ca1d25860f7ce32ef7414acb42f6d68f113a4\": container with ID starting with 17b47d0c79821ce1bf84778f186ca1d25860f7ce32ef7414acb42f6d68f113a4 not found: ID does not exist" containerID="17b47d0c79821ce1bf84778f186ca1d25860f7ce32ef7414acb42f6d68f113a4"
Aug 04 18:35:28.252014 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:28.251967    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17b47d0c79821ce1bf84778f186ca1d25860f7ce32ef7414acb42f6d68f113a4"} err="failed to get container status \"17b47d0c79821ce1bf84778f186ca1d25860f7ce32ef7414acb42f6d68f113a4\": rpc error: code = NotFound desc = could not find container \"17b47d0c79821ce1bf84778f186ca1d25860f7ce32ef7414acb42f6d68f113a4\": container with ID starting with 17b47d0c79821ce1bf84778f186ca1d25860f7ce32ef7414acb42f6d68f113a4 not found: ID does not exist"
Aug 04 18:35:28.254695 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:28.254674    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"]
Aug 04 18:35:28.257187 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:28.257168    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-16b81f-openshift-default-68c5dfb464-4w47d"]
Aug 04 18:35:29.878989 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:29.878960    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11fe2701-d062-458d-927f-da3166fc2ef3" path="/var/lib/kubelet/pods/11fe2701-d062-458d-927f-da3166fc2ef3/volumes"
Aug 04 18:35:44.807617 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:44.807586    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"]
Aug 04 18:35:44.808033 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:44.807799    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77" podUID="a6435b7b-1c46-4744-a888-f5f0cb3abbff" containerName="istio-proxy" containerID="cri-o://f141d97b7548edfc1b14988f70f3a9c09813054cd70a7a9e578ca1617d1bf115" gracePeriod=30
Aug 04 18:35:45.626887 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.626850    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"]
Aug 04 18:35:45.627158 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.627144    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11fe2701-d062-458d-927f-da3166fc2ef3" containerName="istio-proxy"
Aug 04 18:35:45.627208 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.627159    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="11fe2701-d062-458d-927f-da3166fc2ef3" containerName="istio-proxy"
Aug 04 18:35:45.627208 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.627167    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11fe2701-d062-458d-927f-da3166fc2ef3" containerName="istio-proxy"
Aug 04 18:35:45.627208 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.627172    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="11fe2701-d062-458d-927f-da3166fc2ef3" containerName="istio-proxy"
Aug 04 18:35:45.627208 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.627179    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1753f64b-a6c1-4c13-bd4b-fa511aac641a" containerName="istio-proxy"
Aug 04 18:35:45.627208 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.627185    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1753f64b-a6c1-4c13-bd4b-fa511aac641a" containerName="istio-proxy"
Aug 04 18:35:45.627388 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.627236    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="11fe2701-d062-458d-927f-da3166fc2ef3" containerName="istio-proxy"
Aug 04 18:35:45.627388 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.627242    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="11fe2701-d062-458d-927f-da3166fc2ef3" containerName="istio-proxy"
Aug 04 18:35:45.628860 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.628845    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:35:45.631126 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.631108    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-4659f1-openshift-default-dockercfg-fkn8m\""
Aug 04 18:35:45.642447 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.642427    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"]
Aug 04 18:35:45.749265 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.749231    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-istio-podinfo\") pod \"e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx\" (UID: \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\") " pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:35:45.749265 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.749269    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-istiod-ca-cert\") pod \"e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx\" (UID: \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\") " pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:35:45.749465 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.749288    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-workload-socket\") pod \"e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx\" (UID: \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\") " pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:35:45.749465 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.749339    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-istio-data\") pod \"e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx\" (UID: \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\") " pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:35:45.749465 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.749359    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2vfn\" (UniqueName: \"kubernetes.io/projected/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-kube-api-access-g2vfn\") pod \"e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx\" (UID: \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\") " pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:35:45.749465 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.749413    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-istio-envoy\") pod \"e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx\" (UID: \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\") " pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:35:45.749465 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.749433    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-workload-certs\") pod \"e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx\" (UID: \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\") " pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:35:45.749658 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.749476    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-istio-token\") pod \"e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx\" (UID: \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\") " pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:35:45.749658 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.749498    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-credential-socket\") pod \"e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx\" (UID: \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\") " pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:35:45.850352 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.850324    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-credential-socket\") pod \"e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx\" (UID: \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\") " pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:35:45.850764 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.850362    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-istio-podinfo\") pod \"e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx\" (UID: \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\") " pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:35:45.850764 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.850387    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-istiod-ca-cert\") pod \"e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx\" (UID: \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\") " pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:35:45.850764 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.850509    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-workload-socket\") pod \"e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx\" (UID: \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\") " pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:35:45.850764 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.850573    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-istio-data\") pod \"e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx\" (UID: \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\") " pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:35:45.850764 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.850606    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2vfn\" (UniqueName: \"kubernetes.io/projected/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-kube-api-access-g2vfn\") pod \"e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx\" (UID: \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\") " pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:35:45.850764 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.850689    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-istio-envoy\") pod \"e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx\" (UID: \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\") " pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:35:45.850764 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.850718    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-workload-certs\") pod \"e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx\" (UID: \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\") " pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:35:45.850764 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.850755    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-istio-token\") pod \"e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx\" (UID: \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\") " pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:35:45.851221 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.850788    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-credential-socket\") pod \"e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx\" (UID: \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\") " pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:35:45.851221 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.850978    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-istio-data\") pod \"e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx\" (UID: \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\") " pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:35:45.851221 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.851053    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-workload-certs\") pod \"e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx\" (UID: \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\") " pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:35:45.851221 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.851121    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-istiod-ca-cert\") pod \"e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx\" (UID: \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\") " pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:35:45.851221 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.851128    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-workload-socket\") pod \"e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx\" (UID: \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\") " pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:35:45.852824 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.852798    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-istio-envoy\") pod \"e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx\" (UID: \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\") " pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:35:45.852938 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.852907    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-istio-podinfo\") pod \"e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx\" (UID: \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\") " pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:35:45.858419 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.858395    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2vfn\" (UniqueName: \"kubernetes.io/projected/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-kube-api-access-g2vfn\") pod \"e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx\" (UID: \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\") " pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:35:45.858538 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.858400    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-istio-token\") pod \"e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx\" (UID: \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\") " pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:35:45.939377 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:45.939318    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:35:46.068116 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:46.068096    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"]
Aug 04 18:35:46.070538 ip-10-0-141-220 kubenswrapper[2571]: W0804 18:35:46.070497    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41fbed05_4340_4aa4_b0a9_3ab6c0fe5fc8.slice/crio-d89e59416c33671a1139663e3bc8394576e9aae3850d93c60db3650a5a73c89e WatchSource:0}: Error finding container d89e59416c33671a1139663e3bc8394576e9aae3850d93c60db3650a5a73c89e: Status 404 returned error can't find the container with id d89e59416c33671a1139663e3bc8394576e9aae3850d93c60db3650a5a73c89e
Aug 04 18:35:46.072609 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:46.072576    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:35:46.072692 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:46.072649    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:35:46.072692 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:46.072675    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:35:46.312809 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:46.312776    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx" event={"ID":"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8","Type":"ContainerStarted","Data":"2163d12bd2bebb1def50dec5e3d4e4217be72941bae52cbba02de3df19cd5e23"}
Aug 04 18:35:46.312982 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:46.312826    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx" event={"ID":"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8","Type":"ContainerStarted","Data":"d89e59416c33671a1139663e3bc8394576e9aae3850d93c60db3650a5a73c89e"}
Aug 04 18:35:46.332271 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:46.332222    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx" podStartSLOduration=1.332204506 podStartE2EDuration="1.332204506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:35:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:35:46.330233744 +0000 UTC m=+2963.131370081" watchObservedRunningTime="2026-08-04 18:35:46.332204506 +0000 UTC m=+2963.133340832"
Aug 04 18:35:46.939491 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:46.939462    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:35:47.944379 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:47.944351    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:35:48.320972 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:48.320945    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:35:48.321905 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:48.321884    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:35:50.053297 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.053274    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:35:50.180340 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.180264    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6435b7b-1c46-4744-a888-f5f0cb3abbff-workload-certs\") pod \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\" (UID: \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\") "
Aug 04 18:35:50.180340 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.180296    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6435b7b-1c46-4744-a888-f5f0cb3abbff-istio-token\") pod \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\" (UID: \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\") "
Aug 04 18:35:50.180340 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.180319    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfdqb\" (UniqueName: \"kubernetes.io/projected/a6435b7b-1c46-4744-a888-f5f0cb3abbff-kube-api-access-wfdqb\") pod \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\" (UID: \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\") "
Aug 04 18:35:50.180653 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.180455    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6435b7b-1c46-4744-a888-f5f0cb3abbff-credential-socket\") pod \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\" (UID: \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\") "
Aug 04 18:35:50.180653 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.180503    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6435b7b-1c46-4744-a888-f5f0cb3abbff-istiod-ca-cert\") pod \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\" (UID: \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\") "
Aug 04 18:35:50.180653 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.180562    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6435b7b-1c46-4744-a888-f5f0cb3abbff-istio-data\") pod \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\" (UID: \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\") "
Aug 04 18:35:50.180653 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.180569    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6435b7b-1c46-4744-a888-f5f0cb3abbff-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a6435b7b-1c46-4744-a888-f5f0cb3abbff" (UID: "a6435b7b-1c46-4744-a888-f5f0cb3abbff"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:35:50.180653 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.180587    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6435b7b-1c46-4744-a888-f5f0cb3abbff-istio-envoy\") pod \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\" (UID: \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\") "
Aug 04 18:35:50.180653 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.180635    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6435b7b-1c46-4744-a888-f5f0cb3abbff-istio-podinfo\") pod \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\" (UID: \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\") "
Aug 04 18:35:50.180939 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.180692    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6435b7b-1c46-4744-a888-f5f0cb3abbff-workload-socket\") pod \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\" (UID: \"a6435b7b-1c46-4744-a888-f5f0cb3abbff\") "
Aug 04 18:35:50.180939 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.180687    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6435b7b-1c46-4744-a888-f5f0cb3abbff-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a6435b7b-1c46-4744-a888-f5f0cb3abbff" (UID: "a6435b7b-1c46-4744-a888-f5f0cb3abbff"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:35:50.180939 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.180807    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6435b7b-1c46-4744-a888-f5f0cb3abbff-istio-data" (OuterVolumeSpecName: "istio-data") pod "a6435b7b-1c46-4744-a888-f5f0cb3abbff" (UID: "a6435b7b-1c46-4744-a888-f5f0cb3abbff"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:35:50.180939 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.180891    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6435b7b-1c46-4744-a888-f5f0cb3abbff-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a6435b7b-1c46-4744-a888-f5f0cb3abbff" (UID: "a6435b7b-1c46-4744-a888-f5f0cb3abbff"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:35:50.181125 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.180975    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6435b7b-1c46-4744-a888-f5f0cb3abbff-workload-certs\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:35:50.181125 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.180993    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6435b7b-1c46-4744-a888-f5f0cb3abbff-credential-socket\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:35:50.181125 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.180990    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6435b7b-1c46-4744-a888-f5f0cb3abbff-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a6435b7b-1c46-4744-a888-f5f0cb3abbff" (UID: "a6435b7b-1c46-4744-a888-f5f0cb3abbff"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:35:50.181125 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.181006    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6435b7b-1c46-4744-a888-f5f0cb3abbff-istiod-ca-cert\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:35:50.181125 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.181020    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6435b7b-1c46-4744-a888-f5f0cb3abbff-istio-data\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:35:50.182556 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.182531    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6435b7b-1c46-4744-a888-f5f0cb3abbff-istio-token" (OuterVolumeSpecName: "istio-token") pod "a6435b7b-1c46-4744-a888-f5f0cb3abbff" (UID: "a6435b7b-1c46-4744-a888-f5f0cb3abbff"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:35:50.182691 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.182600    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6435b7b-1c46-4744-a888-f5f0cb3abbff-kube-api-access-wfdqb" (OuterVolumeSpecName: "kube-api-access-wfdqb") pod "a6435b7b-1c46-4744-a888-f5f0cb3abbff" (UID: "a6435b7b-1c46-4744-a888-f5f0cb3abbff"). InnerVolumeSpecName "kube-api-access-wfdqb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:35:50.182954 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.182923    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6435b7b-1c46-4744-a888-f5f0cb3abbff-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a6435b7b-1c46-4744-a888-f5f0cb3abbff" (UID: "a6435b7b-1c46-4744-a888-f5f0cb3abbff"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:35:50.183056 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.183003    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a6435b7b-1c46-4744-a888-f5f0cb3abbff-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a6435b7b-1c46-4744-a888-f5f0cb3abbff" (UID: "a6435b7b-1c46-4744-a888-f5f0cb3abbff"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 18:35:50.282067 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.282044    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6435b7b-1c46-4744-a888-f5f0cb3abbff-istio-envoy\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:35:50.282067 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.282065    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6435b7b-1c46-4744-a888-f5f0cb3abbff-istio-podinfo\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:35:50.282192 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.282074    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6435b7b-1c46-4744-a888-f5f0cb3abbff-workload-socket\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:35:50.282192 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.282083    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6435b7b-1c46-4744-a888-f5f0cb3abbff-istio-token\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:35:50.282192 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.282091    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfdqb\" (UniqueName: \"kubernetes.io/projected/a6435b7b-1c46-4744-a888-f5f0cb3abbff-kube-api-access-wfdqb\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:35:50.330136 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.330111    2571 generic.go:356] "Generic (PLEG): container finished" podID="a6435b7b-1c46-4744-a888-f5f0cb3abbff" containerID="f141d97b7548edfc1b14988f70f3a9c09813054cd70a7a9e578ca1617d1bf115" exitCode=0
Aug 04 18:35:50.330223 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.330161    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"
Aug 04 18:35:50.330223 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.330188    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77" event={"ID":"a6435b7b-1c46-4744-a888-f5f0cb3abbff","Type":"ContainerDied","Data":"f141d97b7548edfc1b14988f70f3a9c09813054cd70a7a9e578ca1617d1bf115"}
Aug 04 18:35:50.330298 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.330249    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77" event={"ID":"a6435b7b-1c46-4744-a888-f5f0cb3abbff","Type":"ContainerDied","Data":"d3498b9321f5322be9268c81edd1c99709cfce9230a2589bd1b0bcb307595d8f"}
Aug 04 18:35:50.330298 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.330274    2571 scope.go:117] "RemoveContainer" containerID="f141d97b7548edfc1b14988f70f3a9c09813054cd70a7a9e578ca1617d1bf115"
Aug 04 18:35:50.338764 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.338747    2571 scope.go:117] "RemoveContainer" containerID="7c1f9bf2fd3fa50e59be4de78929b040470c70ed4db64814db6d31a8ed6c2083"
Aug 04 18:35:50.346299 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.346285    2571 scope.go:117] "RemoveContainer" containerID="f141d97b7548edfc1b14988f70f3a9c09813054cd70a7a9e578ca1617d1bf115"
Aug 04 18:35:50.346553 ip-10-0-141-220 kubenswrapper[2571]: E0804 18:35:50.346509    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f141d97b7548edfc1b14988f70f3a9c09813054cd70a7a9e578ca1617d1bf115\": container with ID starting with f141d97b7548edfc1b14988f70f3a9c09813054cd70a7a9e578ca1617d1bf115 not found: ID does not exist" containerID="f141d97b7548edfc1b14988f70f3a9c09813054cd70a7a9e578ca1617d1bf115"
Aug 04 18:35:50.346597 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.346562    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f141d97b7548edfc1b14988f70f3a9c09813054cd70a7a9e578ca1617d1bf115"} err="failed to get container status \"f141d97b7548edfc1b14988f70f3a9c09813054cd70a7a9e578ca1617d1bf115\": rpc error: code = NotFound desc = could not find container \"f141d97b7548edfc1b14988f70f3a9c09813054cd70a7a9e578ca1617d1bf115\": container with ID starting with f141d97b7548edfc1b14988f70f3a9c09813054cd70a7a9e578ca1617d1bf115 not found: ID does not exist"
Aug 04 18:35:50.346597 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.346580    2571 scope.go:117] "RemoveContainer" containerID="7c1f9bf2fd3fa50e59be4de78929b040470c70ed4db64814db6d31a8ed6c2083"
Aug 04 18:35:50.346809 ip-10-0-141-220 kubenswrapper[2571]: E0804 18:35:50.346790    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c1f9bf2fd3fa50e59be4de78929b040470c70ed4db64814db6d31a8ed6c2083\": container with ID starting with 7c1f9bf2fd3fa50e59be4de78929b040470c70ed4db64814db6d31a8ed6c2083 not found: ID does not exist" containerID="7c1f9bf2fd3fa50e59be4de78929b040470c70ed4db64814db6d31a8ed6c2083"
Aug 04 18:35:50.346868 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.346819    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c1f9bf2fd3fa50e59be4de78929b040470c70ed4db64814db6d31a8ed6c2083"} err="failed to get container status \"7c1f9bf2fd3fa50e59be4de78929b040470c70ed4db64814db6d31a8ed6c2083\": rpc error: code = NotFound desc = could not find container \"7c1f9bf2fd3fa50e59be4de78929b040470c70ed4db64814db6d31a8ed6c2083\": container with ID starting with 7c1f9bf2fd3fa50e59be4de78929b040470c70ed4db64814db6d31a8ed6c2083 not found: ID does not exist"
Aug 04 18:35:50.350585 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.350565    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"]
Aug 04 18:35:50.357001 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:50.356977    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-95cf1a-openshift-default-8d5f47d56-lqt77"]
Aug 04 18:35:51.879637 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:35:51.879600    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6435b7b-1c46-4744-a888-f5f0cb3abbff" path="/var/lib/kubelet/pods/a6435b7b-1c46-4744-a888-f5f0cb3abbff/volumes"
Aug 04 18:36:02.385835 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:02.385800    2571 generic.go:356] "Generic (PLEG): container finished" podID="41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8" containerID="2163d12bd2bebb1def50dec5e3d4e4217be72941bae52cbba02de3df19cd5e23" exitCode=0
Aug 04 18:36:02.386249 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:02.385871    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx" event={"ID":"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8","Type":"ContainerDied","Data":"2163d12bd2bebb1def50dec5e3d4e4217be72941bae52cbba02de3df19cd5e23"}
Aug 04 18:36:02.386249 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:02.386212    2571 scope.go:117] "RemoveContainer" containerID="2163d12bd2bebb1def50dec5e3d4e4217be72941bae52cbba02de3df19cd5e23"
Aug 04 18:36:02.387131 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:02.387100    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:36:02.387226 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:02.387182    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:36:02.387289 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:02.387228    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:36:03.320912 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:03.320876    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:36:03.392000 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:03.391967    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx" event={"ID":"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8","Type":"ContainerStarted","Data":"84a220148effc9d966158322b792040bb9ece01db796ce2f14417e545cfbf892"}
Aug 04 18:36:03.940492 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:03.940450    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:36:03.941626 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:03.941594    2571 patch_prober.go:28] interesting pod/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Aug 04 18:36:03.941785 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:03.941655    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx" podUID="41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Aug 04 18:36:04.939833 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:04.939799    2571 patch_prober.go:28] interesting pod/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Aug 04 18:36:04.940408 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:04.940374    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx" podUID="41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Aug 04 18:36:05.939904 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:05.939863    2571 patch_prober.go:28] interesting pod/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Aug 04 18:36:05.940412 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:05.939940    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx" podUID="41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Aug 04 18:36:06.939767 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:06.939728    2571 patch_prober.go:28] interesting pod/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Aug 04 18:36:06.939975 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:06.939794    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx" podUID="41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Aug 04 18:36:07.939768 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:07.939732    2571 patch_prober.go:28] interesting pod/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Aug 04 18:36:07.940069 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:07.940038    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx" podUID="41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Aug 04 18:36:08.944112 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:08.944081    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:36:08.944506 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:08.944330    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:36:08.945069 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:08.945052    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:36:13.758760 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:13.758730    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"]
Aug 04 18:36:13.759125 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:13.759020    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6435b7b-1c46-4744-a888-f5f0cb3abbff" containerName="istio-proxy"
Aug 04 18:36:13.759125 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:13.759030    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6435b7b-1c46-4744-a888-f5f0cb3abbff" containerName="istio-proxy"
Aug 04 18:36:13.759125 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:13.759042    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6435b7b-1c46-4744-a888-f5f0cb3abbff" containerName="istio-proxy"
Aug 04 18:36:13.759125 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:13.759048    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6435b7b-1c46-4744-a888-f5f0cb3abbff" containerName="istio-proxy"
Aug 04 18:36:13.759125 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:13.759103    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6435b7b-1c46-4744-a888-f5f0cb3abbff" containerName="istio-proxy"
Aug 04 18:36:13.759125 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:13.759112    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6435b7b-1c46-4744-a888-f5f0cb3abbff" containerName="istio-proxy"
Aug 04 18:36:13.761783 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:13.761761    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:36:13.764007 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:13.763985    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-e9be3f-openshift-default-dockercfg-78682\""
Aug 04 18:36:13.778541 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:13.778503    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"]
Aug 04 18:36:13.851266 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:13.851239    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-istio-envoy\") pod \"e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl\" (UID: \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\") " pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:36:13.851493 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:13.851466    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-credential-socket\") pod \"e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl\" (UID: \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\") " pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:36:13.851763 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:13.851511    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-istio-data\") pod \"e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl\" (UID: \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\") " pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:36:13.851763 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:13.851585    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-istiod-ca-cert\") pod \"e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl\" (UID: \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\") " pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:36:13.851763 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:13.851620    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-workload-socket\") pod \"e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl\" (UID: \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\") " pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:36:13.851763 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:13.851653    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm58x\" (UniqueName: \"kubernetes.io/projected/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-kube-api-access-gm58x\") pod \"e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl\" (UID: \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\") " pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:36:13.851763 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:13.851681    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-istio-token\") pod \"e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl\" (UID: \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\") " pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:36:13.851763 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:13.851706    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-istio-podinfo\") pod \"e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl\" (UID: \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\") " pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:36:13.851763 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:13.851730    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-workload-certs\") pod \"e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl\" (UID: \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\") " pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:36:13.952670 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:13.952641    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-istiod-ca-cert\") pod \"e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl\" (UID: \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\") " pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:36:13.952843 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:13.952685    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-workload-socket\") pod \"e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl\" (UID: \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\") " pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:36:13.952843 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:13.952805    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm58x\" (UniqueName: \"kubernetes.io/projected/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-kube-api-access-gm58x\") pod \"e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl\" (UID: \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\") " pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:36:13.952972 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:13.952845    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-istio-token\") pod \"e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl\" (UID: \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\") " pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:36:13.952972 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:13.952883    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-istio-podinfo\") pod \"e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl\" (UID: \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\") " pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:36:13.952972 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:13.952920    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-workload-certs\") pod \"e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl\" (UID: \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\") " pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:36:13.952972 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:13.952966    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-istio-envoy\") pod \"e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl\" (UID: \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\") " pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:36:13.953171 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:13.952992    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-credential-socket\") pod \"e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl\" (UID: \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\") " pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:36:13.953171 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:13.953016    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-istio-data\") pod \"e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl\" (UID: \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\") " pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:36:13.953171 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:13.953079    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-workload-socket\") pod \"e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl\" (UID: \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\") " pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:36:13.953381 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:13.953359    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-workload-certs\") pod \"e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl\" (UID: \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\") " pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:36:13.953465 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:13.953411    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-istio-data\") pod \"e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl\" (UID: \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\") " pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:36:13.953465 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:13.953445    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-credential-socket\") pod \"e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl\" (UID: \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\") " pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:36:13.953585 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:13.953468    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-istiod-ca-cert\") pod \"e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl\" (UID: \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\") " pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:36:13.955187 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:13.955167    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-istio-envoy\") pod \"e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl\" (UID: \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\") " pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:36:13.955404 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:13.955386    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-istio-podinfo\") pod \"e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl\" (UID: \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\") " pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:36:13.959937 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:13.959914    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-istio-token\") pod \"e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl\" (UID: \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\") " pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:36:13.960031 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:13.959947    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm58x\" (UniqueName: \"kubernetes.io/projected/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-kube-api-access-gm58x\") pod \"e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl\" (UID: \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\") " pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:36:14.071034 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:14.071009    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:36:14.202265 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:14.202240    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"]
Aug 04 18:36:14.204403 ip-10-0-141-220 kubenswrapper[2571]: W0804 18:36:14.204379    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a721af7_bd0f_4a60_afc9_e1390b4c4c65.slice/crio-69438eb49ce6a94c05037608f954cf5d0fd631ef833c31eda455bc8c21b7f27d WatchSource:0}: Error finding container 69438eb49ce6a94c05037608f954cf5d0fd631ef833c31eda455bc8c21b7f27d: Status 404 returned error can't find the container with id 69438eb49ce6a94c05037608f954cf5d0fd631ef833c31eda455bc8c21b7f27d
Aug 04 18:36:14.206843 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:14.206808    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:36:14.206934 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:14.206877    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:36:14.206934 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:14.206909    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:36:14.439971 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:14.439881    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl" event={"ID":"7a721af7-bd0f-4a60-afc9-e1390b4c4c65","Type":"ContainerStarted","Data":"e09862795c67cf7c79c09f3a8ed5033828706c8c7dd57e437ee0a9347ee97d78"}
Aug 04 18:36:14.439971 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:14.439950    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl" event={"ID":"7a721af7-bd0f-4a60-afc9-e1390b4c4c65","Type":"ContainerStarted","Data":"69438eb49ce6a94c05037608f954cf5d0fd631ef833c31eda455bc8c21b7f27d"}
Aug 04 18:36:14.457467 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:14.457415    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl" podStartSLOduration=1.457401191 podStartE2EDuration="1.457401191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:36:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:36:14.456198765 +0000 UTC m=+2991.257335093" watchObservedRunningTime="2026-08-04 18:36:14.457401191 +0000 UTC m=+2991.258537588"
Aug 04 18:36:15.071731 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:15.071701    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:36:15.076616 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:15.076595    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:36:15.444424 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:15.444350    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:36:15.445088 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:15.445071    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:36:30.445778 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:30.445711    2571 patch_prober.go:28] interesting pod/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Aug 04 18:36:30.445778 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:30.445764    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl" podUID="7a721af7-bd0f-4a60-afc9-e1390b4c4c65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Aug 04 18:36:30.508009 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:30.507984    2571 generic.go:356] "Generic (PLEG): container finished" podID="7a721af7-bd0f-4a60-afc9-e1390b4c4c65" containerID="e09862795c67cf7c79c09f3a8ed5033828706c8c7dd57e437ee0a9347ee97d78" exitCode=0
Aug 04 18:36:30.508114 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:30.508053    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl" event={"ID":"7a721af7-bd0f-4a60-afc9-e1390b4c4c65","Type":"ContainerDied","Data":"e09862795c67cf7c79c09f3a8ed5033828706c8c7dd57e437ee0a9347ee97d78"}
Aug 04 18:36:30.508448 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:30.508431    2571 scope.go:117] "RemoveContainer" containerID="e09862795c67cf7c79c09f3a8ed5033828706c8c7dd57e437ee0a9347ee97d78"
Aug 04 18:36:30.509417 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:30.509387    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:36:30.509514 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:30.509453    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:36:30.509514 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:30.509488    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:36:31.513818 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:31.513783    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl" event={"ID":"7a721af7-bd0f-4a60-afc9-e1390b4c4c65","Type":"ContainerStarted","Data":"c8a1944b0a86bc1c556a4bc300f6bd31c0ce07f9ee8403cfc3e3067869e55644"}
Aug 04 18:36:32.071437 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:32.071403    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:36:32.071670 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:32.071648    2571 patch_prober.go:28] interesting pod/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Aug 04 18:36:32.071731 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:32.071698    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl" podUID="7a721af7-bd0f-4a60-afc9-e1390b4c4c65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Aug 04 18:36:33.072090 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:33.072053    2571 patch_prober.go:28] interesting pod/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Aug 04 18:36:33.072494 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:33.072106    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl" podUID="7a721af7-bd0f-4a60-afc9-e1390b4c4c65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Aug 04 18:36:34.071657 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:34.071624    2571 patch_prober.go:28] interesting pod/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Aug 04 18:36:34.071836 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:34.071684    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl" podUID="7a721af7-bd0f-4a60-afc9-e1390b4c4c65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Aug 04 18:36:35.072238 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:35.072202    2571 patch_prober.go:28] interesting pod/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Aug 04 18:36:35.072660 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:35.072257    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl" podUID="7a721af7-bd0f-4a60-afc9-e1390b4c4c65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Aug 04 18:36:36.071871 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:36.071839    2571 patch_prober.go:28] interesting pod/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Aug 04 18:36:36.072062 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:36.071899    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl" podUID="7a721af7-bd0f-4a60-afc9-e1390b4c4c65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Aug 04 18:36:37.075606 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:37.075577    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:36:37.076013 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:37.075849    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:36:37.076504 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:37.076488    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:36:47.779644 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:47.779610    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn"]
Aug 04 18:36:47.781623 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:47.781599    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn"
Aug 04 18:36:47.784905 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:47.784881    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-4659f1\"/\"kube-root-ca.crt\""
Aug 04 18:36:47.785025 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:47.784930    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-4659f1\"/\"openshift-service-ca.crt\""
Aug 04 18:36:47.785025 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:47.784888    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4659f1\"/\"default-dockercfg-tvtrp\""
Aug 04 18:36:47.785025 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:47.784881    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4659f1\"/\"auth-test-model-4659f1-kserve-self-signed-certs\""
Aug 04 18:36:47.790667 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:47.790643    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn"]
Aug 04 18:36:47.820506 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:47.820482    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce6d3020-ec1b-430a-bb02-cf76d688ec31-model-cache\") pod \"auth-test-model-4659f1-kserve-54f585f875-k5xcn\" (UID: \"ce6d3020-ec1b-430a-bb02-cf76d688ec31\") " pod="ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn"
Aug 04 18:36:47.820608 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:47.820513    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt2p6\" (UniqueName: \"kubernetes.io/projected/ce6d3020-ec1b-430a-bb02-cf76d688ec31-kube-api-access-lt2p6\") pod \"auth-test-model-4659f1-kserve-54f585f875-k5xcn\" (UID: \"ce6d3020-ec1b-430a-bb02-cf76d688ec31\") " pod="ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn"
Aug 04 18:36:47.820608 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:47.820552    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce6d3020-ec1b-430a-bb02-cf76d688ec31-dshm\") pod \"auth-test-model-4659f1-kserve-54f585f875-k5xcn\" (UID: \"ce6d3020-ec1b-430a-bb02-cf76d688ec31\") " pod="ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn"
Aug 04 18:36:47.820687 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:47.820615    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce6d3020-ec1b-430a-bb02-cf76d688ec31-home\") pod \"auth-test-model-4659f1-kserve-54f585f875-k5xcn\" (UID: \"ce6d3020-ec1b-430a-bb02-cf76d688ec31\") " pod="ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn"
Aug 04 18:36:47.820687 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:47.820643    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce6d3020-ec1b-430a-bb02-cf76d688ec31-tmp-dir\") pod \"auth-test-model-4659f1-kserve-54f585f875-k5xcn\" (UID: \"ce6d3020-ec1b-430a-bb02-cf76d688ec31\") " pod="ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn"
Aug 04 18:36:47.820687 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:47.820684    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce6d3020-ec1b-430a-bb02-cf76d688ec31-tls-certs\") pod \"auth-test-model-4659f1-kserve-54f585f875-k5xcn\" (UID: \"ce6d3020-ec1b-430a-bb02-cf76d688ec31\") " pod="ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn"
Aug 04 18:36:47.921611 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:47.921586    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce6d3020-ec1b-430a-bb02-cf76d688ec31-tls-certs\") pod \"auth-test-model-4659f1-kserve-54f585f875-k5xcn\" (UID: \"ce6d3020-ec1b-430a-bb02-cf76d688ec31\") " pod="ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn"
Aug 04 18:36:47.921745 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:47.921624    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce6d3020-ec1b-430a-bb02-cf76d688ec31-model-cache\") pod \"auth-test-model-4659f1-kserve-54f585f875-k5xcn\" (UID: \"ce6d3020-ec1b-430a-bb02-cf76d688ec31\") " pod="ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn"
Aug 04 18:36:47.921745 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:47.921644    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt2p6\" (UniqueName: \"kubernetes.io/projected/ce6d3020-ec1b-430a-bb02-cf76d688ec31-kube-api-access-lt2p6\") pod \"auth-test-model-4659f1-kserve-54f585f875-k5xcn\" (UID: \"ce6d3020-ec1b-430a-bb02-cf76d688ec31\") " pod="ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn"
Aug 04 18:36:47.921745 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:47.921661    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce6d3020-ec1b-430a-bb02-cf76d688ec31-dshm\") pod \"auth-test-model-4659f1-kserve-54f585f875-k5xcn\" (UID: \"ce6d3020-ec1b-430a-bb02-cf76d688ec31\") " pod="ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn"
Aug 04 18:36:47.921745 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:47.921686    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce6d3020-ec1b-430a-bb02-cf76d688ec31-home\") pod \"auth-test-model-4659f1-kserve-54f585f875-k5xcn\" (UID: \"ce6d3020-ec1b-430a-bb02-cf76d688ec31\") " pod="ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn"
Aug 04 18:36:47.921745 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:47.921711    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce6d3020-ec1b-430a-bb02-cf76d688ec31-tmp-dir\") pod \"auth-test-model-4659f1-kserve-54f585f875-k5xcn\" (UID: \"ce6d3020-ec1b-430a-bb02-cf76d688ec31\") " pod="ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn"
Aug 04 18:36:47.922084 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:47.922062    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce6d3020-ec1b-430a-bb02-cf76d688ec31-home\") pod \"auth-test-model-4659f1-kserve-54f585f875-k5xcn\" (UID: \"ce6d3020-ec1b-430a-bb02-cf76d688ec31\") " pod="ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn"
Aug 04 18:36:47.922140 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:47.922108    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce6d3020-ec1b-430a-bb02-cf76d688ec31-model-cache\") pod \"auth-test-model-4659f1-kserve-54f585f875-k5xcn\" (UID: \"ce6d3020-ec1b-430a-bb02-cf76d688ec31\") " pod="ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn"
Aug 04 18:36:47.922190 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:47.922151    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce6d3020-ec1b-430a-bb02-cf76d688ec31-tmp-dir\") pod \"auth-test-model-4659f1-kserve-54f585f875-k5xcn\" (UID: \"ce6d3020-ec1b-430a-bb02-cf76d688ec31\") " pod="ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn"
Aug 04 18:36:47.923881 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:47.923862    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce6d3020-ec1b-430a-bb02-cf76d688ec31-dshm\") pod \"auth-test-model-4659f1-kserve-54f585f875-k5xcn\" (UID: \"ce6d3020-ec1b-430a-bb02-cf76d688ec31\") " pod="ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn"
Aug 04 18:36:47.924011 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:47.923991    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce6d3020-ec1b-430a-bb02-cf76d688ec31-tls-certs\") pod \"auth-test-model-4659f1-kserve-54f585f875-k5xcn\" (UID: \"ce6d3020-ec1b-430a-bb02-cf76d688ec31\") " pod="ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn"
Aug 04 18:36:47.931697 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:47.931675    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt2p6\" (UniqueName: \"kubernetes.io/projected/ce6d3020-ec1b-430a-bb02-cf76d688ec31-kube-api-access-lt2p6\") pod \"auth-test-model-4659f1-kserve-54f585f875-k5xcn\" (UID: \"ce6d3020-ec1b-430a-bb02-cf76d688ec31\") " pod="ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn"
Aug 04 18:36:48.090822 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:48.090735    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn"
Aug 04 18:36:48.211968 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:48.211943    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn"]
Aug 04 18:36:48.213488 ip-10-0-141-220 kubenswrapper[2571]: W0804 18:36:48.213459    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce6d3020_ec1b_430a_bb02_cf76d688ec31.slice/crio-68822dc19774b4e70fad7f9b6bb39152eadd6abf88e62e1bcfb81b3bf4c871e1 WatchSource:0}: Error finding container 68822dc19774b4e70fad7f9b6bb39152eadd6abf88e62e1bcfb81b3bf4c871e1: Status 404 returned error can't find the container with id 68822dc19774b4e70fad7f9b6bb39152eadd6abf88e62e1bcfb81b3bf4c871e1
Aug 04 18:36:48.590317 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:48.590283    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn" event={"ID":"ce6d3020-ec1b-430a-bb02-cf76d688ec31","Type":"ContainerStarted","Data":"47ec1cd29267771edf5b4edd194818539639f94196f784db0885eb3d8ba9a10d"}
Aug 04 18:36:48.590468 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:48.590323    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn" event={"ID":"ce6d3020-ec1b-430a-bb02-cf76d688ec31","Type":"ContainerStarted","Data":"68822dc19774b4e70fad7f9b6bb39152eadd6abf88e62e1bcfb81b3bf4c871e1"}
Aug 04 18:36:48.605678 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:48.605632    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn" podStartSLOduration=1.605618329 podStartE2EDuration="1.605618329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:36:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:36:48.60459144 +0000 UTC m=+3025.405727766" watchObservedRunningTime="2026-08-04 18:36:48.605618329 +0000 UTC m=+3025.406754655"
Aug 04 18:36:58.091342 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:58.091308    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn"
Aug 04 18:36:58.091741 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:58.091352    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn"
Aug 04 18:36:58.103382 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:58.103360    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn"
Aug 04 18:36:58.642721 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:36:58.642698    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn"
Aug 04 18:37:11.382206 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:37:11.382176    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b"]
Aug 04 18:37:11.385200 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:37:11.385184    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b"
Aug 04 18:37:11.388214 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:37:11.388190    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e9be3f\"/\"auth-test-model-e9be3f-kserve-self-signed-certs\""
Aug 04 18:37:11.388381 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:37:11.388231    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e9be3f\"/\"kube-root-ca.crt\""
Aug 04 18:37:11.388381 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:37:11.388198    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e9be3f\"/\"default-dockercfg-m54fh\""
Aug 04 18:37:11.388381 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:37:11.388275    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e9be3f\"/\"openshift-service-ca.crt\""
Aug 04 18:37:11.395173 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:37:11.395150    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b"]
Aug 04 18:37:11.496631 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:37:11.496606    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwqpj\" (UniqueName: \"kubernetes.io/projected/9af9aa87-e7f8-45b6-96a1-d595784052db-kube-api-access-mwqpj\") pod \"auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b\" (UID: \"9af9aa87-e7f8-45b6-96a1-d595784052db\") " pod="ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b"
Aug 04 18:37:11.496736 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:37:11.496639    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9af9aa87-e7f8-45b6-96a1-d595784052db-dshm\") pod \"auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b\" (UID: \"9af9aa87-e7f8-45b6-96a1-d595784052db\") " pod="ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b"
Aug 04 18:37:11.496736 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:37:11.496665    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9af9aa87-e7f8-45b6-96a1-d595784052db-tmp-dir\") pod \"auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b\" (UID: \"9af9aa87-e7f8-45b6-96a1-d595784052db\") " pod="ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b"
Aug 04 18:37:11.496824 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:37:11.496752    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9af9aa87-e7f8-45b6-96a1-d595784052db-home\") pod \"auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b\" (UID: \"9af9aa87-e7f8-45b6-96a1-d595784052db\") " pod="ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b"
Aug 04 18:37:11.496824 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:37:11.496788    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9af9aa87-e7f8-45b6-96a1-d595784052db-model-cache\") pod \"auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b\" (UID: \"9af9aa87-e7f8-45b6-96a1-d595784052db\") " pod="ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b"
Aug 04 18:37:11.496824 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:37:11.496810    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9af9aa87-e7f8-45b6-96a1-d595784052db-tls-certs\") pod \"auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b\" (UID: \"9af9aa87-e7f8-45b6-96a1-d595784052db\") " pod="ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b"
Aug 04 18:37:11.597871 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:37:11.597839    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwqpj\" (UniqueName: \"kubernetes.io/projected/9af9aa87-e7f8-45b6-96a1-d595784052db-kube-api-access-mwqpj\") pod \"auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b\" (UID: \"9af9aa87-e7f8-45b6-96a1-d595784052db\") " pod="ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b"
Aug 04 18:37:11.597871 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:37:11.597874    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9af9aa87-e7f8-45b6-96a1-d595784052db-dshm\") pod \"auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b\" (UID: \"9af9aa87-e7f8-45b6-96a1-d595784052db\") " pod="ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b"
Aug 04 18:37:11.598108 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:37:11.597908    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9af9aa87-e7f8-45b6-96a1-d595784052db-tmp-dir\") pod \"auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b\" (UID: \"9af9aa87-e7f8-45b6-96a1-d595784052db\") " pod="ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b"
Aug 04 18:37:11.598108 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:37:11.597939    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9af9aa87-e7f8-45b6-96a1-d595784052db-home\") pod \"auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b\" (UID: \"9af9aa87-e7f8-45b6-96a1-d595784052db\") " pod="ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b"
Aug 04 18:37:11.598108 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:37:11.597968    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9af9aa87-e7f8-45b6-96a1-d595784052db-model-cache\") pod \"auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b\" (UID: \"9af9aa87-e7f8-45b6-96a1-d595784052db\") " pod="ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b"
Aug 04 18:37:11.598108 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:37:11.597996    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9af9aa87-e7f8-45b6-96a1-d595784052db-tls-certs\") pod \"auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b\" (UID: \"9af9aa87-e7f8-45b6-96a1-d595784052db\") " pod="ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b"
Aug 04 18:37:11.598398 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:37:11.598378    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9af9aa87-e7f8-45b6-96a1-d595784052db-home\") pod \"auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b\" (UID: \"9af9aa87-e7f8-45b6-96a1-d595784052db\") " pod="ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b"
Aug 04 18:37:11.598467 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:37:11.598394    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9af9aa87-e7f8-45b6-96a1-d595784052db-tmp-dir\") pod \"auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b\" (UID: \"9af9aa87-e7f8-45b6-96a1-d595784052db\") " pod="ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b"
Aug 04 18:37:11.598467 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:37:11.598427    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9af9aa87-e7f8-45b6-96a1-d595784052db-model-cache\") pod \"auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b\" (UID: \"9af9aa87-e7f8-45b6-96a1-d595784052db\") " pod="ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b"
Aug 04 18:37:11.600114 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:37:11.600094    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9af9aa87-e7f8-45b6-96a1-d595784052db-dshm\") pod \"auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b\" (UID: \"9af9aa87-e7f8-45b6-96a1-d595784052db\") " pod="ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b"
Aug 04 18:37:11.600475 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:37:11.600457    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9af9aa87-e7f8-45b6-96a1-d595784052db-tls-certs\") pod \"auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b\" (UID: \"9af9aa87-e7f8-45b6-96a1-d595784052db\") " pod="ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b"
Aug 04 18:37:11.608011 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:37:11.607989    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwqpj\" (UniqueName: \"kubernetes.io/projected/9af9aa87-e7f8-45b6-96a1-d595784052db-kube-api-access-mwqpj\") pod \"auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b\" (UID: \"9af9aa87-e7f8-45b6-96a1-d595784052db\") " pod="ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b"
Aug 04 18:37:11.694906 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:37:11.694858    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b"
Aug 04 18:37:11.819299 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:37:11.819276    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b"]
Aug 04 18:37:11.821313 ip-10-0-141-220 kubenswrapper[2571]: W0804 18:37:11.821281    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9af9aa87_e7f8_45b6_96a1_d595784052db.slice/crio-0a2db4235b3d8d806f53c6f9fa087adc72702645b520ca74e4de4696c56ea3a3 WatchSource:0}: Error finding container 0a2db4235b3d8d806f53c6f9fa087adc72702645b520ca74e4de4696c56ea3a3: Status 404 returned error can't find the container with id 0a2db4235b3d8d806f53c6f9fa087adc72702645b520ca74e4de4696c56ea3a3
Aug 04 18:37:12.688623 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:37:12.688587    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b" event={"ID":"9af9aa87-e7f8-45b6-96a1-d595784052db","Type":"ContainerStarted","Data":"9b4d49d846df95f9d97fc2d893aeac55a9f7121ffcc29e2f043387b576e318a8"}
Aug 04 18:37:12.688623 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:37:12.688626    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b" event={"ID":"9af9aa87-e7f8-45b6-96a1-d595784052db","Type":"ContainerStarted","Data":"0a2db4235b3d8d806f53c6f9fa087adc72702645b520ca74e4de4696c56ea3a3"}
Aug 04 18:37:12.704193 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:37:12.704152    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b" podStartSLOduration=1.7041370599999999 podStartE2EDuration="1.70413706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:37:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:37:12.702608176 +0000 UTC m=+3049.503744502" watchObservedRunningTime="2026-08-04 18:37:12.70413706 +0000 UTC m=+3049.505273386"
Aug 04 18:37:21.695032 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:37:21.694949    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b"
Aug 04 18:37:21.695032 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:37:21.694996    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b"
Aug 04 18:37:21.707465 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:37:21.707444    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b"
Aug 04 18:37:21.737899 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:37:21.737874    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b"
Aug 04 18:40:26.033608 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:26.033505    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn"]
Aug 04 18:40:26.989062 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:26.989033    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b"]
Aug 04 18:40:40.995582 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:40.995553    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv"]
Aug 04 18:40:40.998689 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:40.998669    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv"
Aug 04 18:40:41.000939 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.000915    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4659f1\"/\"sub-test-model-4659f1-kserve-self-signed-certs\""
Aug 04 18:40:41.007113 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.007092    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv"]
Aug 04 18:40:41.051933 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.051885    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn" podUID="ce6d3020-ec1b-430a-bb02-cf76d688ec31" containerName="main" containerID="cri-o://47ec1cd29267771edf5b4edd194818539639f94196f784db0885eb3d8ba9a10d" gracePeriod=45
Aug 04 18:40:41.159736 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.159703    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33d05a8e-e30a-46d0-8016-a86b8f10f2be-dshm\") pod \"sub-test-model-4659f1-kserve-7854fbd49-vk6dv\" (UID: \"33d05a8e-e30a-46d0-8016-a86b8f10f2be\") " pod="ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv"
Aug 04 18:40:41.159736 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.159739    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33d05a8e-e30a-46d0-8016-a86b8f10f2be-home\") pod \"sub-test-model-4659f1-kserve-7854fbd49-vk6dv\" (UID: \"33d05a8e-e30a-46d0-8016-a86b8f10f2be\") " pod="ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv"
Aug 04 18:40:41.160035 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.159757    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33d05a8e-e30a-46d0-8016-a86b8f10f2be-tmp-dir\") pod \"sub-test-model-4659f1-kserve-7854fbd49-vk6dv\" (UID: \"33d05a8e-e30a-46d0-8016-a86b8f10f2be\") " pod="ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv"
Aug 04 18:40:41.160035 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.159880    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33d05a8e-e30a-46d0-8016-a86b8f10f2be-model-cache\") pod \"sub-test-model-4659f1-kserve-7854fbd49-vk6dv\" (UID: \"33d05a8e-e30a-46d0-8016-a86b8f10f2be\") " pod="ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv"
Aug 04 18:40:41.160035 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.159941    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33d05a8e-e30a-46d0-8016-a86b8f10f2be-tls-certs\") pod \"sub-test-model-4659f1-kserve-7854fbd49-vk6dv\" (UID: \"33d05a8e-e30a-46d0-8016-a86b8f10f2be\") " pod="ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv"
Aug 04 18:40:41.160184 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.160044    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q974r\" (UniqueName: \"kubernetes.io/projected/33d05a8e-e30a-46d0-8016-a86b8f10f2be-kube-api-access-q974r\") pod \"sub-test-model-4659f1-kserve-7854fbd49-vk6dv\" (UID: \"33d05a8e-e30a-46d0-8016-a86b8f10f2be\") " pod="ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv"
Aug 04 18:40:41.260813 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.260733    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33d05a8e-e30a-46d0-8016-a86b8f10f2be-dshm\") pod \"sub-test-model-4659f1-kserve-7854fbd49-vk6dv\" (UID: \"33d05a8e-e30a-46d0-8016-a86b8f10f2be\") " pod="ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv"
Aug 04 18:40:41.260813 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.260773    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33d05a8e-e30a-46d0-8016-a86b8f10f2be-home\") pod \"sub-test-model-4659f1-kserve-7854fbd49-vk6dv\" (UID: \"33d05a8e-e30a-46d0-8016-a86b8f10f2be\") " pod="ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv"
Aug 04 18:40:41.261014 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.260899    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33d05a8e-e30a-46d0-8016-a86b8f10f2be-tmp-dir\") pod \"sub-test-model-4659f1-kserve-7854fbd49-vk6dv\" (UID: \"33d05a8e-e30a-46d0-8016-a86b8f10f2be\") " pod="ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv"
Aug 04 18:40:41.261014 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.260984    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33d05a8e-e30a-46d0-8016-a86b8f10f2be-model-cache\") pod \"sub-test-model-4659f1-kserve-7854fbd49-vk6dv\" (UID: \"33d05a8e-e30a-46d0-8016-a86b8f10f2be\") " pod="ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv"
Aug 04 18:40:41.261135 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.261021    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33d05a8e-e30a-46d0-8016-a86b8f10f2be-tls-certs\") pod \"sub-test-model-4659f1-kserve-7854fbd49-vk6dv\" (UID: \"33d05a8e-e30a-46d0-8016-a86b8f10f2be\") " pod="ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv"
Aug 04 18:40:41.261135 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.261088    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q974r\" (UniqueName: \"kubernetes.io/projected/33d05a8e-e30a-46d0-8016-a86b8f10f2be-kube-api-access-q974r\") pod \"sub-test-model-4659f1-kserve-7854fbd49-vk6dv\" (UID: \"33d05a8e-e30a-46d0-8016-a86b8f10f2be\") " pod="ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv"
Aug 04 18:40:41.261237 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.261165    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33d05a8e-e30a-46d0-8016-a86b8f10f2be-home\") pod \"sub-test-model-4659f1-kserve-7854fbd49-vk6dv\" (UID: \"33d05a8e-e30a-46d0-8016-a86b8f10f2be\") " pod="ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv"
Aug 04 18:40:41.261275 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.261238    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33d05a8e-e30a-46d0-8016-a86b8f10f2be-tmp-dir\") pod \"sub-test-model-4659f1-kserve-7854fbd49-vk6dv\" (UID: \"33d05a8e-e30a-46d0-8016-a86b8f10f2be\") " pod="ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv"
Aug 04 18:40:41.261321 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.261306    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33d05a8e-e30a-46d0-8016-a86b8f10f2be-model-cache\") pod \"sub-test-model-4659f1-kserve-7854fbd49-vk6dv\" (UID: \"33d05a8e-e30a-46d0-8016-a86b8f10f2be\") " pod="ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv"
Aug 04 18:40:41.263409 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.263381    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33d05a8e-e30a-46d0-8016-a86b8f10f2be-dshm\") pod \"sub-test-model-4659f1-kserve-7854fbd49-vk6dv\" (UID: \"33d05a8e-e30a-46d0-8016-a86b8f10f2be\") " pod="ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv"
Aug 04 18:40:41.263409 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.263385    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33d05a8e-e30a-46d0-8016-a86b8f10f2be-tls-certs\") pod \"sub-test-model-4659f1-kserve-7854fbd49-vk6dv\" (UID: \"33d05a8e-e30a-46d0-8016-a86b8f10f2be\") " pod="ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv"
Aug 04 18:40:41.268970 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.268949    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q974r\" (UniqueName: \"kubernetes.io/projected/33d05a8e-e30a-46d0-8016-a86b8f10f2be-kube-api-access-q974r\") pod \"sub-test-model-4659f1-kserve-7854fbd49-vk6dv\" (UID: \"33d05a8e-e30a-46d0-8016-a86b8f10f2be\") " pod="ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv"
Aug 04 18:40:41.292031 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.292009    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn"
Aug 04 18:40:41.308794 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.308768    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv"
Aug 04 18:40:41.430973 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.430946    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv"]
Aug 04 18:40:41.433053 ip-10-0-141-220 kubenswrapper[2571]: W0804 18:40:41.433025    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33d05a8e_e30a_46d0_8016_a86b8f10f2be.slice/crio-734794185a3c9490d8be22251343e72404e84e8605413347244165ff96810ebc WatchSource:0}: Error finding container 734794185a3c9490d8be22251343e72404e84e8605413347244165ff96810ebc: Status 404 returned error can't find the container with id 734794185a3c9490d8be22251343e72404e84e8605413347244165ff96810ebc
Aug 04 18:40:41.462301 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.462279    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce6d3020-ec1b-430a-bb02-cf76d688ec31-home\") pod \"ce6d3020-ec1b-430a-bb02-cf76d688ec31\" (UID: \"ce6d3020-ec1b-430a-bb02-cf76d688ec31\") "
Aug 04 18:40:41.462416 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.462314    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce6d3020-ec1b-430a-bb02-cf76d688ec31-dshm\") pod \"ce6d3020-ec1b-430a-bb02-cf76d688ec31\" (UID: \"ce6d3020-ec1b-430a-bb02-cf76d688ec31\") "
Aug 04 18:40:41.462416 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.462339    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce6d3020-ec1b-430a-bb02-cf76d688ec31-tmp-dir\") pod \"ce6d3020-ec1b-430a-bb02-cf76d688ec31\" (UID: \"ce6d3020-ec1b-430a-bb02-cf76d688ec31\") "
Aug 04 18:40:41.462416 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.462392    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lt2p6\" (UniqueName: \"kubernetes.io/projected/ce6d3020-ec1b-430a-bb02-cf76d688ec31-kube-api-access-lt2p6\") pod \"ce6d3020-ec1b-430a-bb02-cf76d688ec31\" (UID: \"ce6d3020-ec1b-430a-bb02-cf76d688ec31\") "
Aug 04 18:40:41.462619 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.462428    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce6d3020-ec1b-430a-bb02-cf76d688ec31-model-cache\") pod \"ce6d3020-ec1b-430a-bb02-cf76d688ec31\" (UID: \"ce6d3020-ec1b-430a-bb02-cf76d688ec31\") "
Aug 04 18:40:41.462619 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.462465    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce6d3020-ec1b-430a-bb02-cf76d688ec31-tls-certs\") pod \"ce6d3020-ec1b-430a-bb02-cf76d688ec31\" (UID: \"ce6d3020-ec1b-430a-bb02-cf76d688ec31\") "
Aug 04 18:40:41.462718 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.462622    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce6d3020-ec1b-430a-bb02-cf76d688ec31-home" (OuterVolumeSpecName: "home") pod "ce6d3020-ec1b-430a-bb02-cf76d688ec31" (UID: "ce6d3020-ec1b-430a-bb02-cf76d688ec31"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:40:41.462718 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.462679    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce6d3020-ec1b-430a-bb02-cf76d688ec31-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ce6d3020-ec1b-430a-bb02-cf76d688ec31" (UID: "ce6d3020-ec1b-430a-bb02-cf76d688ec31"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:40:41.462817 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.462780    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce6d3020-ec1b-430a-bb02-cf76d688ec31-model-cache" (OuterVolumeSpecName: "model-cache") pod "ce6d3020-ec1b-430a-bb02-cf76d688ec31" (UID: "ce6d3020-ec1b-430a-bb02-cf76d688ec31"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:40:41.462878 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.462848    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce6d3020-ec1b-430a-bb02-cf76d688ec31-home\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:40:41.462878 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.462869    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce6d3020-ec1b-430a-bb02-cf76d688ec31-tmp-dir\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:40:41.462969 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.462885    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce6d3020-ec1b-430a-bb02-cf76d688ec31-model-cache\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:40:41.464477 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.464451    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce6d3020-ec1b-430a-bb02-cf76d688ec31-dshm" (OuterVolumeSpecName: "dshm") pod "ce6d3020-ec1b-430a-bb02-cf76d688ec31" (UID: "ce6d3020-ec1b-430a-bb02-cf76d688ec31"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:40:41.464591 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.464573    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce6d3020-ec1b-430a-bb02-cf76d688ec31-kube-api-access-lt2p6" (OuterVolumeSpecName: "kube-api-access-lt2p6") pod "ce6d3020-ec1b-430a-bb02-cf76d688ec31" (UID: "ce6d3020-ec1b-430a-bb02-cf76d688ec31"). InnerVolumeSpecName "kube-api-access-lt2p6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:40:41.464642 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.464621    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce6d3020-ec1b-430a-bb02-cf76d688ec31-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ce6d3020-ec1b-430a-bb02-cf76d688ec31" (UID: "ce6d3020-ec1b-430a-bb02-cf76d688ec31"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:40:41.563972 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.563947    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce6d3020-ec1b-430a-bb02-cf76d688ec31-dshm\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:40:41.563972 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.563973    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lt2p6\" (UniqueName: \"kubernetes.io/projected/ce6d3020-ec1b-430a-bb02-cf76d688ec31-kube-api-access-lt2p6\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:40:41.564145 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.563988    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce6d3020-ec1b-430a-bb02-cf76d688ec31-tls-certs\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:40:41.576411 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.576384    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv" event={"ID":"33d05a8e-e30a-46d0-8016-a86b8f10f2be","Type":"ContainerStarted","Data":"20f981350473707defcce22ea60abd7891e54f81be9c87e4cb1257ed905718dd"}
Aug 04 18:40:41.576537 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.576422    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv" event={"ID":"33d05a8e-e30a-46d0-8016-a86b8f10f2be","Type":"ContainerStarted","Data":"734794185a3c9490d8be22251343e72404e84e8605413347244165ff96810ebc"}
Aug 04 18:40:41.577621 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.577598    2571 generic.go:356] "Generic (PLEG): container finished" podID="ce6d3020-ec1b-430a-bb02-cf76d688ec31" containerID="47ec1cd29267771edf5b4edd194818539639f94196f784db0885eb3d8ba9a10d" exitCode=0
Aug 04 18:40:41.577677 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.577632    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn"
Aug 04 18:40:41.577677 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.577647    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn" event={"ID":"ce6d3020-ec1b-430a-bb02-cf76d688ec31","Type":"ContainerDied","Data":"47ec1cd29267771edf5b4edd194818539639f94196f784db0885eb3d8ba9a10d"}
Aug 04 18:40:41.577677 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.577679    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn" event={"ID":"ce6d3020-ec1b-430a-bb02-cf76d688ec31","Type":"ContainerDied","Data":"68822dc19774b4e70fad7f9b6bb39152eadd6abf88e62e1bcfb81b3bf4c871e1"}
Aug 04 18:40:41.577791 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.577701    2571 scope.go:117] "RemoveContainer" containerID="47ec1cd29267771edf5b4edd194818539639f94196f784db0885eb3d8ba9a10d"
Aug 04 18:40:41.586028 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.586005    2571 scope.go:117] "RemoveContainer" containerID="47ec1cd29267771edf5b4edd194818539639f94196f784db0885eb3d8ba9a10d"
Aug 04 18:40:41.586298 ip-10-0-141-220 kubenswrapper[2571]: E0804 18:40:41.586278    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47ec1cd29267771edf5b4edd194818539639f94196f784db0885eb3d8ba9a10d\": container with ID starting with 47ec1cd29267771edf5b4edd194818539639f94196f784db0885eb3d8ba9a10d not found: ID does not exist" containerID="47ec1cd29267771edf5b4edd194818539639f94196f784db0885eb3d8ba9a10d"
Aug 04 18:40:41.586348 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.586307    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47ec1cd29267771edf5b4edd194818539639f94196f784db0885eb3d8ba9a10d"} err="failed to get container status \"47ec1cd29267771edf5b4edd194818539639f94196f784db0885eb3d8ba9a10d\": rpc error: code = NotFound desc = could not find container \"47ec1cd29267771edf5b4edd194818539639f94196f784db0885eb3d8ba9a10d\": container with ID starting with 47ec1cd29267771edf5b4edd194818539639f94196f784db0885eb3d8ba9a10d not found: ID does not exist"
Aug 04 18:40:41.594502 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.594463    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv" podStartSLOduration=1.594451126 podStartE2EDuration="1.594451126s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:40:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:40:41.593062311 +0000 UTC m=+3258.394198634" watchObservedRunningTime="2026-08-04 18:40:41.594451126 +0000 UTC m=+3258.395587452"
Aug 04 18:40:41.608422 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.608402    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn"]
Aug 04 18:40:41.611713 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.611694    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-4659f1/auth-test-model-4659f1-kserve-54f585f875-k5xcn"]
Aug 04 18:40:41.879638 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:41.879555    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce6d3020-ec1b-430a-bb02-cf76d688ec31" path="/var/lib/kubelet/pods/ce6d3020-ec1b-430a-bb02-cf76d688ec31/volumes"
Aug 04 18:40:42.007605 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:42.007575    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b" podUID="9af9aa87-e7f8-45b6-96a1-d595784052db" containerName="main" containerID="cri-o://9b4d49d846df95f9d97fc2d893aeac55a9f7121ffcc29e2f043387b576e318a8" gracePeriod=45
Aug 04 18:40:42.242558 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:42.242536    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b"
Aug 04 18:40:42.370314 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:42.370274    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9af9aa87-e7f8-45b6-96a1-d595784052db-tls-certs\") pod \"9af9aa87-e7f8-45b6-96a1-d595784052db\" (UID: \"9af9aa87-e7f8-45b6-96a1-d595784052db\") "
Aug 04 18:40:42.370460 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:42.370342    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9af9aa87-e7f8-45b6-96a1-d595784052db-model-cache\") pod \"9af9aa87-e7f8-45b6-96a1-d595784052db\" (UID: \"9af9aa87-e7f8-45b6-96a1-d595784052db\") "
Aug 04 18:40:42.370460 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:42.370371    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwqpj\" (UniqueName: \"kubernetes.io/projected/9af9aa87-e7f8-45b6-96a1-d595784052db-kube-api-access-mwqpj\") pod \"9af9aa87-e7f8-45b6-96a1-d595784052db\" (UID: \"9af9aa87-e7f8-45b6-96a1-d595784052db\") "
Aug 04 18:40:42.370460 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:42.370391    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9af9aa87-e7f8-45b6-96a1-d595784052db-home\") pod \"9af9aa87-e7f8-45b6-96a1-d595784052db\" (UID: \"9af9aa87-e7f8-45b6-96a1-d595784052db\") "
Aug 04 18:40:42.370460 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:42.370408    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9af9aa87-e7f8-45b6-96a1-d595784052db-tmp-dir\") pod \"9af9aa87-e7f8-45b6-96a1-d595784052db\" (UID: \"9af9aa87-e7f8-45b6-96a1-d595784052db\") "
Aug 04 18:40:42.370460 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:42.370432    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9af9aa87-e7f8-45b6-96a1-d595784052db-dshm\") pod \"9af9aa87-e7f8-45b6-96a1-d595784052db\" (UID: \"9af9aa87-e7f8-45b6-96a1-d595784052db\") "
Aug 04 18:40:42.370760 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:42.370636    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9af9aa87-e7f8-45b6-96a1-d595784052db-model-cache" (OuterVolumeSpecName: "model-cache") pod "9af9aa87-e7f8-45b6-96a1-d595784052db" (UID: "9af9aa87-e7f8-45b6-96a1-d595784052db"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:40:42.370760 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:42.370706    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9af9aa87-e7f8-45b6-96a1-d595784052db-home" (OuterVolumeSpecName: "home") pod "9af9aa87-e7f8-45b6-96a1-d595784052db" (UID: "9af9aa87-e7f8-45b6-96a1-d595784052db"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:40:42.370760 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:42.370717    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9af9aa87-e7f8-45b6-96a1-d595784052db-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9af9aa87-e7f8-45b6-96a1-d595784052db" (UID: "9af9aa87-e7f8-45b6-96a1-d595784052db"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:40:42.370876 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:42.370799    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9af9aa87-e7f8-45b6-96a1-d595784052db-model-cache\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:40:42.372630 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:42.372599    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9af9aa87-e7f8-45b6-96a1-d595784052db-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9af9aa87-e7f8-45b6-96a1-d595784052db" (UID: "9af9aa87-e7f8-45b6-96a1-d595784052db"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:40:42.372724 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:42.372633    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9af9aa87-e7f8-45b6-96a1-d595784052db-dshm" (OuterVolumeSpecName: "dshm") pod "9af9aa87-e7f8-45b6-96a1-d595784052db" (UID: "9af9aa87-e7f8-45b6-96a1-d595784052db"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:40:42.372724 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:42.372662    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9af9aa87-e7f8-45b6-96a1-d595784052db-kube-api-access-mwqpj" (OuterVolumeSpecName: "kube-api-access-mwqpj") pod "9af9aa87-e7f8-45b6-96a1-d595784052db" (UID: "9af9aa87-e7f8-45b6-96a1-d595784052db"). InnerVolumeSpecName "kube-api-access-mwqpj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:40:42.471758 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:42.471697    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9af9aa87-e7f8-45b6-96a1-d595784052db-tls-certs\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:40:42.471758 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:42.471729    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwqpj\" (UniqueName: \"kubernetes.io/projected/9af9aa87-e7f8-45b6-96a1-d595784052db-kube-api-access-mwqpj\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:40:42.471758 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:42.471740    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9af9aa87-e7f8-45b6-96a1-d595784052db-home\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:40:42.471758 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:42.471748    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9af9aa87-e7f8-45b6-96a1-d595784052db-tmp-dir\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:40:42.471758 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:42.471757    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9af9aa87-e7f8-45b6-96a1-d595784052db-dshm\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:40:42.588051 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:42.588024    2571 generic.go:356] "Generic (PLEG): container finished" podID="9af9aa87-e7f8-45b6-96a1-d595784052db" containerID="9b4d49d846df95f9d97fc2d893aeac55a9f7121ffcc29e2f043387b576e318a8" exitCode=0
Aug 04 18:40:42.588148 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:42.588072    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b"
Aug 04 18:40:42.588148 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:42.588105    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b" event={"ID":"9af9aa87-e7f8-45b6-96a1-d595784052db","Type":"ContainerDied","Data":"9b4d49d846df95f9d97fc2d893aeac55a9f7121ffcc29e2f043387b576e318a8"}
Aug 04 18:40:42.588148 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:42.588141    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b" event={"ID":"9af9aa87-e7f8-45b6-96a1-d595784052db","Type":"ContainerDied","Data":"0a2db4235b3d8d806f53c6f9fa087adc72702645b520ca74e4de4696c56ea3a3"}
Aug 04 18:40:42.588292 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:42.588158    2571 scope.go:117] "RemoveContainer" containerID="9b4d49d846df95f9d97fc2d893aeac55a9f7121ffcc29e2f043387b576e318a8"
Aug 04 18:40:42.596924 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:42.596907    2571 scope.go:117] "RemoveContainer" containerID="9b4d49d846df95f9d97fc2d893aeac55a9f7121ffcc29e2f043387b576e318a8"
Aug 04 18:40:42.597151 ip-10-0-141-220 kubenswrapper[2571]: E0804 18:40:42.597131    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b4d49d846df95f9d97fc2d893aeac55a9f7121ffcc29e2f043387b576e318a8\": container with ID starting with 9b4d49d846df95f9d97fc2d893aeac55a9f7121ffcc29e2f043387b576e318a8 not found: ID does not exist" containerID="9b4d49d846df95f9d97fc2d893aeac55a9f7121ffcc29e2f043387b576e318a8"
Aug 04 18:40:42.597219 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:42.597160    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b4d49d846df95f9d97fc2d893aeac55a9f7121ffcc29e2f043387b576e318a8"} err="failed to get container status \"9b4d49d846df95f9d97fc2d893aeac55a9f7121ffcc29e2f043387b576e318a8\": rpc error: code = NotFound desc = could not find container \"9b4d49d846df95f9d97fc2d893aeac55a9f7121ffcc29e2f043387b576e318a8\": container with ID starting with 9b4d49d846df95f9d97fc2d893aeac55a9f7121ffcc29e2f043387b576e318a8 not found: ID does not exist"
Aug 04 18:40:42.607532 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:42.607507    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b"]
Aug 04 18:40:42.611801 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:42.611778    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-e9be3f/auth-test-model-e9be3f-kserve-678fd89dc5-4ds5b"]
Aug 04 18:40:43.879487 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:43.879452    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9af9aa87-e7f8-45b6-96a1-d595784052db" path="/var/lib/kubelet/pods/9af9aa87-e7f8-45b6-96a1-d595784052db/volumes"
Aug 04 18:40:51.309536 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:51.309499    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv"
Aug 04 18:40:51.309934 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:51.309554    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv"
Aug 04 18:40:51.321405 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:51.321386    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv"
Aug 04 18:40:51.638386 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:40:51.638317    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv"
Aug 04 18:41:17.374888 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:17.374851    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226"]
Aug 04 18:41:17.375478 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:17.375134    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce6d3020-ec1b-430a-bb02-cf76d688ec31" containerName="main"
Aug 04 18:41:17.375478 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:17.375145    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce6d3020-ec1b-430a-bb02-cf76d688ec31" containerName="main"
Aug 04 18:41:17.375478 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:17.375157    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9af9aa87-e7f8-45b6-96a1-d595784052db" containerName="main"
Aug 04 18:41:17.375478 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:17.375162    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9af9aa87-e7f8-45b6-96a1-d595784052db" containerName="main"
Aug 04 18:41:17.375478 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:17.375228    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="9af9aa87-e7f8-45b6-96a1-d595784052db" containerName="main"
Aug 04 18:41:17.375478 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:17.375246    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce6d3020-ec1b-430a-bb02-cf76d688ec31" containerName="main"
Aug 04 18:41:17.378023 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:17.378006    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226"
Aug 04 18:41:17.381056 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:17.381031    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e9be3f\"/\"default-dockercfg-m54fh\""
Aug 04 18:41:17.381167 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:17.381032    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e9be3f\"/\"sub-test-model-e9be3f-kserve-self-signed-certs\""
Aug 04 18:41:17.381167 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:17.381037    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e9be3f\"/\"kube-root-ca.crt\""
Aug 04 18:41:17.381167 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:17.381072    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e9be3f\"/\"openshift-service-ca.crt\""
Aug 04 18:41:17.387226 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:17.387203    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226"]
Aug 04 18:41:17.415864 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:17.415841    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-856tp\" (UniqueName: \"kubernetes.io/projected/24d03d66-cf28-44b8-8a43-4ca0a357eaf4-kube-api-access-856tp\") pod \"sub-test-model-e9be3f-kserve-7f6d766c5-sk226\" (UID: \"24d03d66-cf28-44b8-8a43-4ca0a357eaf4\") " pod="ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226"
Aug 04 18:41:17.415980 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:17.415893    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24d03d66-cf28-44b8-8a43-4ca0a357eaf4-dshm\") pod \"sub-test-model-e9be3f-kserve-7f6d766c5-sk226\" (UID: \"24d03d66-cf28-44b8-8a43-4ca0a357eaf4\") " pod="ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226"
Aug 04 18:41:17.415980 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:17.415943    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24d03d66-cf28-44b8-8a43-4ca0a357eaf4-model-cache\") pod \"sub-test-model-e9be3f-kserve-7f6d766c5-sk226\" (UID: \"24d03d66-cf28-44b8-8a43-4ca0a357eaf4\") " pod="ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226"
Aug 04 18:41:17.415980 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:17.415969    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24d03d66-cf28-44b8-8a43-4ca0a357eaf4-tmp-dir\") pod \"sub-test-model-e9be3f-kserve-7f6d766c5-sk226\" (UID: \"24d03d66-cf28-44b8-8a43-4ca0a357eaf4\") " pod="ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226"
Aug 04 18:41:17.416162 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:17.416030    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24d03d66-cf28-44b8-8a43-4ca0a357eaf4-home\") pod \"sub-test-model-e9be3f-kserve-7f6d766c5-sk226\" (UID: \"24d03d66-cf28-44b8-8a43-4ca0a357eaf4\") " pod="ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226"
Aug 04 18:41:17.416162 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:17.416066    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24d03d66-cf28-44b8-8a43-4ca0a357eaf4-tls-certs\") pod \"sub-test-model-e9be3f-kserve-7f6d766c5-sk226\" (UID: \"24d03d66-cf28-44b8-8a43-4ca0a357eaf4\") " pod="ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226"
Aug 04 18:41:17.517276 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:17.517246    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-856tp\" (UniqueName: \"kubernetes.io/projected/24d03d66-cf28-44b8-8a43-4ca0a357eaf4-kube-api-access-856tp\") pod \"sub-test-model-e9be3f-kserve-7f6d766c5-sk226\" (UID: \"24d03d66-cf28-44b8-8a43-4ca0a357eaf4\") " pod="ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226"
Aug 04 18:41:17.517369 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:17.517292    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24d03d66-cf28-44b8-8a43-4ca0a357eaf4-dshm\") pod \"sub-test-model-e9be3f-kserve-7f6d766c5-sk226\" (UID: \"24d03d66-cf28-44b8-8a43-4ca0a357eaf4\") " pod="ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226"
Aug 04 18:41:17.517434 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:17.517416    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24d03d66-cf28-44b8-8a43-4ca0a357eaf4-model-cache\") pod \"sub-test-model-e9be3f-kserve-7f6d766c5-sk226\" (UID: \"24d03d66-cf28-44b8-8a43-4ca0a357eaf4\") " pod="ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226"
Aug 04 18:41:17.517495 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:17.517454    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24d03d66-cf28-44b8-8a43-4ca0a357eaf4-tmp-dir\") pod \"sub-test-model-e9be3f-kserve-7f6d766c5-sk226\" (UID: \"24d03d66-cf28-44b8-8a43-4ca0a357eaf4\") " pod="ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226"
Aug 04 18:41:17.517579 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:17.517510    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24d03d66-cf28-44b8-8a43-4ca0a357eaf4-home\") pod \"sub-test-model-e9be3f-kserve-7f6d766c5-sk226\" (UID: \"24d03d66-cf28-44b8-8a43-4ca0a357eaf4\") " pod="ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226"
Aug 04 18:41:17.517579 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:17.517570    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24d03d66-cf28-44b8-8a43-4ca0a357eaf4-tls-certs\") pod \"sub-test-model-e9be3f-kserve-7f6d766c5-sk226\" (UID: \"24d03d66-cf28-44b8-8a43-4ca0a357eaf4\") " pod="ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226"
Aug 04 18:41:17.517802 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:17.517777    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24d03d66-cf28-44b8-8a43-4ca0a357eaf4-model-cache\") pod \"sub-test-model-e9be3f-kserve-7f6d766c5-sk226\" (UID: \"24d03d66-cf28-44b8-8a43-4ca0a357eaf4\") " pod="ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226"
Aug 04 18:41:17.517874 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:17.517805    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24d03d66-cf28-44b8-8a43-4ca0a357eaf4-tmp-dir\") pod \"sub-test-model-e9be3f-kserve-7f6d766c5-sk226\" (UID: \"24d03d66-cf28-44b8-8a43-4ca0a357eaf4\") " pod="ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226"
Aug 04 18:41:17.517931 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:17.517894    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24d03d66-cf28-44b8-8a43-4ca0a357eaf4-home\") pod \"sub-test-model-e9be3f-kserve-7f6d766c5-sk226\" (UID: \"24d03d66-cf28-44b8-8a43-4ca0a357eaf4\") " pod="ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226"
Aug 04 18:41:17.519390 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:17.519370    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24d03d66-cf28-44b8-8a43-4ca0a357eaf4-dshm\") pod \"sub-test-model-e9be3f-kserve-7f6d766c5-sk226\" (UID: \"24d03d66-cf28-44b8-8a43-4ca0a357eaf4\") " pod="ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226"
Aug 04 18:41:17.519793 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:17.519777    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24d03d66-cf28-44b8-8a43-4ca0a357eaf4-tls-certs\") pod \"sub-test-model-e9be3f-kserve-7f6d766c5-sk226\" (UID: \"24d03d66-cf28-44b8-8a43-4ca0a357eaf4\") " pod="ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226"
Aug 04 18:41:17.525073 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:17.525055    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-856tp\" (UniqueName: \"kubernetes.io/projected/24d03d66-cf28-44b8-8a43-4ca0a357eaf4-kube-api-access-856tp\") pod \"sub-test-model-e9be3f-kserve-7f6d766c5-sk226\" (UID: \"24d03d66-cf28-44b8-8a43-4ca0a357eaf4\") " pod="ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226"
Aug 04 18:41:17.687040 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:17.686963    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226"
Aug 04 18:41:17.814153 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:17.814129    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226"]
Aug 04 18:41:17.816466 ip-10-0-141-220 kubenswrapper[2571]: W0804 18:41:17.816428    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24d03d66_cf28_44b8_8a43_4ca0a357eaf4.slice/crio-40ccefdd7712874da356e2592b0d3348869a8f96cc888fb5a9103aa386c6fdee WatchSource:0}: Error finding container 40ccefdd7712874da356e2592b0d3348869a8f96cc888fb5a9103aa386c6fdee: Status 404 returned error can't find the container with id 40ccefdd7712874da356e2592b0d3348869a8f96cc888fb5a9103aa386c6fdee
Aug 04 18:41:18.744995 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:18.744962    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226" event={"ID":"24d03d66-cf28-44b8-8a43-4ca0a357eaf4","Type":"ContainerStarted","Data":"cf78e2d5fc7060286393864538465410dae6158709eef51fea04fb096e209683"}
Aug 04 18:41:18.745337 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:18.745002    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226" event={"ID":"24d03d66-cf28-44b8-8a43-4ca0a357eaf4","Type":"ContainerStarted","Data":"40ccefdd7712874da356e2592b0d3348869a8f96cc888fb5a9103aa386c6fdee"}
Aug 04 18:41:18.760517 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:18.760467    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226" podStartSLOduration=1.760452791 podStartE2EDuration="1.760452791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:41:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:41:18.759238567 +0000 UTC m=+3295.560374916" watchObservedRunningTime="2026-08-04 18:41:18.760452791 +0000 UTC m=+3295.561589118"
Aug 04 18:41:27.688073 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:27.688042    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226"
Aug 04 18:41:27.688073 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:27.688086    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226"
Aug 04 18:41:27.700216 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:27.700196    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226"
Aug 04 18:41:27.798829 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:41:27.798804    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226"
Aug 04 18:42:58.540296 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:42:58.540260    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv"]
Aug 04 18:42:59.384038 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:42:59.384009    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226"]
Aug 04 18:43:04.271959 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:04.271927    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g"]
Aug 04 18:43:04.275050 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:04.275034    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g"
Aug 04 18:43:04.277177 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:04.277155    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4659f1\"/\"rate-test-model-4659f1-kserve-self-signed-certs\""
Aug 04 18:43:04.283051 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:04.283027    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g"]
Aug 04 18:43:04.381308 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:04.381282    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a57a2a62-e86c-4fea-be0c-94001895ec60-model-cache\") pod \"rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g\" (UID: \"a57a2a62-e86c-4fea-be0c-94001895ec60\") " pod="ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g"
Aug 04 18:43:04.381420 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:04.381333    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a57a2a62-e86c-4fea-be0c-94001895ec60-tls-certs\") pod \"rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g\" (UID: \"a57a2a62-e86c-4fea-be0c-94001895ec60\") " pod="ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g"
Aug 04 18:43:04.381420 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:04.381386    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4bc5\" (UniqueName: \"kubernetes.io/projected/a57a2a62-e86c-4fea-be0c-94001895ec60-kube-api-access-b4bc5\") pod \"rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g\" (UID: \"a57a2a62-e86c-4fea-be0c-94001895ec60\") " pod="ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g"
Aug 04 18:43:04.381512 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:04.381433    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a57a2a62-e86c-4fea-be0c-94001895ec60-home\") pod \"rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g\" (UID: \"a57a2a62-e86c-4fea-be0c-94001895ec60\") " pod="ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g"
Aug 04 18:43:04.381512 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:04.381454    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a57a2a62-e86c-4fea-be0c-94001895ec60-dshm\") pod \"rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g\" (UID: \"a57a2a62-e86c-4fea-be0c-94001895ec60\") " pod="ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g"
Aug 04 18:43:04.381512 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:04.381473    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a57a2a62-e86c-4fea-be0c-94001895ec60-tmp-dir\") pod \"rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g\" (UID: \"a57a2a62-e86c-4fea-be0c-94001895ec60\") " pod="ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g"
Aug 04 18:43:04.482608 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:04.482579    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a57a2a62-e86c-4fea-be0c-94001895ec60-model-cache\") pod \"rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g\" (UID: \"a57a2a62-e86c-4fea-be0c-94001895ec60\") " pod="ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g"
Aug 04 18:43:04.482751 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:04.482622    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a57a2a62-e86c-4fea-be0c-94001895ec60-tls-certs\") pod \"rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g\" (UID: \"a57a2a62-e86c-4fea-be0c-94001895ec60\") " pod="ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g"
Aug 04 18:43:04.482751 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:04.482641    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4bc5\" (UniqueName: \"kubernetes.io/projected/a57a2a62-e86c-4fea-be0c-94001895ec60-kube-api-access-b4bc5\") pod \"rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g\" (UID: \"a57a2a62-e86c-4fea-be0c-94001895ec60\") " pod="ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g"
Aug 04 18:43:04.482751 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:04.482669    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a57a2a62-e86c-4fea-be0c-94001895ec60-home\") pod \"rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g\" (UID: \"a57a2a62-e86c-4fea-be0c-94001895ec60\") " pod="ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g"
Aug 04 18:43:04.482751 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:04.482685    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a57a2a62-e86c-4fea-be0c-94001895ec60-dshm\") pod \"rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g\" (UID: \"a57a2a62-e86c-4fea-be0c-94001895ec60\") " pod="ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g"
Aug 04 18:43:04.482751 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:04.482699    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a57a2a62-e86c-4fea-be0c-94001895ec60-tmp-dir\") pod \"rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g\" (UID: \"a57a2a62-e86c-4fea-be0c-94001895ec60\") " pod="ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g"
Aug 04 18:43:04.483042 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:04.483020    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a57a2a62-e86c-4fea-be0c-94001895ec60-model-cache\") pod \"rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g\" (UID: \"a57a2a62-e86c-4fea-be0c-94001895ec60\") " pod="ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g"
Aug 04 18:43:04.483107 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:04.483039    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a57a2a62-e86c-4fea-be0c-94001895ec60-tmp-dir\") pod \"rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g\" (UID: \"a57a2a62-e86c-4fea-be0c-94001895ec60\") " pod="ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g"
Aug 04 18:43:04.483148 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:04.483136    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a57a2a62-e86c-4fea-be0c-94001895ec60-home\") pod \"rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g\" (UID: \"a57a2a62-e86c-4fea-be0c-94001895ec60\") " pod="ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g"
Aug 04 18:43:04.484844 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:04.484823    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a57a2a62-e86c-4fea-be0c-94001895ec60-dshm\") pod \"rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g\" (UID: \"a57a2a62-e86c-4fea-be0c-94001895ec60\") " pod="ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g"
Aug 04 18:43:04.484994 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:04.484979    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a57a2a62-e86c-4fea-be0c-94001895ec60-tls-certs\") pod \"rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g\" (UID: \"a57a2a62-e86c-4fea-be0c-94001895ec60\") " pod="ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g"
Aug 04 18:43:04.489678 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:04.489653    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4bc5\" (UniqueName: \"kubernetes.io/projected/a57a2a62-e86c-4fea-be0c-94001895ec60-kube-api-access-b4bc5\") pod \"rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g\" (UID: \"a57a2a62-e86c-4fea-be0c-94001895ec60\") " pod="ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g"
Aug 04 18:43:04.583696 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:04.583676    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g"
Aug 04 18:43:04.728064 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:04.728039    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g"]
Aug 04 18:43:04.730056 ip-10-0-141-220 kubenswrapper[2571]: W0804 18:43:04.730019    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda57a2a62_e86c_4fea_be0c_94001895ec60.slice/crio-610dca07d57c36af3be7e843b9ac458a633015e3a4a747ba1f4dfe69f56e3d90 WatchSource:0}: Error finding container 610dca07d57c36af3be7e843b9ac458a633015e3a4a747ba1f4dfe69f56e3d90: Status 404 returned error can't find the container with id 610dca07d57c36af3be7e843b9ac458a633015e3a4a747ba1f4dfe69f56e3d90
Aug 04 18:43:05.183710 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:05.183676    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g" event={"ID":"a57a2a62-e86c-4fea-be0c-94001895ec60","Type":"ContainerStarted","Data":"b13de07151f93ca81fd316d04131b9672ab7f63fec071d07897345356a6f975f"}
Aug 04 18:43:05.183710 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:05.183715    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g" event={"ID":"a57a2a62-e86c-4fea-be0c-94001895ec60","Type":"ContainerStarted","Data":"610dca07d57c36af3be7e843b9ac458a633015e3a4a747ba1f4dfe69f56e3d90"}
Aug 04 18:43:05.200400 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:05.200354    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g" podStartSLOduration=1.200340216 podStartE2EDuration="1.200340216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:43:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:43:05.198016912 +0000 UTC m=+3401.999153242" watchObservedRunningTime="2026-08-04 18:43:05.200340216 +0000 UTC m=+3402.001476583"
Aug 04 18:43:13.558168 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:13.558128    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv" podUID="33d05a8e-e30a-46d0-8016-a86b8f10f2be" containerName="main" containerID="cri-o://20f981350473707defcce22ea60abd7891e54f81be9c87e4cb1257ed905718dd" gracePeriod=45
Aug 04 18:43:13.802163 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:13.802137    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv"
Aug 04 18:43:13.846989 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:13.846932    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33d05a8e-e30a-46d0-8016-a86b8f10f2be-tmp-dir\") pod \"33d05a8e-e30a-46d0-8016-a86b8f10f2be\" (UID: \"33d05a8e-e30a-46d0-8016-a86b8f10f2be\") "
Aug 04 18:43:13.846989 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:13.846965    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33d05a8e-e30a-46d0-8016-a86b8f10f2be-home\") pod \"33d05a8e-e30a-46d0-8016-a86b8f10f2be\" (UID: \"33d05a8e-e30a-46d0-8016-a86b8f10f2be\") "
Aug 04 18:43:13.847126 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:13.846996    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33d05a8e-e30a-46d0-8016-a86b8f10f2be-tls-certs\") pod \"33d05a8e-e30a-46d0-8016-a86b8f10f2be\" (UID: \"33d05a8e-e30a-46d0-8016-a86b8f10f2be\") "
Aug 04 18:43:13.847126 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:13.847031    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33d05a8e-e30a-46d0-8016-a86b8f10f2be-model-cache\") pod \"33d05a8e-e30a-46d0-8016-a86b8f10f2be\" (UID: \"33d05a8e-e30a-46d0-8016-a86b8f10f2be\") "
Aug 04 18:43:13.847126 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:13.847051    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33d05a8e-e30a-46d0-8016-a86b8f10f2be-dshm\") pod \"33d05a8e-e30a-46d0-8016-a86b8f10f2be\" (UID: \"33d05a8e-e30a-46d0-8016-a86b8f10f2be\") "
Aug 04 18:43:13.847126 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:13.847106    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q974r\" (UniqueName: \"kubernetes.io/projected/33d05a8e-e30a-46d0-8016-a86b8f10f2be-kube-api-access-q974r\") pod \"33d05a8e-e30a-46d0-8016-a86b8f10f2be\" (UID: \"33d05a8e-e30a-46d0-8016-a86b8f10f2be\") "
Aug 04 18:43:13.847318 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:13.847203    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33d05a8e-e30a-46d0-8016-a86b8f10f2be-home" (OuterVolumeSpecName: "home") pod "33d05a8e-e30a-46d0-8016-a86b8f10f2be" (UID: "33d05a8e-e30a-46d0-8016-a86b8f10f2be"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:43:13.847318 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:13.847217    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33d05a8e-e30a-46d0-8016-a86b8f10f2be-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "33d05a8e-e30a-46d0-8016-a86b8f10f2be" (UID: "33d05a8e-e30a-46d0-8016-a86b8f10f2be"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:43:13.847487 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:13.847320    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33d05a8e-e30a-46d0-8016-a86b8f10f2be-model-cache" (OuterVolumeSpecName: "model-cache") pod "33d05a8e-e30a-46d0-8016-a86b8f10f2be" (UID: "33d05a8e-e30a-46d0-8016-a86b8f10f2be"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:43:13.847487 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:13.847408    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33d05a8e-e30a-46d0-8016-a86b8f10f2be-tmp-dir\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:43:13.847487 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:13.847420    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33d05a8e-e30a-46d0-8016-a86b8f10f2be-home\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:43:13.847487 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:13.847428    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33d05a8e-e30a-46d0-8016-a86b8f10f2be-model-cache\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:43:13.849002 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:13.848976    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33d05a8e-e30a-46d0-8016-a86b8f10f2be-dshm" (OuterVolumeSpecName: "dshm") pod "33d05a8e-e30a-46d0-8016-a86b8f10f2be" (UID: "33d05a8e-e30a-46d0-8016-a86b8f10f2be"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:43:13.849107 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:13.849048    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33d05a8e-e30a-46d0-8016-a86b8f10f2be-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "33d05a8e-e30a-46d0-8016-a86b8f10f2be" (UID: "33d05a8e-e30a-46d0-8016-a86b8f10f2be"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:43:13.849178 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:13.849152    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33d05a8e-e30a-46d0-8016-a86b8f10f2be-kube-api-access-q974r" (OuterVolumeSpecName: "kube-api-access-q974r") pod "33d05a8e-e30a-46d0-8016-a86b8f10f2be" (UID: "33d05a8e-e30a-46d0-8016-a86b8f10f2be"). InnerVolumeSpecName "kube-api-access-q974r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:43:13.948428 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:13.948404    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33d05a8e-e30a-46d0-8016-a86b8f10f2be-tls-certs\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:43:13.948428 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:13.948426    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33d05a8e-e30a-46d0-8016-a86b8f10f2be-dshm\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:43:13.948594 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:13.948436    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q974r\" (UniqueName: \"kubernetes.io/projected/33d05a8e-e30a-46d0-8016-a86b8f10f2be-kube-api-access-q974r\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:43:14.219514 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:14.219461    2571 generic.go:356] "Generic (PLEG): container finished" podID="33d05a8e-e30a-46d0-8016-a86b8f10f2be" containerID="20f981350473707defcce22ea60abd7891e54f81be9c87e4cb1257ed905718dd" exitCode=0
Aug 04 18:43:14.219514 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:14.219502    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv"
Aug 04 18:43:14.219681 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:14.219544    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv" event={"ID":"33d05a8e-e30a-46d0-8016-a86b8f10f2be","Type":"ContainerDied","Data":"20f981350473707defcce22ea60abd7891e54f81be9c87e4cb1257ed905718dd"}
Aug 04 18:43:14.219681 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:14.219576    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv" event={"ID":"33d05a8e-e30a-46d0-8016-a86b8f10f2be","Type":"ContainerDied","Data":"734794185a3c9490d8be22251343e72404e84e8605413347244165ff96810ebc"}
Aug 04 18:43:14.219681 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:14.219593    2571 scope.go:117] "RemoveContainer" containerID="20f981350473707defcce22ea60abd7891e54f81be9c87e4cb1257ed905718dd"
Aug 04 18:43:14.227489 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:14.227472    2571 scope.go:117] "RemoveContainer" containerID="20f981350473707defcce22ea60abd7891e54f81be9c87e4cb1257ed905718dd"
Aug 04 18:43:14.227748 ip-10-0-141-220 kubenswrapper[2571]: E0804 18:43:14.227730    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20f981350473707defcce22ea60abd7891e54f81be9c87e4cb1257ed905718dd\": container with ID starting with 20f981350473707defcce22ea60abd7891e54f81be9c87e4cb1257ed905718dd not found: ID does not exist" containerID="20f981350473707defcce22ea60abd7891e54f81be9c87e4cb1257ed905718dd"
Aug 04 18:43:14.227799 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:14.227757    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20f981350473707defcce22ea60abd7891e54f81be9c87e4cb1257ed905718dd"} err="failed to get container status \"20f981350473707defcce22ea60abd7891e54f81be9c87e4cb1257ed905718dd\": rpc error: code = NotFound desc = could not find container \"20f981350473707defcce22ea60abd7891e54f81be9c87e4cb1257ed905718dd\": container with ID starting with 20f981350473707defcce22ea60abd7891e54f81be9c87e4cb1257ed905718dd not found: ID does not exist"
Aug 04 18:43:14.236644 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:14.236625    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv"]
Aug 04 18:43:14.240261 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:14.240241    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-4659f1/sub-test-model-4659f1-kserve-7854fbd49-vk6dv"]
Aug 04 18:43:14.402125 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:14.402096    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226" podUID="24d03d66-cf28-44b8-8a43-4ca0a357eaf4" containerName="main" containerID="cri-o://cf78e2d5fc7060286393864538465410dae6158709eef51fea04fb096e209683" gracePeriod=45
Aug 04 18:43:14.583966 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:14.583939    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g"
Aug 04 18:43:14.584359 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:14.583981    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g"
Aug 04 18:43:14.596667 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:14.596644    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g"
Aug 04 18:43:14.640106 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:14.640088    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226"
Aug 04 18:43:14.754323 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:14.754295    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-856tp\" (UniqueName: \"kubernetes.io/projected/24d03d66-cf28-44b8-8a43-4ca0a357eaf4-kube-api-access-856tp\") pod \"24d03d66-cf28-44b8-8a43-4ca0a357eaf4\" (UID: \"24d03d66-cf28-44b8-8a43-4ca0a357eaf4\") "
Aug 04 18:43:14.754479 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:14.754371    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24d03d66-cf28-44b8-8a43-4ca0a357eaf4-tls-certs\") pod \"24d03d66-cf28-44b8-8a43-4ca0a357eaf4\" (UID: \"24d03d66-cf28-44b8-8a43-4ca0a357eaf4\") "
Aug 04 18:43:14.754479 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:14.754402    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24d03d66-cf28-44b8-8a43-4ca0a357eaf4-home\") pod \"24d03d66-cf28-44b8-8a43-4ca0a357eaf4\" (UID: \"24d03d66-cf28-44b8-8a43-4ca0a357eaf4\") "
Aug 04 18:43:14.754479 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:14.754469    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24d03d66-cf28-44b8-8a43-4ca0a357eaf4-tmp-dir\") pod \"24d03d66-cf28-44b8-8a43-4ca0a357eaf4\" (UID: \"24d03d66-cf28-44b8-8a43-4ca0a357eaf4\") "
Aug 04 18:43:14.754674 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:14.754497    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24d03d66-cf28-44b8-8a43-4ca0a357eaf4-dshm\") pod \"24d03d66-cf28-44b8-8a43-4ca0a357eaf4\" (UID: \"24d03d66-cf28-44b8-8a43-4ca0a357eaf4\") "
Aug 04 18:43:14.754674 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:14.754545    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24d03d66-cf28-44b8-8a43-4ca0a357eaf4-model-cache\") pod \"24d03d66-cf28-44b8-8a43-4ca0a357eaf4\" (UID: \"24d03d66-cf28-44b8-8a43-4ca0a357eaf4\") "
Aug 04 18:43:14.754773 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:14.754711    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24d03d66-cf28-44b8-8a43-4ca0a357eaf4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "24d03d66-cf28-44b8-8a43-4ca0a357eaf4" (UID: "24d03d66-cf28-44b8-8a43-4ca0a357eaf4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:43:14.754836 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:14.754757    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24d03d66-cf28-44b8-8a43-4ca0a357eaf4-home" (OuterVolumeSpecName: "home") pod "24d03d66-cf28-44b8-8a43-4ca0a357eaf4" (UID: "24d03d66-cf28-44b8-8a43-4ca0a357eaf4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:43:14.754836 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:14.754824    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24d03d66-cf28-44b8-8a43-4ca0a357eaf4-model-cache" (OuterVolumeSpecName: "model-cache") pod "24d03d66-cf28-44b8-8a43-4ca0a357eaf4" (UID: "24d03d66-cf28-44b8-8a43-4ca0a357eaf4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:43:14.754936 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:14.754834    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24d03d66-cf28-44b8-8a43-4ca0a357eaf4-tmp-dir\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:43:14.756473 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:14.756450    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24d03d66-cf28-44b8-8a43-4ca0a357eaf4-dshm" (OuterVolumeSpecName: "dshm") pod "24d03d66-cf28-44b8-8a43-4ca0a357eaf4" (UID: "24d03d66-cf28-44b8-8a43-4ca0a357eaf4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:43:14.756473 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:14.756465    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24d03d66-cf28-44b8-8a43-4ca0a357eaf4-kube-api-access-856tp" (OuterVolumeSpecName: "kube-api-access-856tp") pod "24d03d66-cf28-44b8-8a43-4ca0a357eaf4" (UID: "24d03d66-cf28-44b8-8a43-4ca0a357eaf4"). InnerVolumeSpecName "kube-api-access-856tp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:43:14.756625 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:14.756454    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24d03d66-cf28-44b8-8a43-4ca0a357eaf4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "24d03d66-cf28-44b8-8a43-4ca0a357eaf4" (UID: "24d03d66-cf28-44b8-8a43-4ca0a357eaf4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:43:14.855965 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:14.855937    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24d03d66-cf28-44b8-8a43-4ca0a357eaf4-dshm\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:43:14.855965 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:14.855963    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24d03d66-cf28-44b8-8a43-4ca0a357eaf4-model-cache\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:43:14.856131 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:14.855974    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-856tp\" (UniqueName: \"kubernetes.io/projected/24d03d66-cf28-44b8-8a43-4ca0a357eaf4-kube-api-access-856tp\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:43:14.856131 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:14.855983    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24d03d66-cf28-44b8-8a43-4ca0a357eaf4-tls-certs\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:43:14.856131 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:14.855992    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24d03d66-cf28-44b8-8a43-4ca0a357eaf4-home\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:43:15.225767 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:15.225678    2571 generic.go:356] "Generic (PLEG): container finished" podID="24d03d66-cf28-44b8-8a43-4ca0a357eaf4" containerID="cf78e2d5fc7060286393864538465410dae6158709eef51fea04fb096e209683" exitCode=0
Aug 04 18:43:15.225767 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:15.225735    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226"
Aug 04 18:43:15.225955 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:15.225762    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226" event={"ID":"24d03d66-cf28-44b8-8a43-4ca0a357eaf4","Type":"ContainerDied","Data":"cf78e2d5fc7060286393864538465410dae6158709eef51fea04fb096e209683"}
Aug 04 18:43:15.225955 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:15.225805    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226" event={"ID":"24d03d66-cf28-44b8-8a43-4ca0a357eaf4","Type":"ContainerDied","Data":"40ccefdd7712874da356e2592b0d3348869a8f96cc888fb5a9103aa386c6fdee"}
Aug 04 18:43:15.225955 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:15.225826    2571 scope.go:117] "RemoveContainer" containerID="cf78e2d5fc7060286393864538465410dae6158709eef51fea04fb096e209683"
Aug 04 18:43:15.234640 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:15.234617    2571 scope.go:117] "RemoveContainer" containerID="cf78e2d5fc7060286393864538465410dae6158709eef51fea04fb096e209683"
Aug 04 18:43:15.234895 ip-10-0-141-220 kubenswrapper[2571]: E0804 18:43:15.234876    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf78e2d5fc7060286393864538465410dae6158709eef51fea04fb096e209683\": container with ID starting with cf78e2d5fc7060286393864538465410dae6158709eef51fea04fb096e209683 not found: ID does not exist" containerID="cf78e2d5fc7060286393864538465410dae6158709eef51fea04fb096e209683"
Aug 04 18:43:15.234957 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:15.234902    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf78e2d5fc7060286393864538465410dae6158709eef51fea04fb096e209683"} err="failed to get container status \"cf78e2d5fc7060286393864538465410dae6158709eef51fea04fb096e209683\": rpc error: code = NotFound desc = could not find container \"cf78e2d5fc7060286393864538465410dae6158709eef51fea04fb096e209683\": container with ID starting with cf78e2d5fc7060286393864538465410dae6158709eef51fea04fb096e209683 not found: ID does not exist"
Aug 04 18:43:15.239612 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:15.239592    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g"
Aug 04 18:43:15.248347 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:15.248318    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226"]
Aug 04 18:43:15.249737 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:15.249718    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-e9be3f/sub-test-model-e9be3f-kserve-7f6d766c5-sk226"]
Aug 04 18:43:15.879963 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:15.879933    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24d03d66-cf28-44b8-8a43-4ca0a357eaf4" path="/var/lib/kubelet/pods/24d03d66-cf28-44b8-8a43-4ca0a357eaf4/volumes"
Aug 04 18:43:15.880309 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:15.880287    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33d05a8e-e30a-46d0-8016-a86b8f10f2be" path="/var/lib/kubelet/pods/33d05a8e-e30a-46d0-8016-a86b8f10f2be/volumes"
Aug 04 18:43:27.776383 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:27.776351    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r"]
Aug 04 18:43:27.776871 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:27.776649    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33d05a8e-e30a-46d0-8016-a86b8f10f2be" containerName="main"
Aug 04 18:43:27.776871 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:27.776661    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="33d05a8e-e30a-46d0-8016-a86b8f10f2be" containerName="main"
Aug 04 18:43:27.776871 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:27.776678    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24d03d66-cf28-44b8-8a43-4ca0a357eaf4" containerName="main"
Aug 04 18:43:27.776871 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:27.776684    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="24d03d66-cf28-44b8-8a43-4ca0a357eaf4" containerName="main"
Aug 04 18:43:27.776871 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:27.776736    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="24d03d66-cf28-44b8-8a43-4ca0a357eaf4" containerName="main"
Aug 04 18:43:27.776871 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:27.776746    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="33d05a8e-e30a-46d0-8016-a86b8f10f2be" containerName="main"
Aug 04 18:43:27.780966 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:27.780944    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r"
Aug 04 18:43:27.783069 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:27.783041    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e9be3f\"/\"openshift-service-ca.crt\""
Aug 04 18:43:27.783923 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:27.783899    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e9be3f\"/\"default-dockercfg-m54fh\""
Aug 04 18:43:27.784017 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:27.783933    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e9be3f\"/\"rate-test-model-e9be3f-kserve-self-signed-certs\""
Aug 04 18:43:27.784017 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:27.783959    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e9be3f\"/\"kube-root-ca.crt\""
Aug 04 18:43:27.789772 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:27.789751    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r"]
Aug 04 18:43:27.850924 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:27.850902    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84229eef-b42d-4979-a7e4-8ad04af51c8c-home\") pod \"rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r\" (UID: \"84229eef-b42d-4979-a7e4-8ad04af51c8c\") " pod="ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r"
Aug 04 18:43:27.851025 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:27.850932    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84229eef-b42d-4979-a7e4-8ad04af51c8c-tmp-dir\") pod \"rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r\" (UID: \"84229eef-b42d-4979-a7e4-8ad04af51c8c\") " pod="ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r"
Aug 04 18:43:27.851025 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:27.850950    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84229eef-b42d-4979-a7e4-8ad04af51c8c-tls-certs\") pod \"rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r\" (UID: \"84229eef-b42d-4979-a7e4-8ad04af51c8c\") " pod="ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r"
Aug 04 18:43:27.851112 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:27.851019    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84229eef-b42d-4979-a7e4-8ad04af51c8c-dshm\") pod \"rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r\" (UID: \"84229eef-b42d-4979-a7e4-8ad04af51c8c\") " pod="ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r"
Aug 04 18:43:27.851112 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:27.851065    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vjwl\" (UniqueName: \"kubernetes.io/projected/84229eef-b42d-4979-a7e4-8ad04af51c8c-kube-api-access-8vjwl\") pod \"rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r\" (UID: \"84229eef-b42d-4979-a7e4-8ad04af51c8c\") " pod="ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r"
Aug 04 18:43:27.851112 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:27.851091    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84229eef-b42d-4979-a7e4-8ad04af51c8c-model-cache\") pod \"rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r\" (UID: \"84229eef-b42d-4979-a7e4-8ad04af51c8c\") " pod="ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r"
Aug 04 18:43:27.952425 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:27.952383    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84229eef-b42d-4979-a7e4-8ad04af51c8c-dshm\") pod \"rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r\" (UID: \"84229eef-b42d-4979-a7e4-8ad04af51c8c\") " pod="ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r"
Aug 04 18:43:27.952639 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:27.952438    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vjwl\" (UniqueName: \"kubernetes.io/projected/84229eef-b42d-4979-a7e4-8ad04af51c8c-kube-api-access-8vjwl\") pod \"rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r\" (UID: \"84229eef-b42d-4979-a7e4-8ad04af51c8c\") " pod="ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r"
Aug 04 18:43:27.952639 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:27.952481    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84229eef-b42d-4979-a7e4-8ad04af51c8c-model-cache\") pod \"rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r\" (UID: \"84229eef-b42d-4979-a7e4-8ad04af51c8c\") " pod="ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r"
Aug 04 18:43:27.952639 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:27.952571    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84229eef-b42d-4979-a7e4-8ad04af51c8c-home\") pod \"rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r\" (UID: \"84229eef-b42d-4979-a7e4-8ad04af51c8c\") " pod="ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r"
Aug 04 18:43:27.952639 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:27.952607    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84229eef-b42d-4979-a7e4-8ad04af51c8c-tmp-dir\") pod \"rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r\" (UID: \"84229eef-b42d-4979-a7e4-8ad04af51c8c\") " pod="ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r"
Aug 04 18:43:27.952639 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:27.952634    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84229eef-b42d-4979-a7e4-8ad04af51c8c-tls-certs\") pod \"rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r\" (UID: \"84229eef-b42d-4979-a7e4-8ad04af51c8c\") " pod="ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r"
Aug 04 18:43:27.953160 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:27.953137    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84229eef-b42d-4979-a7e4-8ad04af51c8c-home\") pod \"rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r\" (UID: \"84229eef-b42d-4979-a7e4-8ad04af51c8c\") " pod="ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r"
Aug 04 18:43:27.953283 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:27.953247    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84229eef-b42d-4979-a7e4-8ad04af51c8c-tmp-dir\") pod \"rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r\" (UID: \"84229eef-b42d-4979-a7e4-8ad04af51c8c\") " pod="ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r"
Aug 04 18:43:27.953361 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:27.953165    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84229eef-b42d-4979-a7e4-8ad04af51c8c-model-cache\") pod \"rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r\" (UID: \"84229eef-b42d-4979-a7e4-8ad04af51c8c\") " pod="ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r"
Aug 04 18:43:27.955080 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:27.955052    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84229eef-b42d-4979-a7e4-8ad04af51c8c-dshm\") pod \"rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r\" (UID: \"84229eef-b42d-4979-a7e4-8ad04af51c8c\") " pod="ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r"
Aug 04 18:43:27.955159 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:27.955126    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84229eef-b42d-4979-a7e4-8ad04af51c8c-tls-certs\") pod \"rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r\" (UID: \"84229eef-b42d-4979-a7e4-8ad04af51c8c\") " pod="ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r"
Aug 04 18:43:27.960107 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:27.960085    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vjwl\" (UniqueName: \"kubernetes.io/projected/84229eef-b42d-4979-a7e4-8ad04af51c8c-kube-api-access-8vjwl\") pod \"rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r\" (UID: \"84229eef-b42d-4979-a7e4-8ad04af51c8c\") " pod="ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r"
Aug 04 18:43:28.091389 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:28.091341    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r"
Aug 04 18:43:28.213862 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:28.213837    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r"]
Aug 04 18:43:28.216185 ip-10-0-141-220 kubenswrapper[2571]: W0804 18:43:28.216158    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84229eef_b42d_4979_a7e4_8ad04af51c8c.slice/crio-3afe8574a8662590f474e06b0a0f6653edc26b3605b7b6b88e3c6dfb94ab36e9 WatchSource:0}: Error finding container 3afe8574a8662590f474e06b0a0f6653edc26b3605b7b6b88e3c6dfb94ab36e9: Status 404 returned error can't find the container with id 3afe8574a8662590f474e06b0a0f6653edc26b3605b7b6b88e3c6dfb94ab36e9
Aug 04 18:43:28.281704 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:28.281676    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r" event={"ID":"84229eef-b42d-4979-a7e4-8ad04af51c8c","Type":"ContainerStarted","Data":"903acebe8dcb786c4ec0dd6a2703416dee401db35dbfe2798157cf757bd9f0de"}
Aug 04 18:43:28.281814 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:28.281728    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r" event={"ID":"84229eef-b42d-4979-a7e4-8ad04af51c8c","Type":"ContainerStarted","Data":"3afe8574a8662590f474e06b0a0f6653edc26b3605b7b6b88e3c6dfb94ab36e9"}
Aug 04 18:43:28.297821 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:28.297777    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r" podStartSLOduration=1.29776198 podStartE2EDuration="1.29776198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:43:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:43:28.295314254 +0000 UTC m=+3425.096450584" watchObservedRunningTime="2026-08-04 18:43:28.29776198 +0000 UTC m=+3425.098898314"
Aug 04 18:43:38.092365 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:38.092329    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r"
Aug 04 18:43:38.092365 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:38.092371    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r"
Aug 04 18:43:38.104438 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:38.104417    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r"
Aug 04 18:43:38.334235 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:43:38.334210    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r"
Aug 04 18:44:46.244356 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:44:46.244275    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g"]
Aug 04 18:44:47.256644 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:44:47.256611    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r"]
Aug 04 18:45:01.262510 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:01.262470    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g" podUID="a57a2a62-e86c-4fea-be0c-94001895ec60" containerName="main" containerID="cri-o://b13de07151f93ca81fd316d04131b9672ab7f63fec071d07897345356a6f975f" gracePeriod=45
Aug 04 18:45:01.497962 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:01.497938    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g"
Aug 04 18:45:01.638574 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:01.638545    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4bc5\" (UniqueName: \"kubernetes.io/projected/a57a2a62-e86c-4fea-be0c-94001895ec60-kube-api-access-b4bc5\") pod \"a57a2a62-e86c-4fea-be0c-94001895ec60\" (UID: \"a57a2a62-e86c-4fea-be0c-94001895ec60\") "
Aug 04 18:45:01.638714 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:01.638631    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a57a2a62-e86c-4fea-be0c-94001895ec60-tls-certs\") pod \"a57a2a62-e86c-4fea-be0c-94001895ec60\" (UID: \"a57a2a62-e86c-4fea-be0c-94001895ec60\") "
Aug 04 18:45:01.638714 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:01.638665    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a57a2a62-e86c-4fea-be0c-94001895ec60-dshm\") pod \"a57a2a62-e86c-4fea-be0c-94001895ec60\" (UID: \"a57a2a62-e86c-4fea-be0c-94001895ec60\") "
Aug 04 18:45:01.638714 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:01.638687    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a57a2a62-e86c-4fea-be0c-94001895ec60-home\") pod \"a57a2a62-e86c-4fea-be0c-94001895ec60\" (UID: \"a57a2a62-e86c-4fea-be0c-94001895ec60\") "
Aug 04 18:45:01.638884 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:01.638738    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a57a2a62-e86c-4fea-be0c-94001895ec60-model-cache\") pod \"a57a2a62-e86c-4fea-be0c-94001895ec60\" (UID: \"a57a2a62-e86c-4fea-be0c-94001895ec60\") "
Aug 04 18:45:01.638884 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:01.638763    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a57a2a62-e86c-4fea-be0c-94001895ec60-tmp-dir\") pod \"a57a2a62-e86c-4fea-be0c-94001895ec60\" (UID: \"a57a2a62-e86c-4fea-be0c-94001895ec60\") "
Aug 04 18:45:01.639047 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:01.639008    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a57a2a62-e86c-4fea-be0c-94001895ec60-home" (OuterVolumeSpecName: "home") pod "a57a2a62-e86c-4fea-be0c-94001895ec60" (UID: "a57a2a62-e86c-4fea-be0c-94001895ec60"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:45:01.639047 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:01.639020    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a57a2a62-e86c-4fea-be0c-94001895ec60-model-cache" (OuterVolumeSpecName: "model-cache") pod "a57a2a62-e86c-4fea-be0c-94001895ec60" (UID: "a57a2a62-e86c-4fea-be0c-94001895ec60"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:45:01.639227 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:01.639050    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a57a2a62-e86c-4fea-be0c-94001895ec60-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a57a2a62-e86c-4fea-be0c-94001895ec60" (UID: "a57a2a62-e86c-4fea-be0c-94001895ec60"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:45:01.640679 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:01.640652    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a57a2a62-e86c-4fea-be0c-94001895ec60-kube-api-access-b4bc5" (OuterVolumeSpecName: "kube-api-access-b4bc5") pod "a57a2a62-e86c-4fea-be0c-94001895ec60" (UID: "a57a2a62-e86c-4fea-be0c-94001895ec60"). InnerVolumeSpecName "kube-api-access-b4bc5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:45:01.641144 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:01.641116    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a57a2a62-e86c-4fea-be0c-94001895ec60-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a57a2a62-e86c-4fea-be0c-94001895ec60" (UID: "a57a2a62-e86c-4fea-be0c-94001895ec60"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:45:01.641144 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:01.641135    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a57a2a62-e86c-4fea-be0c-94001895ec60-dshm" (OuterVolumeSpecName: "dshm") pod "a57a2a62-e86c-4fea-be0c-94001895ec60" (UID: "a57a2a62-e86c-4fea-be0c-94001895ec60"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:45:01.673109 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:01.673082    2571 generic.go:356] "Generic (PLEG): container finished" podID="a57a2a62-e86c-4fea-be0c-94001895ec60" containerID="b13de07151f93ca81fd316d04131b9672ab7f63fec071d07897345356a6f975f" exitCode=0
Aug 04 18:45:01.673194 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:01.673126    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g"
Aug 04 18:45:01.673194 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:01.673165    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g" event={"ID":"a57a2a62-e86c-4fea-be0c-94001895ec60","Type":"ContainerDied","Data":"b13de07151f93ca81fd316d04131b9672ab7f63fec071d07897345356a6f975f"}
Aug 04 18:45:01.673304 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:01.673207    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g" event={"ID":"a57a2a62-e86c-4fea-be0c-94001895ec60","Type":"ContainerDied","Data":"610dca07d57c36af3be7e843b9ac458a633015e3a4a747ba1f4dfe69f56e3d90"}
Aug 04 18:45:01.673304 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:01.673224    2571 scope.go:117] "RemoveContainer" containerID="b13de07151f93ca81fd316d04131b9672ab7f63fec071d07897345356a6f975f"
Aug 04 18:45:01.681249 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:01.681234    2571 scope.go:117] "RemoveContainer" containerID="b13de07151f93ca81fd316d04131b9672ab7f63fec071d07897345356a6f975f"
Aug 04 18:45:01.681475 ip-10-0-141-220 kubenswrapper[2571]: E0804 18:45:01.681458    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b13de07151f93ca81fd316d04131b9672ab7f63fec071d07897345356a6f975f\": container with ID starting with b13de07151f93ca81fd316d04131b9672ab7f63fec071d07897345356a6f975f not found: ID does not exist" containerID="b13de07151f93ca81fd316d04131b9672ab7f63fec071d07897345356a6f975f"
Aug 04 18:45:01.681541 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:01.681481    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b13de07151f93ca81fd316d04131b9672ab7f63fec071d07897345356a6f975f"} err="failed to get container status \"b13de07151f93ca81fd316d04131b9672ab7f63fec071d07897345356a6f975f\": rpc error: code = NotFound desc = could not find container \"b13de07151f93ca81fd316d04131b9672ab7f63fec071d07897345356a6f975f\": container with ID starting with b13de07151f93ca81fd316d04131b9672ab7f63fec071d07897345356a6f975f not found: ID does not exist"
Aug 04 18:45:01.692204 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:01.692184    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g"]
Aug 04 18:45:01.694334 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:01.694314    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-4659f1/rate-test-model-4659f1-kserve-6744fdcf9f-xcm6g"]
Aug 04 18:45:01.739584 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:01.739560    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a57a2a62-e86c-4fea-be0c-94001895ec60-tls-certs\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:45:01.739584 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:01.739580    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a57a2a62-e86c-4fea-be0c-94001895ec60-dshm\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:45:01.739706 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:01.739588    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a57a2a62-e86c-4fea-be0c-94001895ec60-home\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:45:01.739706 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:01.739595    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a57a2a62-e86c-4fea-be0c-94001895ec60-model-cache\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:45:01.739706 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:01.739603    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a57a2a62-e86c-4fea-be0c-94001895ec60-tmp-dir\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:45:01.739706 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:01.739610    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4bc5\" (UniqueName: \"kubernetes.io/projected/a57a2a62-e86c-4fea-be0c-94001895ec60-kube-api-access-b4bc5\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:45:01.879494 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:01.879465    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a57a2a62-e86c-4fea-be0c-94001895ec60" path="/var/lib/kubelet/pods/a57a2a62-e86c-4fea-be0c-94001895ec60/volumes"
Aug 04 18:45:02.275234 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:02.275172    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r" podUID="84229eef-b42d-4979-a7e4-8ad04af51c8c" containerName="main" containerID="cri-o://903acebe8dcb786c4ec0dd6a2703416dee401db35dbfe2798157cf757bd9f0de" gracePeriod=45
Aug 04 18:45:02.528816 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:02.528761    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r"
Aug 04 18:45:02.646062 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:02.646030    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84229eef-b42d-4979-a7e4-8ad04af51c8c-home\") pod \"84229eef-b42d-4979-a7e4-8ad04af51c8c\" (UID: \"84229eef-b42d-4979-a7e4-8ad04af51c8c\") "
Aug 04 18:45:02.646198 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:02.646095    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84229eef-b42d-4979-a7e4-8ad04af51c8c-tmp-dir\") pod \"84229eef-b42d-4979-a7e4-8ad04af51c8c\" (UID: \"84229eef-b42d-4979-a7e4-8ad04af51c8c\") "
Aug 04 18:45:02.646198 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:02.646114    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vjwl\" (UniqueName: \"kubernetes.io/projected/84229eef-b42d-4979-a7e4-8ad04af51c8c-kube-api-access-8vjwl\") pod \"84229eef-b42d-4979-a7e4-8ad04af51c8c\" (UID: \"84229eef-b42d-4979-a7e4-8ad04af51c8c\") "
Aug 04 18:45:02.646198 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:02.646153    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84229eef-b42d-4979-a7e4-8ad04af51c8c-dshm\") pod \"84229eef-b42d-4979-a7e4-8ad04af51c8c\" (UID: \"84229eef-b42d-4979-a7e4-8ad04af51c8c\") "
Aug 04 18:45:02.646198 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:02.646187    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84229eef-b42d-4979-a7e4-8ad04af51c8c-model-cache\") pod \"84229eef-b42d-4979-a7e4-8ad04af51c8c\" (UID: \"84229eef-b42d-4979-a7e4-8ad04af51c8c\") "
Aug 04 18:45:02.646383 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:02.646216    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84229eef-b42d-4979-a7e4-8ad04af51c8c-tls-certs\") pod \"84229eef-b42d-4979-a7e4-8ad04af51c8c\" (UID: \"84229eef-b42d-4979-a7e4-8ad04af51c8c\") "
Aug 04 18:45:02.646383 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:02.646333    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84229eef-b42d-4979-a7e4-8ad04af51c8c-home" (OuterVolumeSpecName: "home") pod "84229eef-b42d-4979-a7e4-8ad04af51c8c" (UID: "84229eef-b42d-4979-a7e4-8ad04af51c8c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:45:02.646498 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:02.646386    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84229eef-b42d-4979-a7e4-8ad04af51c8c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "84229eef-b42d-4979-a7e4-8ad04af51c8c" (UID: "84229eef-b42d-4979-a7e4-8ad04af51c8c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:45:02.646498 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:02.646462    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84229eef-b42d-4979-a7e4-8ad04af51c8c-model-cache" (OuterVolumeSpecName: "model-cache") pod "84229eef-b42d-4979-a7e4-8ad04af51c8c" (UID: "84229eef-b42d-4979-a7e4-8ad04af51c8c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:45:02.646498 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:02.646476    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84229eef-b42d-4979-a7e4-8ad04af51c8c-home\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:45:02.646498 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:02.646493    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84229eef-b42d-4979-a7e4-8ad04af51c8c-tmp-dir\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:45:02.648264 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:02.648240    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84229eef-b42d-4979-a7e4-8ad04af51c8c-kube-api-access-8vjwl" (OuterVolumeSpecName: "kube-api-access-8vjwl") pod "84229eef-b42d-4979-a7e4-8ad04af51c8c" (UID: "84229eef-b42d-4979-a7e4-8ad04af51c8c"). InnerVolumeSpecName "kube-api-access-8vjwl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:45:02.648364 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:02.648277    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84229eef-b42d-4979-a7e4-8ad04af51c8c-dshm" (OuterVolumeSpecName: "dshm") pod "84229eef-b42d-4979-a7e4-8ad04af51c8c" (UID: "84229eef-b42d-4979-a7e4-8ad04af51c8c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:45:02.648364 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:02.648316    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84229eef-b42d-4979-a7e4-8ad04af51c8c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "84229eef-b42d-4979-a7e4-8ad04af51c8c" (UID: "84229eef-b42d-4979-a7e4-8ad04af51c8c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:45:02.678247 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:02.678223    2571 generic.go:356] "Generic (PLEG): container finished" podID="84229eef-b42d-4979-a7e4-8ad04af51c8c" containerID="903acebe8dcb786c4ec0dd6a2703416dee401db35dbfe2798157cf757bd9f0de" exitCode=0
Aug 04 18:45:02.678358 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:02.678265    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r"
Aug 04 18:45:02.678358 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:02.678304    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r" event={"ID":"84229eef-b42d-4979-a7e4-8ad04af51c8c","Type":"ContainerDied","Data":"903acebe8dcb786c4ec0dd6a2703416dee401db35dbfe2798157cf757bd9f0de"}
Aug 04 18:45:02.678358 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:02.678348    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r" event={"ID":"84229eef-b42d-4979-a7e4-8ad04af51c8c","Type":"ContainerDied","Data":"3afe8574a8662590f474e06b0a0f6653edc26b3605b7b6b88e3c6dfb94ab36e9"}
Aug 04 18:45:02.678554 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:02.678371    2571 scope.go:117] "RemoveContainer" containerID="903acebe8dcb786c4ec0dd6a2703416dee401db35dbfe2798157cf757bd9f0de"
Aug 04 18:45:02.686680 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:02.686665    2571 scope.go:117] "RemoveContainer" containerID="903acebe8dcb786c4ec0dd6a2703416dee401db35dbfe2798157cf757bd9f0de"
Aug 04 18:45:02.686926 ip-10-0-141-220 kubenswrapper[2571]: E0804 18:45:02.686904    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"903acebe8dcb786c4ec0dd6a2703416dee401db35dbfe2798157cf757bd9f0de\": container with ID starting with 903acebe8dcb786c4ec0dd6a2703416dee401db35dbfe2798157cf757bd9f0de not found: ID does not exist" containerID="903acebe8dcb786c4ec0dd6a2703416dee401db35dbfe2798157cf757bd9f0de"
Aug 04 18:45:02.687022 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:02.686933    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"903acebe8dcb786c4ec0dd6a2703416dee401db35dbfe2798157cf757bd9f0de"} err="failed to get container status \"903acebe8dcb786c4ec0dd6a2703416dee401db35dbfe2798157cf757bd9f0de\": rpc error: code = NotFound desc = could not find container \"903acebe8dcb786c4ec0dd6a2703416dee401db35dbfe2798157cf757bd9f0de\": container with ID starting with 903acebe8dcb786c4ec0dd6a2703416dee401db35dbfe2798157cf757bd9f0de not found: ID does not exist"
Aug 04 18:45:02.697165 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:02.697145    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r"]
Aug 04 18:45:02.700552 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:02.700515    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-e9be3f/rate-test-model-e9be3f-kserve-79fd96ff79-h5h6r"]
Aug 04 18:45:02.747768 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:02.747745    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vjwl\" (UniqueName: \"kubernetes.io/projected/84229eef-b42d-4979-a7e4-8ad04af51c8c-kube-api-access-8vjwl\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:45:02.747768 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:02.747768    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84229eef-b42d-4979-a7e4-8ad04af51c8c-dshm\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:45:02.747903 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:02.747778    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84229eef-b42d-4979-a7e4-8ad04af51c8c-model-cache\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:45:02.747903 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:02.747787    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84229eef-b42d-4979-a7e4-8ad04af51c8c-tls-certs\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:45:03.879444 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:03.879412    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84229eef-b42d-4979-a7e4-8ad04af51c8c" path="/var/lib/kubelet/pods/84229eef-b42d-4979-a7e4-8ad04af51c8c/volumes"
Aug 04 18:45:06.666836 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.666805    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"]
Aug 04 18:45:06.667294 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.667120    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a57a2a62-e86c-4fea-be0c-94001895ec60" containerName="main"
Aug 04 18:45:06.667294 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.667133    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a57a2a62-e86c-4fea-be0c-94001895ec60" containerName="main"
Aug 04 18:45:06.667294 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.667149    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84229eef-b42d-4979-a7e4-8ad04af51c8c" containerName="main"
Aug 04 18:45:06.667294 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.667155    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="84229eef-b42d-4979-a7e4-8ad04af51c8c" containerName="main"
Aug 04 18:45:06.667294 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.667206    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="84229eef-b42d-4979-a7e4-8ad04af51c8c" containerName="main"
Aug 04 18:45:06.667294 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.667215    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a57a2a62-e86c-4fea-be0c-94001895ec60" containerName="main"
Aug 04 18:45:06.671700 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.671683    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:06.674101 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.674083    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-e72e63-openshift-default-dockercfg-sxgfw\""
Aug 04 18:45:06.680203 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.680180    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"]
Aug 04 18:45:06.774616 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.774590    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f61bc135-2071-4df2-ac94-1889286d9545-istio-data\") pod \"e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c\" (UID: \"f61bc135-2071-4df2-ac94-1889286d9545\") " pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:06.774720 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.774619    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxzh2\" (UniqueName: \"kubernetes.io/projected/f61bc135-2071-4df2-ac94-1889286d9545-kube-api-access-zxzh2\") pod \"e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c\" (UID: \"f61bc135-2071-4df2-ac94-1889286d9545\") " pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:06.774720 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.774640    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f61bc135-2071-4df2-ac94-1889286d9545-istio-podinfo\") pod \"e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c\" (UID: \"f61bc135-2071-4df2-ac94-1889286d9545\") " pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:06.774720 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.774658    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f61bc135-2071-4df2-ac94-1889286d9545-istio-envoy\") pod \"e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c\" (UID: \"f61bc135-2071-4df2-ac94-1889286d9545\") " pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:06.774832 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.774724    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f61bc135-2071-4df2-ac94-1889286d9545-credential-socket\") pod \"e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c\" (UID: \"f61bc135-2071-4df2-ac94-1889286d9545\") " pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:06.774832 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.774761    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f61bc135-2071-4df2-ac94-1889286d9545-workload-socket\") pod \"e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c\" (UID: \"f61bc135-2071-4df2-ac94-1889286d9545\") " pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:06.774832 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.774780    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f61bc135-2071-4df2-ac94-1889286d9545-istiod-ca-cert\") pod \"e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c\" (UID: \"f61bc135-2071-4df2-ac94-1889286d9545\") " pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:06.774832 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.774810    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f61bc135-2071-4df2-ac94-1889286d9545-workload-certs\") pod \"e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c\" (UID: \"f61bc135-2071-4df2-ac94-1889286d9545\") " pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:06.774960 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.774833    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f61bc135-2071-4df2-ac94-1889286d9545-istio-token\") pod \"e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c\" (UID: \"f61bc135-2071-4df2-ac94-1889286d9545\") " pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:06.875394 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.875362    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f61bc135-2071-4df2-ac94-1889286d9545-workload-socket\") pod \"e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c\" (UID: \"f61bc135-2071-4df2-ac94-1889286d9545\") " pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:06.875595 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.875404    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f61bc135-2071-4df2-ac94-1889286d9545-istiod-ca-cert\") pod \"e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c\" (UID: \"f61bc135-2071-4df2-ac94-1889286d9545\") " pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:06.875595 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.875432    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f61bc135-2071-4df2-ac94-1889286d9545-workload-certs\") pod \"e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c\" (UID: \"f61bc135-2071-4df2-ac94-1889286d9545\") " pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:06.875595 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.875450    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f61bc135-2071-4df2-ac94-1889286d9545-istio-token\") pod \"e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c\" (UID: \"f61bc135-2071-4df2-ac94-1889286d9545\") " pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:06.875595 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.875482    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f61bc135-2071-4df2-ac94-1889286d9545-istio-data\") pod \"e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c\" (UID: \"f61bc135-2071-4df2-ac94-1889286d9545\") " pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:06.875595 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.875512    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxzh2\" (UniqueName: \"kubernetes.io/projected/f61bc135-2071-4df2-ac94-1889286d9545-kube-api-access-zxzh2\") pod \"e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c\" (UID: \"f61bc135-2071-4df2-ac94-1889286d9545\") " pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:06.875595 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.875562    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f61bc135-2071-4df2-ac94-1889286d9545-istio-podinfo\") pod \"e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c\" (UID: \"f61bc135-2071-4df2-ac94-1889286d9545\") " pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:06.875595 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.875590    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f61bc135-2071-4df2-ac94-1889286d9545-istio-envoy\") pod \"e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c\" (UID: \"f61bc135-2071-4df2-ac94-1889286d9545\") " pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:06.875989 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.875643    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f61bc135-2071-4df2-ac94-1889286d9545-credential-socket\") pod \"e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c\" (UID: \"f61bc135-2071-4df2-ac94-1889286d9545\") " pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:06.875989 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.875765    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f61bc135-2071-4df2-ac94-1889286d9545-workload-socket\") pod \"e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c\" (UID: \"f61bc135-2071-4df2-ac94-1889286d9545\") " pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:06.875989 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.875872    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f61bc135-2071-4df2-ac94-1889286d9545-istio-data\") pod \"e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c\" (UID: \"f61bc135-2071-4df2-ac94-1889286d9545\") " pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:06.875989 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.875944    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f61bc135-2071-4df2-ac94-1889286d9545-credential-socket\") pod \"e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c\" (UID: \"f61bc135-2071-4df2-ac94-1889286d9545\") " pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:06.876204 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.876121    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f61bc135-2071-4df2-ac94-1889286d9545-workload-certs\") pod \"e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c\" (UID: \"f61bc135-2071-4df2-ac94-1889286d9545\") " pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:06.876204 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.876186    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f61bc135-2071-4df2-ac94-1889286d9545-istiod-ca-cert\") pod \"e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c\" (UID: \"f61bc135-2071-4df2-ac94-1889286d9545\") " pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:06.877879 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.877862    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f61bc135-2071-4df2-ac94-1889286d9545-istio-envoy\") pod \"e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c\" (UID: \"f61bc135-2071-4df2-ac94-1889286d9545\") " pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:06.878012 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.877995    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f61bc135-2071-4df2-ac94-1889286d9545-istio-podinfo\") pod \"e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c\" (UID: \"f61bc135-2071-4df2-ac94-1889286d9545\") " pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:06.882798 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.882779    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f61bc135-2071-4df2-ac94-1889286d9545-istio-token\") pod \"e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c\" (UID: \"f61bc135-2071-4df2-ac94-1889286d9545\") " pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:06.882964 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.882942    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxzh2\" (UniqueName: \"kubernetes.io/projected/f61bc135-2071-4df2-ac94-1889286d9545-kube-api-access-zxzh2\") pod \"e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c\" (UID: \"f61bc135-2071-4df2-ac94-1889286d9545\") " pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:06.983033 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:06.982977    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:07.110699 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:07.110674    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"]
Aug 04 18:45:07.112808 ip-10-0-141-220 kubenswrapper[2571]: W0804 18:45:07.112776    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf61bc135_2071_4df2_ac94_1889286d9545.slice/crio-ceb22b0aa46a12a7ab24f4768086f9fcb1fe20e5a7762b44d8882ca2b810df5e WatchSource:0}: Error finding container ceb22b0aa46a12a7ab24f4768086f9fcb1fe20e5a7762b44d8882ca2b810df5e: Status 404 returned error can't find the container with id ceb22b0aa46a12a7ab24f4768086f9fcb1fe20e5a7762b44d8882ca2b810df5e
Aug 04 18:45:07.114910 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:07.114875    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:45:07.115007 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:07.114942    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:45:07.115007 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:07.114973    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:45:07.708836 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:07.708798    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c" event={"ID":"f61bc135-2071-4df2-ac94-1889286d9545","Type":"ContainerStarted","Data":"da90e63744b1492e96bcdb87784e1a038db989963cf0e48f4454b6193fe7762a"}
Aug 04 18:45:07.709289 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:07.708875    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c" event={"ID":"f61bc135-2071-4df2-ac94-1889286d9545","Type":"ContainerStarted","Data":"ceb22b0aa46a12a7ab24f4768086f9fcb1fe20e5a7762b44d8882ca2b810df5e"}
Aug 04 18:45:07.726840 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:07.726784    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c" podStartSLOduration=1.7267676760000001 podStartE2EDuration="1.726767676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:45:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:45:07.726061159 +0000 UTC m=+3524.527197487" watchObservedRunningTime="2026-08-04 18:45:07.726767676 +0000 UTC m=+3524.527904003"
Aug 04 18:45:07.983384 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:07.983300    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:08.987798 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:08.987762    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:09.716781 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:09.716754    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:09.717423 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:09.717406    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:23.782195 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:23.782164    2571 generic.go:356] "Generic (PLEG): container finished" podID="f61bc135-2071-4df2-ac94-1889286d9545" containerID="da90e63744b1492e96bcdb87784e1a038db989963cf0e48f4454b6193fe7762a" exitCode=0
Aug 04 18:45:23.782696 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:23.782228    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c" event={"ID":"f61bc135-2071-4df2-ac94-1889286d9545","Type":"ContainerDied","Data":"da90e63744b1492e96bcdb87784e1a038db989963cf0e48f4454b6193fe7762a"}
Aug 04 18:45:23.782696 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:23.782655    2571 scope.go:117] "RemoveContainer" containerID="da90e63744b1492e96bcdb87784e1a038db989963cf0e48f4454b6193fe7762a"
Aug 04 18:45:23.783645 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:23.783617    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:45:23.783708 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:23.783681    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:45:23.783748 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:23.783722    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:45:24.717031 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:24.716997    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:24.788196 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:24.788162    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c" event={"ID":"f61bc135-2071-4df2-ac94-1889286d9545","Type":"ContainerStarted","Data":"d2f396d66383dc39aec66d93a1a6af3b330857a820e5e4554f3a06a189acdc49"}
Aug 04 18:45:24.983358 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:24.983270    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:24.984260 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:24.984236    2571 patch_prober.go:28] interesting pod/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Aug 04 18:45:24.984373 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:24.984284    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c" podUID="f61bc135-2071-4df2-ac94-1889286d9545" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Aug 04 18:45:25.983393 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:25.983362    2571 patch_prober.go:28] interesting pod/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Aug 04 18:45:25.983793 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:25.983413    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c" podUID="f61bc135-2071-4df2-ac94-1889286d9545" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Aug 04 18:45:26.983678 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:26.983647    2571 patch_prober.go:28] interesting pod/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Aug 04 18:45:26.984058 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:26.983694    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c" podUID="f61bc135-2071-4df2-ac94-1889286d9545" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Aug 04 18:45:27.983361 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:27.983322    2571 patch_prober.go:28] interesting pod/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Aug 04 18:45:27.983594 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:27.983384    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c" podUID="f61bc135-2071-4df2-ac94-1889286d9545" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Aug 04 18:45:28.983845 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:28.983806    2571 patch_prober.go:28] interesting pod/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Aug 04 18:45:28.984297 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:28.983867    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c" podUID="f61bc135-2071-4df2-ac94-1889286d9545" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Aug 04 18:45:29.988130 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:29.988103    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:29.988511 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:29.988430    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:29.989009 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:29.988992    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:45:35.477375 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:35.477342    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"]
Aug 04 18:45:35.480475 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:35.480455    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:45:35.482562 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:35.482541    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-c7bd98-openshift-default-dockercfg-ptvnq\""
Aug 04 18:45:35.491261 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:35.491240    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"]
Aug 04 18:45:35.601766 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:35.601732    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-credential-socket\") pod \"e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb\" (UID: \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\") " pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:45:35.601960 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:35.601818    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-istio-envoy\") pod \"e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb\" (UID: \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\") " pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:45:35.601960 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:35.601870    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-workload-socket\") pod \"e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb\" (UID: \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\") " pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:45:35.601960 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:35.601900    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-istio-podinfo\") pod \"e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb\" (UID: \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\") " pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:45:35.601960 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:35.601921    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-istio-data\") pod \"e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb\" (UID: \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\") " pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:45:35.601960 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:35.601938    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-workload-certs\") pod \"e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb\" (UID: \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\") " pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:45:35.602165 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:35.602040    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-istio-token\") pod \"e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb\" (UID: \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\") " pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:45:35.602165 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:35.602061    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtj7m\" (UniqueName: \"kubernetes.io/projected/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-kube-api-access-jtj7m\") pod \"e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb\" (UID: \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\") " pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:45:35.602165 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:35.602083    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-istiod-ca-cert\") pod \"e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb\" (UID: \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\") " pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:45:35.702891 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:35.702859    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-istio-envoy\") pod \"e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb\" (UID: \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\") " pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:45:35.703048 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:35.702909    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-workload-socket\") pod \"e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb\" (UID: \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\") " pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:45:35.703048 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:35.702942    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-istio-podinfo\") pod \"e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb\" (UID: \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\") " pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:45:35.703048 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:35.702969    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-istio-data\") pod \"e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb\" (UID: \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\") " pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:45:35.703048 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:35.702995    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-workload-certs\") pod \"e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb\" (UID: \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\") " pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:45:35.703273 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:35.703062    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-istio-token\") pod \"e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb\" (UID: \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\") " pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:45:35.703273 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:35.703089    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtj7m\" (UniqueName: \"kubernetes.io/projected/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-kube-api-access-jtj7m\") pod \"e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb\" (UID: \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\") " pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:45:35.703273 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:35.703118    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-istiod-ca-cert\") pod \"e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb\" (UID: \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\") " pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:45:35.703273 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:35.703146    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-credential-socket\") pod \"e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb\" (UID: \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\") " pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:45:35.703488 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:35.703425    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-istio-data\") pod \"e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb\" (UID: \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\") " pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:45:35.703488 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:35.703437    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-workload-certs\") pod \"e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb\" (UID: \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\") " pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:45:35.703633 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:35.703550    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-credential-socket\") pod \"e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb\" (UID: \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\") " pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:45:35.703633 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:35.703611    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-workload-socket\") pod \"e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb\" (UID: \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\") " pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:45:35.703941 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:35.703923    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-istiod-ca-cert\") pod \"e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb\" (UID: \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\") " pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:45:35.705754 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:35.705730    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-istio-envoy\") pod \"e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb\" (UID: \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\") " pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:45:35.705923 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:35.705908    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-istio-podinfo\") pod \"e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb\" (UID: \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\") " pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:45:35.710881 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:35.710860    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtj7m\" (UniqueName: \"kubernetes.io/projected/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-kube-api-access-jtj7m\") pod \"e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb\" (UID: \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\") " pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:45:35.711164 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:35.711146    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-istio-token\") pod \"e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb\" (UID: \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\") " pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:45:35.791123 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:35.791102    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:45:35.916327 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:35.916305    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"]
Aug 04 18:45:35.917975 ip-10-0-141-220 kubenswrapper[2571]: W0804 18:45:35.917947    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f525e0a_270c_4ef2_94a0_f2519ab1d6f8.slice/crio-e781752295ea606f12b3e9047d156530afeb10672ce02ffc756b853097ed5a03 WatchSource:0}: Error finding container e781752295ea606f12b3e9047d156530afeb10672ce02ffc756b853097ed5a03: Status 404 returned error can't find the container with id e781752295ea606f12b3e9047d156530afeb10672ce02ffc756b853097ed5a03
Aug 04 18:45:35.926196 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:35.920593    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:45:35.926196 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:35.920786    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:45:35.926196 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:35.920891    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:45:36.839476 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:36.839439    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb" event={"ID":"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8","Type":"ContainerStarted","Data":"6f7a13b1ca9d79065046002306b7c396408a146ffc25ca58ac3b9758f6c8bb3e"}
Aug 04 18:45:36.839990 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:36.839555    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb" event={"ID":"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8","Type":"ContainerStarted","Data":"e781752295ea606f12b3e9047d156530afeb10672ce02ffc756b853097ed5a03"}
Aug 04 18:45:36.862210 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:36.862158    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb" podStartSLOduration=1.862144408 podStartE2EDuration="1.862144408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:45:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:45:36.860380642 +0000 UTC m=+3553.661516991" watchObservedRunningTime="2026-08-04 18:45:36.862144408 +0000 UTC m=+3553.663280735"
Aug 04 18:45:37.792100 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:37.792070    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:45:37.796551 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:37.796507    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:45:37.844014 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:37.843993    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:45:37.844939 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:37.844917    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:45:52.845274 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:52.845221    2571 patch_prober.go:28] interesting pod/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Aug 04 18:45:52.845613 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:52.845270    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb" podUID="3f525e0a-270c-4ef2-94a0-f2519ab1d6f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Aug 04 18:45:52.913364 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:52.913310    2571 generic.go:356] "Generic (PLEG): container finished" podID="3f525e0a-270c-4ef2-94a0-f2519ab1d6f8" containerID="6f7a13b1ca9d79065046002306b7c396408a146ffc25ca58ac3b9758f6c8bb3e" exitCode=0
Aug 04 18:45:52.913451 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:52.913382    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb" event={"ID":"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8","Type":"ContainerDied","Data":"6f7a13b1ca9d79065046002306b7c396408a146ffc25ca58ac3b9758f6c8bb3e"}
Aug 04 18:45:52.913732 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:52.913718    2571 scope.go:117] "RemoveContainer" containerID="6f7a13b1ca9d79065046002306b7c396408a146ffc25ca58ac3b9758f6c8bb3e"
Aug 04 18:45:52.914665 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:52.914637    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:45:52.914726 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:52.914703    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:45:52.914769 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:52.914733    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 18:45:53.918407 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:53.918375    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb" event={"ID":"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8","Type":"ContainerStarted","Data":"83c19287abffda5c04c855f5e9dfce596fd0cfd89ff5c2f871b44056b87f213b"}
Aug 04 18:45:54.791583 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:54.791549    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:45:54.791828 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:54.791724    2571 patch_prober.go:28] interesting pod/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Aug 04 18:45:54.791828 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:54.791768    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb" podUID="3f525e0a-270c-4ef2-94a0-f2519ab1d6f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Aug 04 18:45:55.791876 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:55.791836    2571 patch_prober.go:28] interesting pod/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Aug 04 18:45:55.792285 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:55.791893    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb" podUID="3f525e0a-270c-4ef2-94a0-f2519ab1d6f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Aug 04 18:45:56.792394 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:56.792358    2571 patch_prober.go:28] interesting pod/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Aug 04 18:45:56.792822 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:56.792420    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb" podUID="3f525e0a-270c-4ef2-94a0-f2519ab1d6f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Aug 04 18:45:57.791726 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:57.791691    2571 patch_prober.go:28] interesting pod/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Aug 04 18:45:57.791898 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:57.791745    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb" podUID="3f525e0a-270c-4ef2-94a0-f2519ab1d6f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Aug 04 18:45:58.814576 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:58.814541    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:45:58.815012 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:58.814878    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:45:58.815891 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:45:58.815869    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:46:14.961779 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:46:14.961748    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt"]
Aug 04 18:46:14.963747 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:46:14.963730    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt"
Aug 04 18:46:14.965881 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:46:14.965850    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-e72e63\"/\"kube-root-ca.crt\""
Aug 04 18:46:14.966798 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:46:14.966778    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-e72e63\"/\"default-dockercfg-dpt4g\""
Aug 04 18:46:14.966930 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:46:14.966833    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-e72e63\"/\"openshift-service-ca.crt\""
Aug 04 18:46:14.966930 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:46:14.966787    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-e72e63\"/\"ipp-route-e72e63-kserve-self-signed-certs\""
Aug 04 18:46:14.974655 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:46:14.974637    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt"]
Aug 04 18:46:15.013043 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:46:15.013018    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b41bbc9-7cf3-49fe-a8f0-e911de31a0af-tmp-dir\") pod \"ipp-route-e72e63-kserve-5c559f6dc-6jlwt\" (UID: \"0b41bbc9-7cf3-49fe-a8f0-e911de31a0af\") " pod="ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt"
Aug 04 18:46:15.013152 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:46:15.013079    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b41bbc9-7cf3-49fe-a8f0-e911de31a0af-home\") pod \"ipp-route-e72e63-kserve-5c559f6dc-6jlwt\" (UID: \"0b41bbc9-7cf3-49fe-a8f0-e911de31a0af\") " pod="ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt"
Aug 04 18:46:15.013152 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:46:15.013099    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txxkk\" (UniqueName: \"kubernetes.io/projected/0b41bbc9-7cf3-49fe-a8f0-e911de31a0af-kube-api-access-txxkk\") pod \"ipp-route-e72e63-kserve-5c559f6dc-6jlwt\" (UID: \"0b41bbc9-7cf3-49fe-a8f0-e911de31a0af\") " pod="ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt"
Aug 04 18:46:15.013152 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:46:15.013124    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b41bbc9-7cf3-49fe-a8f0-e911de31a0af-model-cache\") pod \"ipp-route-e72e63-kserve-5c559f6dc-6jlwt\" (UID: \"0b41bbc9-7cf3-49fe-a8f0-e911de31a0af\") " pod="ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt"
Aug 04 18:46:15.013265 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:46:15.013153    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b41bbc9-7cf3-49fe-a8f0-e911de31a0af-dshm\") pod \"ipp-route-e72e63-kserve-5c559f6dc-6jlwt\" (UID: \"0b41bbc9-7cf3-49fe-a8f0-e911de31a0af\") " pod="ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt"
Aug 04 18:46:15.013265 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:46:15.013183    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b41bbc9-7cf3-49fe-a8f0-e911de31a0af-tls-certs\") pod \"ipp-route-e72e63-kserve-5c559f6dc-6jlwt\" (UID: \"0b41bbc9-7cf3-49fe-a8f0-e911de31a0af\") " pod="ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt"
Aug 04 18:46:15.114457 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:46:15.114426    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b41bbc9-7cf3-49fe-a8f0-e911de31a0af-home\") pod \"ipp-route-e72e63-kserve-5c559f6dc-6jlwt\" (UID: \"0b41bbc9-7cf3-49fe-a8f0-e911de31a0af\") " pod="ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt"
Aug 04 18:46:15.114457 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:46:15.114462    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txxkk\" (UniqueName: \"kubernetes.io/projected/0b41bbc9-7cf3-49fe-a8f0-e911de31a0af-kube-api-access-txxkk\") pod \"ipp-route-e72e63-kserve-5c559f6dc-6jlwt\" (UID: \"0b41bbc9-7cf3-49fe-a8f0-e911de31a0af\") " pod="ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt"
Aug 04 18:46:15.114741 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:46:15.114482    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b41bbc9-7cf3-49fe-a8f0-e911de31a0af-model-cache\") pod \"ipp-route-e72e63-kserve-5c559f6dc-6jlwt\" (UID: \"0b41bbc9-7cf3-49fe-a8f0-e911de31a0af\") " pod="ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt"
Aug 04 18:46:15.114741 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:46:15.114556    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b41bbc9-7cf3-49fe-a8f0-e911de31a0af-dshm\") pod \"ipp-route-e72e63-kserve-5c559f6dc-6jlwt\" (UID: \"0b41bbc9-7cf3-49fe-a8f0-e911de31a0af\") " pod="ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt"
Aug 04 18:46:15.114741 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:46:15.114583    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b41bbc9-7cf3-49fe-a8f0-e911de31a0af-tls-certs\") pod \"ipp-route-e72e63-kserve-5c559f6dc-6jlwt\" (UID: \"0b41bbc9-7cf3-49fe-a8f0-e911de31a0af\") " pod="ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt"
Aug 04 18:46:15.114741 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:46:15.114626    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b41bbc9-7cf3-49fe-a8f0-e911de31a0af-tmp-dir\") pod \"ipp-route-e72e63-kserve-5c559f6dc-6jlwt\" (UID: \"0b41bbc9-7cf3-49fe-a8f0-e911de31a0af\") " pod="ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt"
Aug 04 18:46:15.115006 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:46:15.114898    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b41bbc9-7cf3-49fe-a8f0-e911de31a0af-home\") pod \"ipp-route-e72e63-kserve-5c559f6dc-6jlwt\" (UID: \"0b41bbc9-7cf3-49fe-a8f0-e911de31a0af\") " pod="ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt"
Aug 04 18:46:15.115006 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:46:15.114946    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b41bbc9-7cf3-49fe-a8f0-e911de31a0af-model-cache\") pod \"ipp-route-e72e63-kserve-5c559f6dc-6jlwt\" (UID: \"0b41bbc9-7cf3-49fe-a8f0-e911de31a0af\") " pod="ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt"
Aug 04 18:46:15.115006 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:46:15.114958    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b41bbc9-7cf3-49fe-a8f0-e911de31a0af-tmp-dir\") pod \"ipp-route-e72e63-kserve-5c559f6dc-6jlwt\" (UID: \"0b41bbc9-7cf3-49fe-a8f0-e911de31a0af\") " pod="ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt"
Aug 04 18:46:15.116838 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:46:15.116813    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b41bbc9-7cf3-49fe-a8f0-e911de31a0af-dshm\") pod \"ipp-route-e72e63-kserve-5c559f6dc-6jlwt\" (UID: \"0b41bbc9-7cf3-49fe-a8f0-e911de31a0af\") " pod="ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt"
Aug 04 18:46:15.117019 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:46:15.117002    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b41bbc9-7cf3-49fe-a8f0-e911de31a0af-tls-certs\") pod \"ipp-route-e72e63-kserve-5c559f6dc-6jlwt\" (UID: \"0b41bbc9-7cf3-49fe-a8f0-e911de31a0af\") " pod="ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt"
Aug 04 18:46:15.121638 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:46:15.121615    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txxkk\" (UniqueName: \"kubernetes.io/projected/0b41bbc9-7cf3-49fe-a8f0-e911de31a0af-kube-api-access-txxkk\") pod \"ipp-route-e72e63-kserve-5c559f6dc-6jlwt\" (UID: \"0b41bbc9-7cf3-49fe-a8f0-e911de31a0af\") " pod="ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt"
Aug 04 18:46:15.275245 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:46:15.275225    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt"
Aug 04 18:46:15.397754 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:46:15.397728    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt"]
Aug 04 18:46:15.399726 ip-10-0-141-220 kubenswrapper[2571]: W0804 18:46:15.399702    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b41bbc9_7cf3_49fe_a8f0_e911de31a0af.slice/crio-915c685d6ff471937e3dda51564b754a49925f2122d61ea68208855c72f8631d WatchSource:0}: Error finding container 915c685d6ff471937e3dda51564b754a49925f2122d61ea68208855c72f8631d: Status 404 returned error can't find the container with id 915c685d6ff471937e3dda51564b754a49925f2122d61ea68208855c72f8631d
Aug 04 18:46:16.016295 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:46:16.016263    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt" event={"ID":"0b41bbc9-7cf3-49fe-a8f0-e911de31a0af","Type":"ContainerStarted","Data":"ac141bbd805434584274b50ae55a1f195d3bb4fa875ce188e58126f383832183"}
Aug 04 18:46:16.016758 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:46:16.016301    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt" event={"ID":"0b41bbc9-7cf3-49fe-a8f0-e911de31a0af","Type":"ContainerStarted","Data":"915c685d6ff471937e3dda51564b754a49925f2122d61ea68208855c72f8631d"}
Aug 04 18:46:16.034285 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:46:16.034239    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt" podStartSLOduration=2.034223503 podStartE2EDuration="2.034223503s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:46:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:46:16.032697657 +0000 UTC m=+3592.833833983" watchObservedRunningTime="2026-08-04 18:46:16.034223503 +0000 UTC m=+3592.835359830"
Aug 04 18:46:25.276135 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:46:25.276099    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt"
Aug 04 18:46:25.276576 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:46:25.276153    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt"
Aug 04 18:46:25.288261 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:46:25.288240    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt"
Aug 04 18:46:26.067602 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:46:26.067574    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt"
Aug 04 18:48:02.286683 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:02.286610    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt"]
Aug 04 18:48:17.306341 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:17.306278    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt" podUID="0b41bbc9-7cf3-49fe-a8f0-e911de31a0af" containerName="main" containerID="cri-o://ac141bbd805434584274b50ae55a1f195d3bb4fa875ce188e58126f383832183" gracePeriod=45
Aug 04 18:48:17.537488 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:17.537458    2571 generic.go:356] "Generic (PLEG): container finished" podID="0b41bbc9-7cf3-49fe-a8f0-e911de31a0af" containerID="ac141bbd805434584274b50ae55a1f195d3bb4fa875ce188e58126f383832183" exitCode=0
Aug 04 18:48:17.537635 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:17.537513    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt" event={"ID":"0b41bbc9-7cf3-49fe-a8f0-e911de31a0af","Type":"ContainerDied","Data":"ac141bbd805434584274b50ae55a1f195d3bb4fa875ce188e58126f383832183"}
Aug 04 18:48:17.537635 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:17.537572    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt" event={"ID":"0b41bbc9-7cf3-49fe-a8f0-e911de31a0af","Type":"ContainerDied","Data":"915c685d6ff471937e3dda51564b754a49925f2122d61ea68208855c72f8631d"}
Aug 04 18:48:17.537635 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:17.537589    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="915c685d6ff471937e3dda51564b754a49925f2122d61ea68208855c72f8631d"
Aug 04 18:48:17.547836 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:17.547818    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt"
Aug 04 18:48:17.645991 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:17.645926    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b41bbc9-7cf3-49fe-a8f0-e911de31a0af-model-cache\") pod \"0b41bbc9-7cf3-49fe-a8f0-e911de31a0af\" (UID: \"0b41bbc9-7cf3-49fe-a8f0-e911de31a0af\") "
Aug 04 18:48:17.645991 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:17.645968    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b41bbc9-7cf3-49fe-a8f0-e911de31a0af-tls-certs\") pod \"0b41bbc9-7cf3-49fe-a8f0-e911de31a0af\" (UID: \"0b41bbc9-7cf3-49fe-a8f0-e911de31a0af\") "
Aug 04 18:48:17.646148 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:17.646029    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b41bbc9-7cf3-49fe-a8f0-e911de31a0af-tmp-dir\") pod \"0b41bbc9-7cf3-49fe-a8f0-e911de31a0af\" (UID: \"0b41bbc9-7cf3-49fe-a8f0-e911de31a0af\") "
Aug 04 18:48:17.646148 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:17.646045    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txxkk\" (UniqueName: \"kubernetes.io/projected/0b41bbc9-7cf3-49fe-a8f0-e911de31a0af-kube-api-access-txxkk\") pod \"0b41bbc9-7cf3-49fe-a8f0-e911de31a0af\" (UID: \"0b41bbc9-7cf3-49fe-a8f0-e911de31a0af\") "
Aug 04 18:48:17.646148 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:17.646098    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b41bbc9-7cf3-49fe-a8f0-e911de31a0af-home\") pod \"0b41bbc9-7cf3-49fe-a8f0-e911de31a0af\" (UID: \"0b41bbc9-7cf3-49fe-a8f0-e911de31a0af\") "
Aug 04 18:48:17.646314 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:17.646160    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b41bbc9-7cf3-49fe-a8f0-e911de31a0af-dshm\") pod \"0b41bbc9-7cf3-49fe-a8f0-e911de31a0af\" (UID: \"0b41bbc9-7cf3-49fe-a8f0-e911de31a0af\") "
Aug 04 18:48:17.646314 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:17.646179    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b41bbc9-7cf3-49fe-a8f0-e911de31a0af-model-cache" (OuterVolumeSpecName: "model-cache") pod "0b41bbc9-7cf3-49fe-a8f0-e911de31a0af" (UID: "0b41bbc9-7cf3-49fe-a8f0-e911de31a0af"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:48:17.646314 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:17.646255    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b41bbc9-7cf3-49fe-a8f0-e911de31a0af-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0b41bbc9-7cf3-49fe-a8f0-e911de31a0af" (UID: "0b41bbc9-7cf3-49fe-a8f0-e911de31a0af"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:48:17.646478 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:17.646377    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b41bbc9-7cf3-49fe-a8f0-e911de31a0af-model-cache\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:48:17.646478 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:17.646377    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b41bbc9-7cf3-49fe-a8f0-e911de31a0af-home" (OuterVolumeSpecName: "home") pod "0b41bbc9-7cf3-49fe-a8f0-e911de31a0af" (UID: "0b41bbc9-7cf3-49fe-a8f0-e911de31a0af"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:48:17.646478 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:17.646399    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b41bbc9-7cf3-49fe-a8f0-e911de31a0af-tmp-dir\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:48:17.648148 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:17.648123    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b41bbc9-7cf3-49fe-a8f0-e911de31a0af-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0b41bbc9-7cf3-49fe-a8f0-e911de31a0af" (UID: "0b41bbc9-7cf3-49fe-a8f0-e911de31a0af"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:48:17.648252 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:17.648219    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b41bbc9-7cf3-49fe-a8f0-e911de31a0af-dshm" (OuterVolumeSpecName: "dshm") pod "0b41bbc9-7cf3-49fe-a8f0-e911de31a0af" (UID: "0b41bbc9-7cf3-49fe-a8f0-e911de31a0af"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:48:17.648252 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:17.648233    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b41bbc9-7cf3-49fe-a8f0-e911de31a0af-kube-api-access-txxkk" (OuterVolumeSpecName: "kube-api-access-txxkk") pod "0b41bbc9-7cf3-49fe-a8f0-e911de31a0af" (UID: "0b41bbc9-7cf3-49fe-a8f0-e911de31a0af"). InnerVolumeSpecName "kube-api-access-txxkk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:48:17.746813 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:17.746787    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b41bbc9-7cf3-49fe-a8f0-e911de31a0af-dshm\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:48:17.746813 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:17.746812    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b41bbc9-7cf3-49fe-a8f0-e911de31a0af-tls-certs\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:48:17.746967 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:17.746823    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txxkk\" (UniqueName: \"kubernetes.io/projected/0b41bbc9-7cf3-49fe-a8f0-e911de31a0af-kube-api-access-txxkk\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:48:17.746967 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:17.746831    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b41bbc9-7cf3-49fe-a8f0-e911de31a0af-home\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:48:18.541717 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:18.541691    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt"
Aug 04 18:48:18.557012 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:18.556986    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt"]
Aug 04 18:48:18.560373 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:18.560352    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-e72e63/ipp-route-e72e63-kserve-5c559f6dc-6jlwt"]
Aug 04 18:48:19.879110 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:19.879070    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b41bbc9-7cf3-49fe-a8f0-e911de31a0af" path="/var/lib/kubelet/pods/0b41bbc9-7cf3-49fe-a8f0-e911de31a0af/volumes"
Aug 04 18:48:45.414007 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:45.413974    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"]
Aug 04 18:48:45.414652 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:45.414178    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c" podUID="f61bc135-2071-4df2-ac94-1889286d9545" containerName="istio-proxy" containerID="cri-o://d2f396d66383dc39aec66d93a1a6af3b330857a820e5e4554f3a06a189acdc49" gracePeriod=30
Aug 04 18:48:50.656425 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.656399    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:48:50.676982 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.676920    2571 generic.go:356] "Generic (PLEG): container finished" podID="f61bc135-2071-4df2-ac94-1889286d9545" containerID="d2f396d66383dc39aec66d93a1a6af3b330857a820e5e4554f3a06a189acdc49" exitCode=0
Aug 04 18:48:50.677091 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.676979    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"
Aug 04 18:48:50.677158 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.676971    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c" event={"ID":"f61bc135-2071-4df2-ac94-1889286d9545","Type":"ContainerDied","Data":"d2f396d66383dc39aec66d93a1a6af3b330857a820e5e4554f3a06a189acdc49"}
Aug 04 18:48:50.677223 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.677188    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c" event={"ID":"f61bc135-2071-4df2-ac94-1889286d9545","Type":"ContainerDied","Data":"ceb22b0aa46a12a7ab24f4768086f9fcb1fe20e5a7762b44d8882ca2b810df5e"}
Aug 04 18:48:50.677279 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.677227    2571 scope.go:117] "RemoveContainer" containerID="d2f396d66383dc39aec66d93a1a6af3b330857a820e5e4554f3a06a189acdc49"
Aug 04 18:48:50.686214 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.686197    2571 scope.go:117] "RemoveContainer" containerID="da90e63744b1492e96bcdb87784e1a038db989963cf0e48f4454b6193fe7762a"
Aug 04 18:48:50.693451 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.693432    2571 scope.go:117] "RemoveContainer" containerID="d2f396d66383dc39aec66d93a1a6af3b330857a820e5e4554f3a06a189acdc49"
Aug 04 18:48:50.693744 ip-10-0-141-220 kubenswrapper[2571]: E0804 18:48:50.693723    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2f396d66383dc39aec66d93a1a6af3b330857a820e5e4554f3a06a189acdc49\": container with ID starting with d2f396d66383dc39aec66d93a1a6af3b330857a820e5e4554f3a06a189acdc49 not found: ID does not exist" containerID="d2f396d66383dc39aec66d93a1a6af3b330857a820e5e4554f3a06a189acdc49"
Aug 04 18:48:50.693835 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.693748    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2f396d66383dc39aec66d93a1a6af3b330857a820e5e4554f3a06a189acdc49"} err="failed to get container status \"d2f396d66383dc39aec66d93a1a6af3b330857a820e5e4554f3a06a189acdc49\": rpc error: code = NotFound desc = could not find container \"d2f396d66383dc39aec66d93a1a6af3b330857a820e5e4554f3a06a189acdc49\": container with ID starting with d2f396d66383dc39aec66d93a1a6af3b330857a820e5e4554f3a06a189acdc49 not found: ID does not exist"
Aug 04 18:48:50.693835 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.693766    2571 scope.go:117] "RemoveContainer" containerID="da90e63744b1492e96bcdb87784e1a038db989963cf0e48f4454b6193fe7762a"
Aug 04 18:48:50.693983 ip-10-0-141-220 kubenswrapper[2571]: E0804 18:48:50.693969    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da90e63744b1492e96bcdb87784e1a038db989963cf0e48f4454b6193fe7762a\": container with ID starting with da90e63744b1492e96bcdb87784e1a038db989963cf0e48f4454b6193fe7762a not found: ID does not exist" containerID="da90e63744b1492e96bcdb87784e1a038db989963cf0e48f4454b6193fe7762a"
Aug 04 18:48:50.694024 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.693987    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da90e63744b1492e96bcdb87784e1a038db989963cf0e48f4454b6193fe7762a"} err="failed to get container status \"da90e63744b1492e96bcdb87784e1a038db989963cf0e48f4454b6193fe7762a\": rpc error: code = NotFound desc = could not find container \"da90e63744b1492e96bcdb87784e1a038db989963cf0e48f4454b6193fe7762a\": container with ID starting with da90e63744b1492e96bcdb87784e1a038db989963cf0e48f4454b6193fe7762a not found: ID does not exist"
Aug 04 18:48:50.783754 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.783731    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f61bc135-2071-4df2-ac94-1889286d9545-istio-data\") pod \"f61bc135-2071-4df2-ac94-1889286d9545\" (UID: \"f61bc135-2071-4df2-ac94-1889286d9545\") "
Aug 04 18:48:50.783857 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.783787    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f61bc135-2071-4df2-ac94-1889286d9545-istio-podinfo\") pod \"f61bc135-2071-4df2-ac94-1889286d9545\" (UID: \"f61bc135-2071-4df2-ac94-1889286d9545\") "
Aug 04 18:48:50.783857 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.783821    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f61bc135-2071-4df2-ac94-1889286d9545-credential-socket\") pod \"f61bc135-2071-4df2-ac94-1889286d9545\" (UID: \"f61bc135-2071-4df2-ac94-1889286d9545\") "
Aug 04 18:48:50.783976 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.783858    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f61bc135-2071-4df2-ac94-1889286d9545-workload-socket\") pod \"f61bc135-2071-4df2-ac94-1889286d9545\" (UID: \"f61bc135-2071-4df2-ac94-1889286d9545\") "
Aug 04 18:48:50.783976 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.783884    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f61bc135-2071-4df2-ac94-1889286d9545-istiod-ca-cert\") pod \"f61bc135-2071-4df2-ac94-1889286d9545\" (UID: \"f61bc135-2071-4df2-ac94-1889286d9545\") "
Aug 04 18:48:50.783976 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.783910    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f61bc135-2071-4df2-ac94-1889286d9545-workload-certs\") pod \"f61bc135-2071-4df2-ac94-1889286d9545\" (UID: \"f61bc135-2071-4df2-ac94-1889286d9545\") "
Aug 04 18:48:50.783976 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.783950    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f61bc135-2071-4df2-ac94-1889286d9545-istio-envoy\") pod \"f61bc135-2071-4df2-ac94-1889286d9545\" (UID: \"f61bc135-2071-4df2-ac94-1889286d9545\") "
Aug 04 18:48:50.784127 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.783978    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f61bc135-2071-4df2-ac94-1889286d9545-istio-data" (OuterVolumeSpecName: "istio-data") pod "f61bc135-2071-4df2-ac94-1889286d9545" (UID: "f61bc135-2071-4df2-ac94-1889286d9545"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:48:50.784127 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.783984    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxzh2\" (UniqueName: \"kubernetes.io/projected/f61bc135-2071-4df2-ac94-1889286d9545-kube-api-access-zxzh2\") pod \"f61bc135-2071-4df2-ac94-1889286d9545\" (UID: \"f61bc135-2071-4df2-ac94-1889286d9545\") "
Aug 04 18:48:50.784127 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.784056    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f61bc135-2071-4df2-ac94-1889286d9545-istio-token\") pod \"f61bc135-2071-4df2-ac94-1889286d9545\" (UID: \"f61bc135-2071-4df2-ac94-1889286d9545\") "
Aug 04 18:48:50.784127 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.784087    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f61bc135-2071-4df2-ac94-1889286d9545-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f61bc135-2071-4df2-ac94-1889286d9545" (UID: "f61bc135-2071-4df2-ac94-1889286d9545"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:48:50.784127 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.784112    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f61bc135-2071-4df2-ac94-1889286d9545-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f61bc135-2071-4df2-ac94-1889286d9545" (UID: "f61bc135-2071-4df2-ac94-1889286d9545"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:48:50.784381 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.784291    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f61bc135-2071-4df2-ac94-1889286d9545-istio-data\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:48:50.784381 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.784309    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f61bc135-2071-4df2-ac94-1889286d9545-credential-socket\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:48:50.784381 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.784322    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f61bc135-2071-4df2-ac94-1889286d9545-workload-socket\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:48:50.784381 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.784371    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f61bc135-2071-4df2-ac94-1889286d9545-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f61bc135-2071-4df2-ac94-1889286d9545" (UID: "f61bc135-2071-4df2-ac94-1889286d9545"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:48:50.784639 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.784296    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f61bc135-2071-4df2-ac94-1889286d9545-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f61bc135-2071-4df2-ac94-1889286d9545" (UID: "f61bc135-2071-4df2-ac94-1889286d9545"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:48:50.785859 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.785828    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f61bc135-2071-4df2-ac94-1889286d9545-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f61bc135-2071-4df2-ac94-1889286d9545" (UID: "f61bc135-2071-4df2-ac94-1889286d9545"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 18:48:50.785979 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.785939    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f61bc135-2071-4df2-ac94-1889286d9545-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f61bc135-2071-4df2-ac94-1889286d9545" (UID: "f61bc135-2071-4df2-ac94-1889286d9545"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:48:50.786064 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.786050    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f61bc135-2071-4df2-ac94-1889286d9545-istio-token" (OuterVolumeSpecName: "istio-token") pod "f61bc135-2071-4df2-ac94-1889286d9545" (UID: "f61bc135-2071-4df2-ac94-1889286d9545"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:48:50.786179 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.786158    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f61bc135-2071-4df2-ac94-1889286d9545-kube-api-access-zxzh2" (OuterVolumeSpecName: "kube-api-access-zxzh2") pod "f61bc135-2071-4df2-ac94-1889286d9545" (UID: "f61bc135-2071-4df2-ac94-1889286d9545"). InnerVolumeSpecName "kube-api-access-zxzh2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:48:50.884913 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.884894    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f61bc135-2071-4df2-ac94-1889286d9545-istiod-ca-cert\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:48:50.884913 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.884914    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f61bc135-2071-4df2-ac94-1889286d9545-workload-certs\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:48:50.885037 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.884923    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f61bc135-2071-4df2-ac94-1889286d9545-istio-envoy\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:48:50.885037 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.884931    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxzh2\" (UniqueName: \"kubernetes.io/projected/f61bc135-2071-4df2-ac94-1889286d9545-kube-api-access-zxzh2\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:48:50.885037 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.884940    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f61bc135-2071-4df2-ac94-1889286d9545-istio-token\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:48:50.885037 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.884948    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f61bc135-2071-4df2-ac94-1889286d9545-istio-podinfo\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:48:50.997582 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:50.997558    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"]
Aug 04 18:48:51.001216 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:51.001195    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-e72e63-openshift-default-6496f4474-nxc7c"]
Aug 04 18:48:51.879246 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:48:51.879218    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f61bc135-2071-4df2-ac94-1889286d9545" path="/var/lib/kubelet/pods/f61bc135-2071-4df2-ac94-1889286d9545/volumes"
Aug 04 18:49:02.752905 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:02.752874    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"]
Aug 04 18:49:02.753374 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:02.753126    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb" podUID="3f525e0a-270c-4ef2-94a0-f2519ab1d6f8" containerName="istio-proxy" containerID="cri-o://83c19287abffda5c04c855f5e9dfce596fd0cfd89ff5c2f871b44056b87f213b" gracePeriod=30
Aug 04 18:49:07.996510 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:07.996485    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:49:08.103608 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.103587    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-credential-socket\") pod \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\" (UID: \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\") "
Aug 04 18:49:08.103733 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.103634    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtj7m\" (UniqueName: \"kubernetes.io/projected/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-kube-api-access-jtj7m\") pod \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\" (UID: \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\") "
Aug 04 18:49:08.103733 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.103656    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-istio-envoy\") pod \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\" (UID: \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\") "
Aug 04 18:49:08.103733 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.103692    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-workload-certs\") pod \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\" (UID: \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\") "
Aug 04 18:49:08.103733 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.103721    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-istiod-ca-cert\") pod \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\" (UID: \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\") "
Aug 04 18:49:08.103932 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.103755    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-istio-data\") pod \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\" (UID: \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\") "
Aug 04 18:49:08.103932 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.103778    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-istio-token\") pod \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\" (UID: \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\") "
Aug 04 18:49:08.103932 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.103844    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3f525e0a-270c-4ef2-94a0-f2519ab1d6f8" (UID: "3f525e0a-270c-4ef2-94a0-f2519ab1d6f8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:49:08.103932 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.103860    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-workload-socket\") pod \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\" (UID: \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\") "
Aug 04 18:49:08.103932 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.103886    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-istio-podinfo\") pod \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\" (UID: \"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8\") "
Aug 04 18:49:08.104208 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.104035    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3f525e0a-270c-4ef2-94a0-f2519ab1d6f8" (UID: "3f525e0a-270c-4ef2-94a0-f2519ab1d6f8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:49:08.104208 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.104043    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-istio-data" (OuterVolumeSpecName: "istio-data") pod "3f525e0a-270c-4ef2-94a0-f2519ab1d6f8" (UID: "3f525e0a-270c-4ef2-94a0-f2519ab1d6f8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:49:08.104208 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.104130    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3f525e0a-270c-4ef2-94a0-f2519ab1d6f8" (UID: "3f525e0a-270c-4ef2-94a0-f2519ab1d6f8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:49:08.104373 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.104238    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3f525e0a-270c-4ef2-94a0-f2519ab1d6f8" (UID: "3f525e0a-270c-4ef2-94a0-f2519ab1d6f8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:49:08.104373 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.104299    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-workload-socket\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:49:08.104373 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.104318    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-credential-socket\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:49:08.104373 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.104331    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-workload-certs\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:49:08.104373 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.104339    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-istiod-ca-cert\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:49:08.104373 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.104347    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-istio-data\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:49:08.105892 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.105860    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-istio-token" (OuterVolumeSpecName: "istio-token") pod "3f525e0a-270c-4ef2-94a0-f2519ab1d6f8" (UID: "3f525e0a-270c-4ef2-94a0-f2519ab1d6f8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:49:08.105991 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.105961    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3f525e0a-270c-4ef2-94a0-f2519ab1d6f8" (UID: "3f525e0a-270c-4ef2-94a0-f2519ab1d6f8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:49:08.106253 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.106232    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3f525e0a-270c-4ef2-94a0-f2519ab1d6f8" (UID: "3f525e0a-270c-4ef2-94a0-f2519ab1d6f8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 18:49:08.106297 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.106247    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-kube-api-access-jtj7m" (OuterVolumeSpecName: "kube-api-access-jtj7m") pod "3f525e0a-270c-4ef2-94a0-f2519ab1d6f8" (UID: "3f525e0a-270c-4ef2-94a0-f2519ab1d6f8"). InnerVolumeSpecName "kube-api-access-jtj7m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:49:08.204695 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.204674    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-istio-token\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:49:08.204695 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.204693    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-istio-podinfo\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:49:08.204819 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.204702    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtj7m\" (UniqueName: \"kubernetes.io/projected/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-kube-api-access-jtj7m\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:49:08.204819 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.204712    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8-istio-envoy\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:49:08.756320 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.756296    2571 generic.go:356] "Generic (PLEG): container finished" podID="3f525e0a-270c-4ef2-94a0-f2519ab1d6f8" containerID="83c19287abffda5c04c855f5e9dfce596fd0cfd89ff5c2f871b44056b87f213b" exitCode=0
Aug 04 18:49:08.756426 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.756336    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb" event={"ID":"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8","Type":"ContainerDied","Data":"83c19287abffda5c04c855f5e9dfce596fd0cfd89ff5c2f871b44056b87f213b"}
Aug 04 18:49:08.756426 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.756345    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"
Aug 04 18:49:08.756426 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.756378    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb" event={"ID":"3f525e0a-270c-4ef2-94a0-f2519ab1d6f8","Type":"ContainerDied","Data":"e781752295ea606f12b3e9047d156530afeb10672ce02ffc756b853097ed5a03"}
Aug 04 18:49:08.756426 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.756399    2571 scope.go:117] "RemoveContainer" containerID="83c19287abffda5c04c855f5e9dfce596fd0cfd89ff5c2f871b44056b87f213b"
Aug 04 18:49:08.765196 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.765182    2571 scope.go:117] "RemoveContainer" containerID="6f7a13b1ca9d79065046002306b7c396408a146ffc25ca58ac3b9758f6c8bb3e"
Aug 04 18:49:08.772283 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.772267    2571 scope.go:117] "RemoveContainer" containerID="83c19287abffda5c04c855f5e9dfce596fd0cfd89ff5c2f871b44056b87f213b"
Aug 04 18:49:08.772533 ip-10-0-141-220 kubenswrapper[2571]: E0804 18:49:08.772503    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83c19287abffda5c04c855f5e9dfce596fd0cfd89ff5c2f871b44056b87f213b\": container with ID starting with 83c19287abffda5c04c855f5e9dfce596fd0cfd89ff5c2f871b44056b87f213b not found: ID does not exist" containerID="83c19287abffda5c04c855f5e9dfce596fd0cfd89ff5c2f871b44056b87f213b"
Aug 04 18:49:08.772599 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.772546    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83c19287abffda5c04c855f5e9dfce596fd0cfd89ff5c2f871b44056b87f213b"} err="failed to get container status \"83c19287abffda5c04c855f5e9dfce596fd0cfd89ff5c2f871b44056b87f213b\": rpc error: code = NotFound desc = could not find container \"83c19287abffda5c04c855f5e9dfce596fd0cfd89ff5c2f871b44056b87f213b\": container with ID starting with 83c19287abffda5c04c855f5e9dfce596fd0cfd89ff5c2f871b44056b87f213b not found: ID does not exist"
Aug 04 18:49:08.772599 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.772569    2571 scope.go:117] "RemoveContainer" containerID="6f7a13b1ca9d79065046002306b7c396408a146ffc25ca58ac3b9758f6c8bb3e"
Aug 04 18:49:08.772821 ip-10-0-141-220 kubenswrapper[2571]: E0804 18:49:08.772802    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f7a13b1ca9d79065046002306b7c396408a146ffc25ca58ac3b9758f6c8bb3e\": container with ID starting with 6f7a13b1ca9d79065046002306b7c396408a146ffc25ca58ac3b9758f6c8bb3e not found: ID does not exist" containerID="6f7a13b1ca9d79065046002306b7c396408a146ffc25ca58ac3b9758f6c8bb3e"
Aug 04 18:49:08.772865 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.772827    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f7a13b1ca9d79065046002306b7c396408a146ffc25ca58ac3b9758f6c8bb3e"} err="failed to get container status \"6f7a13b1ca9d79065046002306b7c396408a146ffc25ca58ac3b9758f6c8bb3e\": rpc error: code = NotFound desc = could not find container \"6f7a13b1ca9d79065046002306b7c396408a146ffc25ca58ac3b9758f6c8bb3e\": container with ID starting with 6f7a13b1ca9d79065046002306b7c396408a146ffc25ca58ac3b9758f6c8bb3e not found: ID does not exist"
Aug 04 18:49:08.776599 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.776578    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"]
Aug 04 18:49:08.781014 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:08.780996    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-c7bd98-openshift-default-6795dd5ccd-phhjb"]
Aug 04 18:49:09.880664 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:09.880628    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f525e0a-270c-4ef2-94a0-f2519ab1d6f8" path="/var/lib/kubelet/pods/3f525e0a-270c-4ef2-94a0-f2519ab1d6f8/volumes"
Aug 04 18:49:20.559789 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:20.559705    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"]
Aug 04 18:49:20.560302 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:20.559920    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx" podUID="41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8" containerName="istio-proxy" containerID="cri-o://84a220148effc9d966158322b792040bb9ece01db796ce2f14417e545cfbf892" gracePeriod=30
Aug 04 18:49:23.946299 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:23.946267    2571 patch_prober.go:28] interesting pod/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 18:49:23.946655 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:23.946320    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx" podUID="41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:49:25.807944 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:25.807917    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:49:25.834368 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:25.834313    2571 generic.go:356] "Generic (PLEG): container finished" podID="41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8" containerID="84a220148effc9d966158322b792040bb9ece01db796ce2f14417e545cfbf892" exitCode=0
Aug 04 18:49:25.834368 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:25.834351    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx" event={"ID":"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8","Type":"ContainerDied","Data":"84a220148effc9d966158322b792040bb9ece01db796ce2f14417e545cfbf892"}
Aug 04 18:49:25.834510 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:25.834365    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"
Aug 04 18:49:25.834510 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:25.834414    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx" event={"ID":"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8","Type":"ContainerDied","Data":"d89e59416c33671a1139663e3bc8394576e9aae3850d93c60db3650a5a73c89e"}
Aug 04 18:49:25.834510 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:25.834436    2571 scope.go:117] "RemoveContainer" containerID="84a220148effc9d966158322b792040bb9ece01db796ce2f14417e545cfbf892"
Aug 04 18:49:25.842090 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:25.842071    2571 scope.go:117] "RemoveContainer" containerID="2163d12bd2bebb1def50dec5e3d4e4217be72941bae52cbba02de3df19cd5e23"
Aug 04 18:49:25.849398 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:25.849383    2571 scope.go:117] "RemoveContainer" containerID="84a220148effc9d966158322b792040bb9ece01db796ce2f14417e545cfbf892"
Aug 04 18:49:25.849679 ip-10-0-141-220 kubenswrapper[2571]: E0804 18:49:25.849654    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84a220148effc9d966158322b792040bb9ece01db796ce2f14417e545cfbf892\": container with ID starting with 84a220148effc9d966158322b792040bb9ece01db796ce2f14417e545cfbf892 not found: ID does not exist" containerID="84a220148effc9d966158322b792040bb9ece01db796ce2f14417e545cfbf892"
Aug 04 18:49:25.849749 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:25.849694    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84a220148effc9d966158322b792040bb9ece01db796ce2f14417e545cfbf892"} err="failed to get container status \"84a220148effc9d966158322b792040bb9ece01db796ce2f14417e545cfbf892\": rpc error: code = NotFound desc = could not find container \"84a220148effc9d966158322b792040bb9ece01db796ce2f14417e545cfbf892\": container with ID starting with 84a220148effc9d966158322b792040bb9ece01db796ce2f14417e545cfbf892 not found: ID does not exist"
Aug 04 18:49:25.849749 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:25.849710    2571 scope.go:117] "RemoveContainer" containerID="2163d12bd2bebb1def50dec5e3d4e4217be72941bae52cbba02de3df19cd5e23"
Aug 04 18:49:25.849983 ip-10-0-141-220 kubenswrapper[2571]: E0804 18:49:25.849967    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2163d12bd2bebb1def50dec5e3d4e4217be72941bae52cbba02de3df19cd5e23\": container with ID starting with 2163d12bd2bebb1def50dec5e3d4e4217be72941bae52cbba02de3df19cd5e23 not found: ID does not exist" containerID="2163d12bd2bebb1def50dec5e3d4e4217be72941bae52cbba02de3df19cd5e23"
Aug 04 18:49:25.850032 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:25.849986    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2163d12bd2bebb1def50dec5e3d4e4217be72941bae52cbba02de3df19cd5e23"} err="failed to get container status \"2163d12bd2bebb1def50dec5e3d4e4217be72941bae52cbba02de3df19cd5e23\": rpc error: code = NotFound desc = could not find container \"2163d12bd2bebb1def50dec5e3d4e4217be72941bae52cbba02de3df19cd5e23\": container with ID starting with 2163d12bd2bebb1def50dec5e3d4e4217be72941bae52cbba02de3df19cd5e23 not found: ID does not exist"
Aug 04 18:49:25.943555 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:25.943515    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-istiod-ca-cert\") pod \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\" (UID: \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\") "
Aug 04 18:49:25.943642 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:25.943565    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-credential-socket\") pod \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\" (UID: \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\") "
Aug 04 18:49:25.943642 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:25.943586    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-istio-token\") pod \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\" (UID: \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\") "
Aug 04 18:49:25.943642 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:25.943617    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-istio-data\") pod \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\" (UID: \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\") "
Aug 04 18:49:25.943642 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:25.943636    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2vfn\" (UniqueName: \"kubernetes.io/projected/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-kube-api-access-g2vfn\") pod \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\" (UID: \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\") "
Aug 04 18:49:25.943895 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:25.943651    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-istio-envoy\") pod \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\" (UID: \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\") "
Aug 04 18:49:25.943895 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:25.943687    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-workload-socket\") pod \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\" (UID: \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\") "
Aug 04 18:49:25.943895 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:25.943725    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-istio-podinfo\") pod \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\" (UID: \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\") "
Aug 04 18:49:25.943895 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:25.943763    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-workload-certs\") pod \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\" (UID: \"41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8\") "
Aug 04 18:49:25.943895 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:25.943806    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8" (UID: "41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:49:25.943895 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:25.943880    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8" (UID: "41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:49:25.944220 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:25.944059    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8" (UID: "41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:49:25.944220 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:25.944073    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-istio-data" (OuterVolumeSpecName: "istio-data") pod "41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8" (UID: "41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:49:25.944220 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:25.944115    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8" (UID: "41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:49:25.944220 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:25.944185    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-istio-data\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:49:25.944220 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:25.944197    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-workload-socket\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:49:25.944220 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:25.944208    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-workload-certs\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:49:25.944220 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:25.944220    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-istiod-ca-cert\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:49:25.944636 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:25.944233    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-credential-socket\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:49:25.945843 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:25.945817    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-istio-token" (OuterVolumeSpecName: "istio-token") pod "41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8" (UID: "41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:49:25.945930 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:25.945815    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8" (UID: "41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:49:25.946112 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:25.946095    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8" (UID: "41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 18:49:25.946174 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:25.946116    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-kube-api-access-g2vfn" (OuterVolumeSpecName: "kube-api-access-g2vfn") pod "41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8" (UID: "41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8"). InnerVolumeSpecName "kube-api-access-g2vfn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:49:26.045376 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:26.045355    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-istio-token\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:49:26.045458 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:26.045385    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2vfn\" (UniqueName: \"kubernetes.io/projected/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-kube-api-access-g2vfn\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:49:26.045458 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:26.045395    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-istio-envoy\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:49:26.045458 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:26.045405    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8-istio-podinfo\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:49:26.154492 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:26.154469    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"]
Aug 04 18:49:26.158467 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:26.158444    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-4659f1-openshift-default-77b7f6bd88-mksrx"]
Aug 04 18:49:27.878435 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:27.878403    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8" path="/var/lib/kubelet/pods/41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8/volumes"
Aug 04 18:49:38.005331 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:38.005295    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"]
Aug 04 18:49:38.005830 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:38.005533    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl" podUID="7a721af7-bd0f-4a60-afc9-e1390b4c4c65" containerName="istio-proxy" containerID="cri-o://c8a1944b0a86bc1c556a4bc300f6bd31c0ce07f9ee8403cfc3e3067869e55644" gracePeriod=30
Aug 04 18:49:38.707961 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:38.707927    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-66c6fcbcc8-l5qfb_67772a4e-1731-433d-9ad0-50073afd3f25/authorino/0.log"
Aug 04 18:49:43.243974 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.243952    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:49:43.361354 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.361331    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-credential-socket\") pod \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\" (UID: \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\") "
Aug 04 18:49:43.361494 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.361358    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-workload-socket\") pod \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\" (UID: \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\") "
Aug 04 18:49:43.361494 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.361381    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-workload-certs\") pod \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\" (UID: \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\") "
Aug 04 18:49:43.361494 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.361407    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-istio-podinfo\") pod \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\" (UID: \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\") "
Aug 04 18:49:43.361494 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.361440    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-istio-token\") pod \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\" (UID: \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\") "
Aug 04 18:49:43.361494 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.361479    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-istio-data\") pod \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\" (UID: \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\") "
Aug 04 18:49:43.361811 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.361644    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-istiod-ca-cert\") pod \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\" (UID: \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\") "
Aug 04 18:49:43.361811 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.361697    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gm58x\" (UniqueName: \"kubernetes.io/projected/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-kube-api-access-gm58x\") pod \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\" (UID: \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\") "
Aug 04 18:49:43.361811 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.361644    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7a721af7-bd0f-4a60-afc9-e1390b4c4c65" (UID: "7a721af7-bd0f-4a60-afc9-e1390b4c4c65"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:49:43.361811 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.361699    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7a721af7-bd0f-4a60-afc9-e1390b4c4c65" (UID: "7a721af7-bd0f-4a60-afc9-e1390b4c4c65"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:49:43.361811 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.361704    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7a721af7-bd0f-4a60-afc9-e1390b4c4c65" (UID: "7a721af7-bd0f-4a60-afc9-e1390b4c4c65"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:49:43.361811 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.361758    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-istio-envoy\") pod \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\" (UID: \"7a721af7-bd0f-4a60-afc9-e1390b4c4c65\") "
Aug 04 18:49:43.361811 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.361796    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-istio-data" (OuterVolumeSpecName: "istio-data") pod "7a721af7-bd0f-4a60-afc9-e1390b4c4c65" (UID: "7a721af7-bd0f-4a60-afc9-e1390b4c4c65"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:49:43.362126 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.361972    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-credential-socket\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:49:43.362126 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.361986    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-workload-socket\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:49:43.362126 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.362002    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-workload-certs\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:49:43.362126 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.362020    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-istio-data\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:49:43.362126 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.361980    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7a721af7-bd0f-4a60-afc9-e1390b4c4c65" (UID: "7a721af7-bd0f-4a60-afc9-e1390b4c4c65"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:49:43.363710 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.363686    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-kube-api-access-gm58x" (OuterVolumeSpecName: "kube-api-access-gm58x") pod "7a721af7-bd0f-4a60-afc9-e1390b4c4c65" (UID: "7a721af7-bd0f-4a60-afc9-e1390b4c4c65"). InnerVolumeSpecName "kube-api-access-gm58x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:49:43.363839 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.363739    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7a721af7-bd0f-4a60-afc9-e1390b4c4c65" (UID: "7a721af7-bd0f-4a60-afc9-e1390b4c4c65"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:49:43.364094 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.364071    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-istio-token" (OuterVolumeSpecName: "istio-token") pod "7a721af7-bd0f-4a60-afc9-e1390b4c4c65" (UID: "7a721af7-bd0f-4a60-afc9-e1390b4c4c65"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:49:43.364094 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.364077    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7a721af7-bd0f-4a60-afc9-e1390b4c4c65" (UID: "7a721af7-bd0f-4a60-afc9-e1390b4c4c65"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 18:49:43.462556 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.462517    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-istiod-ca-cert\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:49:43.462641 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.462556    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gm58x\" (UniqueName: \"kubernetes.io/projected/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-kube-api-access-gm58x\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:49:43.462641 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.462568    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-istio-envoy\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:49:43.462641 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.462576    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-istio-podinfo\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:49:43.462641 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.462584    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a721af7-bd0f-4a60-afc9-e1390b4c4c65-istio-token\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Aug 04 18:49:43.910815 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.910794    2571 generic.go:356] "Generic (PLEG): container finished" podID="7a721af7-bd0f-4a60-afc9-e1390b4c4c65" containerID="c8a1944b0a86bc1c556a4bc300f6bd31c0ce07f9ee8403cfc3e3067869e55644" exitCode=0
Aug 04 18:49:43.910909 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.910832    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"
Aug 04 18:49:43.910909 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.910878    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl" event={"ID":"7a721af7-bd0f-4a60-afc9-e1390b4c4c65","Type":"ContainerDied","Data":"c8a1944b0a86bc1c556a4bc300f6bd31c0ce07f9ee8403cfc3e3067869e55644"}
Aug 04 18:49:43.910991 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.910919    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl" event={"ID":"7a721af7-bd0f-4a60-afc9-e1390b4c4c65","Type":"ContainerDied","Data":"69438eb49ce6a94c05037608f954cf5d0fd631ef833c31eda455bc8c21b7f27d"}
Aug 04 18:49:43.910991 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.910949    2571 scope.go:117] "RemoveContainer" containerID="c8a1944b0a86bc1c556a4bc300f6bd31c0ce07f9ee8403cfc3e3067869e55644"
Aug 04 18:49:43.919007 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.918990    2571 scope.go:117] "RemoveContainer" containerID="e09862795c67cf7c79c09f3a8ed5033828706c8c7dd57e437ee0a9347ee97d78"
Aug 04 18:49:43.926345 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.926326    2571 scope.go:117] "RemoveContainer" containerID="c8a1944b0a86bc1c556a4bc300f6bd31c0ce07f9ee8403cfc3e3067869e55644"
Aug 04 18:49:43.926643 ip-10-0-141-220 kubenswrapper[2571]: E0804 18:49:43.926619    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8a1944b0a86bc1c556a4bc300f6bd31c0ce07f9ee8403cfc3e3067869e55644\": container with ID starting with c8a1944b0a86bc1c556a4bc300f6bd31c0ce07f9ee8403cfc3e3067869e55644 not found: ID does not exist" containerID="c8a1944b0a86bc1c556a4bc300f6bd31c0ce07f9ee8403cfc3e3067869e55644"
Aug 04 18:49:43.926722 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.926648    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8a1944b0a86bc1c556a4bc300f6bd31c0ce07f9ee8403cfc3e3067869e55644"} err="failed to get container status \"c8a1944b0a86bc1c556a4bc300f6bd31c0ce07f9ee8403cfc3e3067869e55644\": rpc error: code = NotFound desc = could not find container \"c8a1944b0a86bc1c556a4bc300f6bd31c0ce07f9ee8403cfc3e3067869e55644\": container with ID starting with c8a1944b0a86bc1c556a4bc300f6bd31c0ce07f9ee8403cfc3e3067869e55644 not found: ID does not exist"
Aug 04 18:49:43.926722 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.926665    2571 scope.go:117] "RemoveContainer" containerID="e09862795c67cf7c79c09f3a8ed5033828706c8c7dd57e437ee0a9347ee97d78"
Aug 04 18:49:43.926918 ip-10-0-141-220 kubenswrapper[2571]: E0804 18:49:43.926899    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e09862795c67cf7c79c09f3a8ed5033828706c8c7dd57e437ee0a9347ee97d78\": container with ID starting with e09862795c67cf7c79c09f3a8ed5033828706c8c7dd57e437ee0a9347ee97d78 not found: ID does not exist" containerID="e09862795c67cf7c79c09f3a8ed5033828706c8c7dd57e437ee0a9347ee97d78"
Aug 04 18:49:43.926964 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.926923    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e09862795c67cf7c79c09f3a8ed5033828706c8c7dd57e437ee0a9347ee97d78"} err="failed to get container status \"e09862795c67cf7c79c09f3a8ed5033828706c8c7dd57e437ee0a9347ee97d78\": rpc error: code = NotFound desc = could not find container \"e09862795c67cf7c79c09f3a8ed5033828706c8c7dd57e437ee0a9347ee97d78\": container with ID starting with e09862795c67cf7c79c09f3a8ed5033828706c8c7dd57e437ee0a9347ee97d78 not found: ID does not exist"
Aug 04 18:49:43.927765 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.927746    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"]
Aug 04 18:49:43.932296 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:43.932276    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-e9be3f-openshift-default-58f7fd4bbd-gj6wl"]
Aug 04 18:49:44.585649 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:44.585621    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-mt7x5_d73003bb-823c-445a-a591-007b9f1f9ca9/manager/0.log"
Aug 04 18:49:44.817350 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:44.817328    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cddfbf4d9-wmlpw_ccbeea1c-9e31-4224-aeee-546b2ea781cd/copy-manifests/0.log"
Aug 04 18:49:44.823012 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:44.822995    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cddfbf4d9-wmlpw_ccbeea1c-9e31-4224-aeee-546b2ea781cd/manager/0.log"
Aug 04 18:49:45.389496 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:45.389473    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29764455-r6g5c_53fd64dd-dfcf-49d6-92ef-71d6fa298645/cleanup/0.log"
Aug 04 18:49:45.509782 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:45.509762    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29764470-gnn2h_04bb1a44-d38f-456a-98a2-08c09bd0da33/cleanup/0.log"
Aug 04 18:49:45.878872 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:45.878851    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a721af7-bd0f-4a60-afc9-e1390b4c4c65" path="/var/lib/kubelet/pods/7a721af7-bd0f-4a60-afc9-e1390b4c4c65/volumes"
Aug 04 18:49:46.470405 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:46.470384    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-66c6fcbcc8-l5qfb_67772a4e-1731-433d-9ad0-50073afd3f25/authorino/0.log"
Aug 04 18:49:47.495395 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:47.495368    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t_67403d95-d95b-429d-a77d-3ee880403375/istio-proxy/0.log"
Aug 04 18:49:47.734477 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:47.734453    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-99b5d7fdc-84grw_bcd30a0d-bc39-4769-9861-9e5f65d7edb4/kube-auth-proxy/0.log"
Aug 04 18:49:47.969649 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:47.969628    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-62kpw_fa5b1c34-ce88-4f98-9466-80eee08573f5/istio-proxy/1.log"
Aug 04 18:49:49.223367 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:49.223342    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-vwb8k_268d2541-5ec5-414d-b98a-6ed5a0975177/main/0.log"
Aug 04 18:49:59.085490 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:59.085459    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pm47l_175017d4-1fb6-4129-b96f-4990959c3a8b/global-pull-secret-syncer/0.log"
Aug 04 18:49:59.208442 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:59.208414    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xq7xp_59068cff-9e8e-4aa6-af07-d08f484171e9/konnectivity-agent/0.log"
Aug 04 18:49:59.324437 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:49:59.324413    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-220.ec2.internal_38e66965b8a5bfd304ca9eefbb3544fa/haproxy/0.log"
Aug 04 18:50:03.601477 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:03.601449    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-66c6fcbcc8-l5qfb_67772a4e-1731-433d-9ad0-50073afd3f25/authorino/0.log"
Aug 04 18:50:05.758792 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:05.758765    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8zzxs_229e973e-d1c0-4114-8d67-5d65a7688217/node-exporter/0.log"
Aug 04 18:50:05.786795 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:05.786774    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8zzxs_229e973e-d1c0-4114-8d67-5d65a7688217/kube-rbac-proxy/0.log"
Aug 04 18:50:05.802208 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:05.802193    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8zzxs_229e973e-d1c0-4114-8d67-5d65a7688217/init-textfile/0.log"
Aug 04 18:50:07.919022 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:07.918986    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-f77f48c6d-5z7qg_cb892edb-7af7-4903-9178-4d1070e50a4f/networking-console-plugin/0.log"
Aug 04 18:50:09.510142 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.510109    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8lbkp/perf-node-gather-daemonset-pf5v4"]
Aug 04 18:50:09.510504 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.510355    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b41bbc9-7cf3-49fe-a8f0-e911de31a0af" containerName="main"
Aug 04 18:50:09.510504 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.510366    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b41bbc9-7cf3-49fe-a8f0-e911de31a0af" containerName="main"
Aug 04 18:50:09.510504 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.510376    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8" containerName="istio-proxy"
Aug 04 18:50:09.510504 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.510382    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8" containerName="istio-proxy"
Aug 04 18:50:09.510504 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.510387    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f525e0a-270c-4ef2-94a0-f2519ab1d6f8" containerName="istio-proxy"
Aug 04 18:50:09.510504 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.510393    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f525e0a-270c-4ef2-94a0-f2519ab1d6f8" containerName="istio-proxy"
Aug 04 18:50:09.510504 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.510406    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a721af7-bd0f-4a60-afc9-e1390b4c4c65" containerName="istio-proxy"
Aug 04 18:50:09.510504 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.510411    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a721af7-bd0f-4a60-afc9-e1390b4c4c65" containerName="istio-proxy"
Aug 04 18:50:09.510504 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.510417    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f61bc135-2071-4df2-ac94-1889286d9545" containerName="istio-proxy"
Aug 04 18:50:09.510504 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.510422    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f61bc135-2071-4df2-ac94-1889286d9545" containerName="istio-proxy"
Aug 04 18:50:09.510504 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.510430    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f61bc135-2071-4df2-ac94-1889286d9545" containerName="istio-proxy"
Aug 04 18:50:09.510504 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.510434    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f61bc135-2071-4df2-ac94-1889286d9545" containerName="istio-proxy"
Aug 04 18:50:09.510504 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.510481    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f61bc135-2071-4df2-ac94-1889286d9545" containerName="istio-proxy"
Aug 04 18:50:09.510504 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.510488    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a721af7-bd0f-4a60-afc9-e1390b4c4c65" containerName="istio-proxy"
Aug 04 18:50:09.510504 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.510493    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f525e0a-270c-4ef2-94a0-f2519ab1d6f8" containerName="istio-proxy"
Aug 04 18:50:09.510504 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.510500    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="41fbed05-4340-4aa4-b0a9-3ab6c0fe5fc8" containerName="istio-proxy"
Aug 04 18:50:09.510504 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.510506    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a721af7-bd0f-4a60-afc9-e1390b4c4c65" containerName="istio-proxy"
Aug 04 18:50:09.510504 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.510513    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b41bbc9-7cf3-49fe-a8f0-e911de31a0af" containerName="main"
Aug 04 18:50:09.514947 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.514928    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-pf5v4"
Aug 04 18:50:09.517207 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.517190    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8lbkp\"/\"kube-root-ca.crt\""
Aug 04 18:50:09.517529 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.517504    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8lbkp\"/\"openshift-service-ca.crt\""
Aug 04 18:50:09.518108 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.518094    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8lbkp\"/\"default-dockercfg-4g7qg\""
Aug 04 18:50:09.521934 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.521780    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8lbkp/perf-node-gather-daemonset-pf5v4"]
Aug 04 18:50:09.543409 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.543388    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bf6w\" (UniqueName: \"kubernetes.io/projected/ac859c26-1b0b-46f8-afc7-9db4be59f30c-kube-api-access-6bf6w\") pod \"perf-node-gather-daemonset-pf5v4\" (UID: \"ac859c26-1b0b-46f8-afc7-9db4be59f30c\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-pf5v4"
Aug 04 18:50:09.543501 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.543422    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac859c26-1b0b-46f8-afc7-9db4be59f30c-lib-modules\") pod \"perf-node-gather-daemonset-pf5v4\" (UID: \"ac859c26-1b0b-46f8-afc7-9db4be59f30c\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-pf5v4"
Aug 04 18:50:09.543501 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.543444    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac859c26-1b0b-46f8-afc7-9db4be59f30c-proc\") pod \"perf-node-gather-daemonset-pf5v4\" (UID: \"ac859c26-1b0b-46f8-afc7-9db4be59f30c\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-pf5v4"
Aug 04 18:50:09.543603 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.543506    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac859c26-1b0b-46f8-afc7-9db4be59f30c-sys\") pod \"perf-node-gather-daemonset-pf5v4\" (UID: \"ac859c26-1b0b-46f8-afc7-9db4be59f30c\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-pf5v4"
Aug 04 18:50:09.543603 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.543584    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac859c26-1b0b-46f8-afc7-9db4be59f30c-podres\") pod \"perf-node-gather-daemonset-pf5v4\" (UID: \"ac859c26-1b0b-46f8-afc7-9db4be59f30c\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-pf5v4"
Aug 04 18:50:09.643996 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.643974    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac859c26-1b0b-46f8-afc7-9db4be59f30c-podres\") pod \"perf-node-gather-daemonset-pf5v4\" (UID: \"ac859c26-1b0b-46f8-afc7-9db4be59f30c\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-pf5v4"
Aug 04 18:50:09.644094 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.644001    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bf6w\" (UniqueName: \"kubernetes.io/projected/ac859c26-1b0b-46f8-afc7-9db4be59f30c-kube-api-access-6bf6w\") pod \"perf-node-gather-daemonset-pf5v4\" (UID: \"ac859c26-1b0b-46f8-afc7-9db4be59f30c\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-pf5v4"
Aug 04 18:50:09.644094 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.644024    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac859c26-1b0b-46f8-afc7-9db4be59f30c-lib-modules\") pod \"perf-node-gather-daemonset-pf5v4\" (UID: \"ac859c26-1b0b-46f8-afc7-9db4be59f30c\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-pf5v4"
Aug 04 18:50:09.644094 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.644042    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac859c26-1b0b-46f8-afc7-9db4be59f30c-proc\") pod \"perf-node-gather-daemonset-pf5v4\" (UID: \"ac859c26-1b0b-46f8-afc7-9db4be59f30c\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-pf5v4"
Aug 04 18:50:09.644094 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.644070    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac859c26-1b0b-46f8-afc7-9db4be59f30c-sys\") pod \"perf-node-gather-daemonset-pf5v4\" (UID: \"ac859c26-1b0b-46f8-afc7-9db4be59f30c\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-pf5v4"
Aug 04 18:50:09.644306 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.644130    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac859c26-1b0b-46f8-afc7-9db4be59f30c-podres\") pod \"perf-node-gather-daemonset-pf5v4\" (UID: \"ac859c26-1b0b-46f8-afc7-9db4be59f30c\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-pf5v4"
Aug 04 18:50:09.644306 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.644144    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac859c26-1b0b-46f8-afc7-9db4be59f30c-sys\") pod \"perf-node-gather-daemonset-pf5v4\" (UID: \"ac859c26-1b0b-46f8-afc7-9db4be59f30c\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-pf5v4"
Aug 04 18:50:09.644306 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.644133    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac859c26-1b0b-46f8-afc7-9db4be59f30c-proc\") pod \"perf-node-gather-daemonset-pf5v4\" (UID: \"ac859c26-1b0b-46f8-afc7-9db4be59f30c\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-pf5v4"
Aug 04 18:50:09.644306 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.644149    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac859c26-1b0b-46f8-afc7-9db4be59f30c-lib-modules\") pod \"perf-node-gather-daemonset-pf5v4\" (UID: \"ac859c26-1b0b-46f8-afc7-9db4be59f30c\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-pf5v4"
Aug 04 18:50:09.651024 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.651002    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bf6w\" (UniqueName: \"kubernetes.io/projected/ac859c26-1b0b-46f8-afc7-9db4be59f30c-kube-api-access-6bf6w\") pod \"perf-node-gather-daemonset-pf5v4\" (UID: \"ac859c26-1b0b-46f8-afc7-9db4be59f30c\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-pf5v4"
Aug 04 18:50:09.825975 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.825955    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-pf5v4"
Aug 04 18:50:09.954286 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:09.954260    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8lbkp/perf-node-gather-daemonset-pf5v4"]
Aug 04 18:50:09.955796 ip-10-0-141-220 kubenswrapper[2571]: W0804 18:50:09.955772    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podac859c26_1b0b_46f8_afc7_9db4be59f30c.slice/crio-a2d30140daad7d25d20464a843bf4dff14e465ebfc659b246b8025b9f08c33d1 WatchSource:0}: Error finding container a2d30140daad7d25d20464a843bf4dff14e465ebfc659b246b8025b9f08c33d1: Status 404 returned error can't find the container with id a2d30140daad7d25d20464a843bf4dff14e465ebfc659b246b8025b9f08c33d1
Aug 04 18:50:10.011795 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:10.011772    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-pf5v4" event={"ID":"ac859c26-1b0b-46f8-afc7-9db4be59f30c","Type":"ContainerStarted","Data":"a2d30140daad7d25d20464a843bf4dff14e465ebfc659b246b8025b9f08c33d1"}
Aug 04 18:50:11.017873 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:11.017844    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-pf5v4" event={"ID":"ac859c26-1b0b-46f8-afc7-9db4be59f30c","Type":"ContainerStarted","Data":"5e7ed2751dbafe8e6c993f2b2ef8fa13c1cfd96ed09184d1f8b4b75f9422850d"}
Aug 04 18:50:11.018224 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:11.017983    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-pf5v4"
Aug 04 18:50:11.040266 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:11.040219    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-pf5v4" podStartSLOduration=2.040204559 podStartE2EDuration="2.040204559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:50:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:50:11.038762732 +0000 UTC m=+3827.839899060" watchObservedRunningTime="2026-08-04 18:50:11.040204559 +0000 UTC m=+3827.841340886"
Aug 04 18:50:11.068623 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:11.068603    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8bxm5_e1d0f03c-af81-42ad-8fff-4d32ba94c3e7/dns/0.log"
Aug 04 18:50:11.131752 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:11.131736    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8bxm5_e1d0f03c-af81-42ad-8fff-4d32ba94c3e7/kube-rbac-proxy/0.log"
Aug 04 18:50:11.233614 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:11.233593    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qgjr8_4ff78307-0cd9-4551-9b67-95943e190bfe/dns-node-resolver/0.log"
Aug 04 18:50:11.792808 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:11.792787    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-64wn5_fbf8aa50-191e-49a4-8a78-c03a83900d95/node-ca/0.log"
Aug 04 18:50:12.747120 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:12.747096    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t_67403d95-d95b-429d-a77d-3ee880403375/istio-proxy/0.log"
Aug 04 18:50:12.935205 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:12.935182    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-99b5d7fdc-84grw_bcd30a0d-bc39-4769-9861-9e5f65d7edb4/kube-auth-proxy/0.log"
Aug 04 18:50:13.005855 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:13.005769    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-62kpw_fa5b1c34-ce88-4f98-9466-80eee08573f5/istio-proxy/0.log"
Aug 04 18:50:13.011440 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:13.011424    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-62kpw_fa5b1c34-ce88-4f98-9466-80eee08573f5/istio-proxy/1.log"
Aug 04 18:50:13.908531 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:13.908491    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ksm84_d109d386-1913-448d-a113-ca36b9aee7c0/serve-healthcheck-canary/0.log"
Aug 04 18:50:14.490868 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:14.490842    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s2256_b3cd662d-7512-46f5-8fcc-46055872098e/kube-rbac-proxy/0.log"
Aug 04 18:50:14.510862 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:14.510825    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s2256_b3cd662d-7512-46f5-8fcc-46055872098e/exporter/0.log"
Aug 04 18:50:14.530599 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:14.530580    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s2256_b3cd662d-7512-46f5-8fcc-46055872098e/extractor/0.log"
Aug 04 18:50:17.033207 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:17.033171    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-pf5v4"
Aug 04 18:50:17.232025 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:17.231999    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-mt7x5_d73003bb-823c-445a-a591-007b9f1f9ca9/manager/0.log"
Aug 04 18:50:17.362501 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:17.362422    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cddfbf4d9-wmlpw_ccbeea1c-9e31-4224-aeee-546b2ea781cd/manager/0.log"
Aug 04 18:50:17.384991 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:17.384967    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cddfbf4d9-wmlpw_ccbeea1c-9e31-4224-aeee-546b2ea781cd/copy-manifests/0.log"
Aug 04 18:50:18.775785 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:18.775766    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-564c4ff8f7-r9lfv_2c158356-a5c8-4647-ba41-89f481c78f2a/manager/0.log"
Aug 04 18:50:18.799301 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:18.799279    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-ds5xn_03b59ee4-df33-48e0-9991-9cd988234ab6/openshift-lws-operator/0.log"
Aug 04 18:50:19.756424 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:19.756399    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t_67403d95-d95b-429d-a77d-3ee880403375/istio-proxy/0.log"
Aug 04 18:50:19.929124 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:19.929056    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-99b5d7fdc-84grw_bcd30a0d-bc39-4769-9861-9e5f65d7edb4/kube-auth-proxy/0.log"
Aug 04 18:50:19.959765 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:19.959741    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-62kpw_fa5b1c34-ce88-4f98-9466-80eee08573f5/istio-proxy/0.log"
Aug 04 18:50:19.966678 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:19.966658    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-62kpw_fa5b1c34-ce88-4f98-9466-80eee08573f5/istio-proxy/1.log"
Aug 04 18:50:21.396152 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:21.396111    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-j6n2t_67403d95-d95b-429d-a77d-3ee880403375/istio-proxy/0.log"
Aug 04 18:50:21.579945 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:21.579891    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-99b5d7fdc-84grw_bcd30a0d-bc39-4769-9861-9e5f65d7edb4/kube-auth-proxy/0.log"
Aug 04 18:50:21.626869 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:21.626832    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-62kpw_fa5b1c34-ce88-4f98-9466-80eee08573f5/istio-proxy/0.log"
Aug 04 18:50:21.634941 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:21.634918    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-62kpw_fa5b1c34-ce88-4f98-9466-80eee08573f5/istio-proxy/1.log"
Aug 04 18:50:25.085268 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:25.085230    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-48dc2_72c8d5dc-4be4-4f9a-9cc3-51444e78301a/kube-multus/0.log"
Aug 04 18:50:25.108389 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:25.108368    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6lrlf_9800c9e0-bedf-4d65-a981-0cb8b0726c61/kube-multus-additional-cni-plugins/0.log"
Aug 04 18:50:25.127655 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:25.127635    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6lrlf_9800c9e0-bedf-4d65-a981-0cb8b0726c61/egress-router-binary-copy/0.log"
Aug 04 18:50:25.147069 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:25.147049    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6lrlf_9800c9e0-bedf-4d65-a981-0cb8b0726c61/cni-plugins/0.log"
Aug 04 18:50:25.165267 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:25.165244    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6lrlf_9800c9e0-bedf-4d65-a981-0cb8b0726c61/bond-cni-plugin/0.log"
Aug 04 18:50:25.184048 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:25.184030    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6lrlf_9800c9e0-bedf-4d65-a981-0cb8b0726c61/routeoverride-cni/0.log"
Aug 04 18:50:25.202028 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:25.202013    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6lrlf_9800c9e0-bedf-4d65-a981-0cb8b0726c61/whereabouts-cni-bincopy/0.log"
Aug 04 18:50:25.220482 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:25.220458    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6lrlf_9800c9e0-bedf-4d65-a981-0cb8b0726c61/whereabouts-cni/0.log"
Aug 04 18:50:25.603114 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:25.603093    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bqph9_cec46231-ba14-4b07-b2b1-df119f58db12/network-metrics-daemon/0.log"
Aug 04 18:50:25.620452 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:25.620432    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bqph9_cec46231-ba14-4b07-b2b1-df119f58db12/kube-rbac-proxy/0.log"
Aug 04 18:50:26.671071 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:26.671025    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwmwl_69dd0780-85db-48ac-adc9-eef4e735e68d/ovn-controller/0.log"
Aug 04 18:50:26.685169 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:26.685146    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwmwl_69dd0780-85db-48ac-adc9-eef4e735e68d/ovn-acl-logging/0.log"
Aug 04 18:50:26.708445 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:26.708423    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwmwl_69dd0780-85db-48ac-adc9-eef4e735e68d/kube-rbac-proxy-node/0.log"
Aug 04 18:50:26.731894 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:26.731869    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwmwl_69dd0780-85db-48ac-adc9-eef4e735e68d/kube-rbac-proxy-ovn-metrics/0.log"
Aug 04 18:50:26.759504 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:26.759485    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwmwl_69dd0780-85db-48ac-adc9-eef4e735e68d/northd/0.log"
Aug 04 18:50:26.779621 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:26.779574    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwmwl_69dd0780-85db-48ac-adc9-eef4e735e68d/nbdb/0.log"
Aug 04 18:50:26.801804 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:26.801775    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwmwl_69dd0780-85db-48ac-adc9-eef4e735e68d/sbdb/0.log"
Aug 04 18:50:26.851254 ip-10-0-141-220 kubenswrapper[2571]: I0804 18:50:26.851227    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwmwl_69dd0780-85db-48ac-adc9-eef4e735e68d/ovnkube-controller/0.log"